Cloudera Community
Nyphel
user rank
New Contributor

Re: Data transformations at Spark level

by New Contributor in Support Questions
‎07-16-2015 01:28 AM
‎07-16-2015 01:28 AM
Hello,   Thanks for your answer. Spark allows me to do some transformations but it is not the main goal of Spark. A transformation tool would offer me more capabilities and would be more productive for tons of transformation rules to be produced, case by case. ... View more

Data transformations at Spark level

by New Contributor in Support Questions
‎07-13-2015 02:55 AM
‎07-13-2015 02:55 AM
Hello,   I'm trying to work with Spark and Cassandra to extract data from the data lake and transform it. Transformation may be done before of after loading in Cassandra.   About transformations, I'm wondering: what would be the transformation tool that would allow me to do transformations without wondering of data storage? I mean that, if tomorrow I don't want to use Cassandra anymore but Hadoop, I would like that my transformations remain valid. So, I would like that my transformation tool works with Spark directly and that my transformation tool do not take care of the tool Spark works with.   Please, could you recommend me a tool that would work with Spark and do not take care of undernying tools like Cassandra et Hadoop?   Thanks 🙂 ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎07-22-2015 02:05 AM
Community Statistics
Member Since ‎07-13-2015 02:48 AM
Last Visited ‎07-22-2015 02:05 AM
Posts 2