Hi all, Is possible to create an workflow on Oozie that automatically execute some Hive, Pig and Spark scripts in order to automate my analytics process? Many thanks! ... View more

Hi experts, How can I overwrite an existing file by a new one (data update). Imagine that I've this: result.map(pair => pair.swap).sortByKey(true).saveAsTextFile("FILE/results") And Imagine that I want to do this: test.map(pair => pair.swap).sortByKey(false).saveAsTextFile("FILE/results") How can I overwrite the results of the var result to the results of the val test in same directory? ... View more

What is the bigger advantage of using Hadoop instead SQL Server or ODI when we aren't in a Big Data Scenario? Many thanks! ... View more

Hi experts, I've this statment in Apache PIG: ... Count = FOREACH data GENERATE SUM(Field); ... How can do a IF Statement like this: IF(SUM(Field) > 10) Store into X; ELSE STORE into Y; Is possible to do this? Many thanks! ... View more

Hi, I have four tables in .csv. All of them can be conected through a fact table (that are in .csv too). I wanna to do some data cleansing to this files and next put them into a Big Table in Have. But in Apache PIG should I've to create a script by table individually, or is better to join in PIG and then aplly some data cleansing in this normalized table? Thanks! ... View more