@Kuldeep Kulkarni, Yes it was a problem with my rpm command, that's why yum hung. I rebuild rpmdb and everything working fine now. thanks a ton. 🙂 ... View more

@Kevin Sievers Hi Kevin, your commands look good to me, somehow he does not take the number of reduce tasks though. You are right Hadoop should be MUCH faster. But the one reduce task and even weirder one mapper seem to be the problem And I assure you it runs with a lot of mappers and 40 reducers and is loading and transforming around 300 GB of data in 20 minutes on an 7 datanode cluster. So basically I have NO idea why he does only one mapper, I have no idea why he has the second Reducer AT ALL. I have no idea why he ignores the mapred.reduce.tasks parameter? I think a support ticket might be in order. set hive.tez.java.opts = "-Xmx3600m"; set hive.tez.container.size = 4096; set mapred.reduce.tasks=120; CREATE EXTERNAL TABLE STAGING ... ... insert into TABLE TARGET partition (day = 20150811) SELECT * FROM STAGING distribute by DT ; ... View more

Thanks Laurence Da Luz . It helped me ... View more

@Kuldeep Kulkarni, Hi, I have tried the same. Even after installing the kerberos client Manuallly, I get the same error. not sure, why the Test Kerberos client fails, I need to skip that and go to second page. * All the hosts got the Kerberos client installed. Kerberos Clients 3 Kerberos Clients Installed 1.jpg ... View more

Thank you all for the response. ... View more

@Davide Isoardi - You are welcome! 🙂 ... View more

Thanks @Ali Bajwa ... View more

HI Kuldeep, Thanks for the post. Need one help. I am trying to run the above example and checking for previous day date in input-events using <instance>${coord:current(-1)}</instance> But it is failing. When I use <instance>${coord:current(0)}</instance> then it runs successfully . here is my dryrun oozie output. Please help with hints/suggestions ***coordJob after parsing: ***<coordinator-app xmlns="uri:oozie:coordinator:0.1" name="my_Scheduler_5f" frequency="1" start="2016-08-17T23:40Z" end="2016-08-19T23:45Z" timezone="America/Los_Angeles" freq_timeunit="DAY" end_of_duration="NONE"> <controls> <timeout>30</timeout> </controls> <input-events> <data-in name="coordInput_1" dataset="input1"> <dataset name="input1" frequency="1" initial-instance="2016-08-17T00:00Z" timezone="America/Los_Angeles" freq_timeunit="DAY" end_of_duration="NONE"> <uri-template>${nameNode}/myHdfsPath/Finalpath1/${YEAR}${MONTH}${DAY}/00/</uri-template> <done-flag>_Complete</done-flag> </dataset> <instance>${coord:current(-1)}</instance> </data-in> <data-in name="coordInput_2" dataset="input2"> <dataset name="input2" frequency="1" initial-instance="2016-08-17T23:00Z" timezone="America/Los_Angeles" freq_timeunit="DAY" end_of_duration="NONE"> <uri-template>${nameNode}/myHdfsPath/Finalpath2/${YEAR}${MONTH}${DAY}/00/</uri-template> <done-flag>_Complete</done-flag> </dataset> <instance>${coord:current(-1)}</instance> </data-in> </input-events> <action> <workflow> <app-path>${nameNode}/myHdfsPath/My_POC/wf-app-dir</app-path> <configuration> <property> <name>date</name> <value>${coord:formatTime(coord:dateOffset(coord:actualTime(),-1,'DAY'), "yyyyMMdd")}</value> </property> </workflow> </action></coordinator-app>***actions for instance*** Question with full details. https://community.hortonworks.com/questions/52412/how-to-configure-oozie-coordinator-dataset-for-pre.html ... View more

Hi, this Looks like fifo-scheduling / capacity scheduling with 1 group only Try to switch to fair scheduling in yarn. Regards, Volker ... View more

@Inam Ur Rehman - You wont be able to run latest version of sandbox with 4G RAM. You can try older version though ... View more