Member since
06-22-2020
10
Posts
0
Kudos Received
0
Solutions
07-05-2020
02:49 PM
@paras ,Please find workflow.xml as below. <workflow-app name="Customer_Journey_FirstActions_Events_Set2" xmlns="uri:oozie:workflow:0.5"> <credentials> <credential name="hs2-cred" type="hive2"> <property> <name>hive2.jdbc.url</name> <value>jdbc:hive2://adcuxxxx.adcbmis.local:10001/db_appldigi;transportMode=http;httpPath=cliservice</value> </property> <property> <name>hive2.server.principal</name> <value>hive/adcuxxxx.adcbmis.local@xxxxxMIS.LOCAL</value> </property> </credential> </credentials> <start to="Trash1"/> <action name="Trash1" cred="hs2-cred"> <fs> <name-node>${nameNode}</name-node> <delete path="/user/anja21614/.Trash"></delete> </fs> <ok to="FirstActions2"/> <error to="kill"/> </action> <action name="FirstActions2" cred="hs2-cred"> <hive2 xmlns="uri:oozie:hive2-action:0.2"> <job-tracker>${resourceManager}</job-tracker> <name-node>${nameNode}</name-node> <configuration> <property> <name>fs.trash.interval</name> <value>0</value> </property> <property> <name>hive.exec.scratchdir</name> <value>/appldigi/tmp</value> </property> </configuration> <jdbc-url>jdbc:hive2://adcuxxxx.adcbmis.local:10001/db_appldigi;transportMode=http;httpPath=cliservice</jdbc-url> <script>FirstActions2.hql</script> <param>-Dyarn.app.mapreduce.am.staging-dir=/appldigi/tmp</param> <file>/user/anja21614/CustomerJourney/FirstActions2.hql</file> </hive2> <ok to="Trash3"/> <error to="kill"/> </action> <action name="Trash3" cred="hs2-cred"> <fs> <name-node>${nameNode}</name-node> <delete path="/user/anja21614/.Trash"></delete> </fs> <ok to="end"/> <error to="kill"/> </action> <kill name="kill"> <message>${wf:errorMessage(wf:lastErrorNode())}</message> </kill> <end name="end"/> </workflow-app> please note you can find scratch directory configuration in workflow which I just added. Please check and let me know if the configuration is correctly mentioned, I had already tried this configuration in Ambari hive which was giving me error.
... View more
06-29-2020
10:21 PM
@AnjaliRocks , I have sent you a PM for further details.
... View more
06-27-2020
12:40 PM
Is ther any solution for this issue. I am facing same issue. Table is holding very huge data and while doing insert overwrite , files are getting placed in my user directory, /user/anjali/.Trash, causing hive action in oozie to fail after 1.5 hr long run. Please help. The table is external and ev even I changed it to internal table, auto purge = true is not working.
... View more