Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 01-03-2018 05:53 PM
Hi,
All my oozie jobs are failing with java.lang.ClassNotFoundException. Please find complete log attached.
java.lang.RuntimeException: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2273) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:524) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$2.call(MRAppMaster.java:501) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1640) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:501) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:287) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$5.run(MRAppMaster.java:1598) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1595) at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1526) Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2241) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2265) ... 12 more Caused by: java.lang.ClassNotFoundException: Class org.apache.oozie.action.hadoop.OozieLauncherOutputCommitter not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2147) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2239)
How can I resolve this issue. Thanks in advance
Created 01-03-2018 05:55 PM
Can you please run this command and check the output. If it is kerberized environment , run kinit before running the command
oozie admin -oozie http://{oozie-host}:11000/oozie -shareliblist
If the above command doesn't return output like below then run the below mentioned commands as well. Make sure that the below list is returned
[Available ShareLib] hive distcp mapreduce-streaming spark oozie hcatalog hive2 sqoop pig spark_orig
Create the share lib
# /usr/hdp/<HDP Version>/oozie/bin/oozie-setup.sh sharelib create -fs hdfs://${NAMENODE-HOST}:8020Update Sharelib
# oozie admin -oozie http://{oozie-host}:11000/oozie -sharelibupdate
Thanks,
Aditya
Created 01-03-2018 05:55 PM
Can you please run this command and check the output. If it is kerberized environment , run kinit before running the command
oozie admin -oozie http://{oozie-host}:11000/oozie -shareliblist
If the above command doesn't return output like below then run the below mentioned commands as well. Make sure that the below list is returned
[Available ShareLib] hive distcp mapreduce-streaming spark oozie hcatalog hive2 sqoop pig spark_orig
Create the share lib
# /usr/hdp/<HDP Version>/oozie/bin/oozie-setup.sh sharelib create -fs hdfs://${NAMENODE-HOST}:8020Update Sharelib
# oozie admin -oozie http://{oozie-host}:11000/oozie -sharelibupdate
Thanks,
Aditya