Support Questions

Find answers, ask questions, and share your expertise
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this solution


Summarising all of the above, assuming you need the spark - atlas hook in your system, the solution is as follows.


  • You need to add the file and spark-sql-kafka-0-10_2.11-<version>.jar to the Oozie shared spark  library.
  • The library is located on HDFS at <home>/oozie/share/lib/lib_<date>/spark.
  • The application properties file can be found in various places such as /etc/hive/conf.cloudera.hive/.
  • The jar file can be found in the parcels directory in /opt/cloudera/parcels/CDH/jars/.
  • When you copy the files they need to be owned by oozie.oozie and be world readable.
  • If you make any changes to the shared library you must then restart the Oozie server before jobs can find the new files.

View solution in original post

Who agreed with this solution