Summarising all of the above, assuming you need the spark - atlas hook in your system, the solution is as follows.

• You need to add the file atlas-application.properties and spark-sql-kafka-0-10_2.11-<version>.jar to the Oozie shared spark  library.
• The library is located on HDFS at <home>/oozie/share/lib/lib_<date>/spark.
• The application properties file can be found in various places such as /etc/hive/conf.cloudera.hive/.
• The jar file can be found in the parcels directory in /opt/cloudera/parcels/CDH/jars/.
• When you copy the files they need to be owned by oozie.oozie and be world readable.
• If you make any changes to the shared library you must then restart the Oozie server before jobs can find the new files.