The Error indicates that you might not have added the hive-site.xml (like: /etc/spark/conf/hive-site.xml) and required jar in spark-submit command.
Exception: ("You must build Spark with Hive. Export 'SPARK_HIVE=true' and run build/sbt assembly", Py4JJavaError(u'An error occurred while calling None.org.apache.spark.sql.hive.HiveContext.\n', JavaObject id=o50))
Usually we specify the hive-site.xml via command line as :
# spark-submit --master yarn-cluster --files /etc/spark/conf/hive-site.xml .........