Support Questions

Find answers, ask questions, and share your expertise
Welcome to the upgraded Community! Read this blog to see What’s New!

Program executing Tez engine instead of Spark

Rising Star

Hello All,


We have a Spark program which executes multiple queries and the tables are Hive tables. 


Currently the queries are executed using Tez engine from Spark.


I set it sqlContext.sql("SET hive.execution.engine=spark") in the program and understand that the queries/program would run as Spark. We are using HDP 2.6.5 version and Spark 2.3.0 version in our cluster. 

Can someone suggest that it is the correct way as we do not need to run the queries using Tez engine and Spark should run as it is .


In the config file /etc/spark2/conf/hive-site.xml, we do not have any specific engine property setup and we do have only kerberos, metastore property details.