A simple Spark1 Java application to show a list of tables in Hive Metastore is as follows: import org.apache.spark.SparkContext; import org.apache.spark.SparkConf; import org.apache.spark.sql.hive.HiveContext; import org.apache.spark.sql.DataFrame; public class SparkHiveExample { public static void main(String[] args) { SparkConf conf = new SparkConf().setAppName("SparkHive Example"); SparkContext sc = new SparkContext(conf); HiveContext hiveContext = new org.apache.spark.sql.hive.HiveContext(sc); DataFrame df = hiveContext.sql("show tables"); df.show(); } } Note that Spark pulls metadata from Hive metastore and also uses hiveql for parsing queries but the execution of queries as such happens in the Spark execution engine. ... View more

On Hive CLI depending on the execution engine, for "mr" you can use "set mapred.job.queue.name=<queuename>;" or for "tez" you can use "set tez.queue.name=<queuename>;". ... View more

Can you share the query? You can workaround this by setting hive.execution.engine=mr. ... View more

Are you using NULL in the select clause, in that case you might be encountering HIVE-11217. As per the JIRA there is no fix but the error message is improved with something like: CREATE-TABLE-AS-SELECT creates a VOID type, please use CAST to specify the type ... View more