This could be permission issue. you can see  the hive server2 log for the error. Log will be in /var/log/hive on the node to which you connect the hive  ... View more

mapred.child.java.opts seems to be depricated. Below are the values from cluster and the one used in driver code. In Code : ======================= config.set("mapreduce.map.java.opts","-Xmx8192m") config.set("mapreduce.reduce.java.opts","-Xmx8192m"); In Cluster : ================================== <property> <name>mapreduce.reduce.java.opts</name> <value>-Xmx26214m</value> </property> <property> <name>mapreduce.map.java.opts</name> <value>-Xmx13107m</value> </property> ... View more

Yes I agree but I am trying to run hive query inside the map method. While using hive context, I am getting error that class is not serializable. ... View more

I'm reading from Hbase in a spark Hdp 2.3.4.0-3485 (and I've done reading with lower Hdp releases). Read hbase through a RDD: Configuration hbaseConfiguration = HBaseConfiguration.create(); hbaseConfiguration.set(TableInputFormat.INPUT_TABLE, "sometable"); JavaPairRDD<ImmutableBytesWritable, Result> hbaseRdd = sc.newAPIHadoopRDD(hbaseConfiguration, TableInputFormat.class, ImmutableBytesWritable.class, Result.class); Or am I missing something? ... View more

I am facing the same issue . Can someone please help ... View more

Thank you. ... View more

@pooja khandelwal I have tested this and this works. Accepting this as best answer. ... View more

Thank you @Alex Miller I imported the Knox SSl certificate into cacerts and used the below connection string . ( "jdbc:hive2://knoxserver.net:443/;ssl=true;transportMode=http;httpPath=knox/nn01/hive", "username", "pwd"); It finally worked.. 🙂 ... View more