I'm reading from Hbase in a spark Hdp 2.3.4.0-3485 (and I've done reading with lower Hdp releases). Read hbase through a RDD: Configuration hbaseConfiguration = HBaseConfiguration.create(); hbaseConfiguration.set(TableInputFormat.INPUT_TABLE, "sometable"); JavaPairRDD<ImmutableBytesWritable, Result> hbaseRdd = sc.newAPIHadoopRDD(hbaseConfiguration, TableInputFormat.class, ImmutableBytesWritable.class, Result.class); Or am I missing something? ... View more

--driver-java-options "-Dlog4j.debug=true -Dlog4j.configuration=file://${BASEDIR}/src/main/resources/log4j.properties" \ --conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=file:///log4j.properties" \ --files "{${BASEDIR}/src/main/resources}" \ So, for the driver I use the driver-java-options and for the executer I combine the conf and the files. ... View more