Can you outline the type of queries involving probability_score and real_labelVal fields ? The answer to the above would determine whether declaring fields as String is good practice. ... View more

Looks like HBASE-14963 was integrated into HDP 2.3 on Fri Jan 22 Can you post the commit hash of the HDP you use ? Please post the complete stack trace. Thanks ... View more

Please install Azure storage SDK for Java (com.microsoft.azure:azure-storage) ... View more

Can you try setting the following before invoking spark-shell ? export HADOOP_HOME=/usr/hdp/current/hadoop-client You can also set the following in conf/log4j.properties: log4j.logger.org.apache.spark.repl.Main=DEBUG so that you can get more information. ... View more

Can you describe the function of the coprocessor ? It should be possible to use shell and observe the side effect your coprocessor makes. ... View more

You can find a ton of hbase coprocessors under: https://github.com/apache/phoenix ... View more

Where is the custom jar located ? Can you show related snippet from hbase-site.xml ? Thanks ... View more

In region server log, you should observe something similar to the following: 2016-06-16 19:44:10,222 INFO [regionserver/hbase5-merge-normalizer-3.openstacklocal/172.22.78.125:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.AccessController was loaded successfully with priority (536870911). If the coprocessor was loaded per table, you can use 'describe' command in shell to verify. ... View more

The functions `phoenixTableAsDataFrame`, `phoenixTableAsRDD` and `saveToPhoenix` all support optionally specifying a `conf` Hadoop configuration parameter with custom Phoenix client settings, as well as an optional `zkUrl` parameter for the Phoenix connection URL. val configuration = new Configuration() // set zookeeper.znode.parent and hbase.zookeeper.quorum in the conf "TABLE1", Seq("ID", "COL1"), conf = configuration ... View more