About sancar_sn

sancar_sn · ‎11-06-2017

@Predrag Minovic could you please let me know how did you created hive avro table from hive text table? did you select from text table and created avro table using CREATE AS SELECT?

sancar_sn · ‎01-26-2017

Is there any maven repository for Spark Hbase connector [https://github.com/hortonworks-spark/shc], which is compatible with Spark 1.6.1 and Hbase 1.1.2? Or i have to build the jar from Git Hub? https://github.com/hortonworks-spark/shc/blob/master/pom.xml. If i have to build the jar from Git, is the above Git link is the correct one? Since we are using HDP 2.4.2 is it available in the HDP Distribution some where? or should i use the spark-packages. I cannot use 0.0.11-1.6.1-s_2.10 this version, because the hbase connection leak is fixed after this version as per this pull request https://github.com/hortonworks-spark/shc/issues/19

sancar_sn · ‎01-23-2017

@Vadim Vaks: Thanks for the answer, so we cannot list the Hbase tables using Spark SQL Context.

sancar_sn · ‎01-23-2017

@Bikas We are actually using HortonWorks Hbase connector, But i cannot use this API to list tables, this is just for one POC , which we are trying to list Hbase tables.

sancar_sn · ‎01-22-2017

I would like to list Hbase tables using Spark SQL. Tried below code, but its not working. Do we need to set hbase host, zookeeper quorum etc details in the Spark sql context options? val sparkConf = new SparkConf().setAppName("test") val sc= new SparkContext(sparkConf) val sqlContext = new SQLContext(sc) val hiveContext = new HiveContext(sqlContext) val listOfTables = hiveContext.sql("list") listOfTables.show

sancar_sn · ‎11-15-2016

We are just trying to read the Hbase table using HortonWorks Hbase connector, we also tried newHadoopAPI, all are same problem.

sancar_sn · ‎11-15-2016

@Rajkumar Singh we are getting null pointer exception, when we try to access the table programmatically, but when we try with hbase console its working, what could be the issue? when i checked in zkcli get /hbase-secure, the data length is 0.

sancar_sn · ‎11-15-2016

I would like to understand where is zookeeper base path is available and how do i check it? in hbase-site.xml it is configured[zookeeper.znode.parent] as /hbase-secure, but i dont see any hdfs folders on that name. Is it something automatically getting created? we are getting some weird error related to this path.

sancar_sn · ‎10-18-2016

@Constantin Stanca : Can i use this as a Maven dependency? or i should use it as Standard Spark package? what is the difference? i never used Standard Spark package.

sancar_sn · ‎10-17-2016

We are planning to use Spark Hbase connector from HortonWorks for the new project.[https://github.com/hortonworks-spark/shc] Since we are using HortonWorks 2.4.2, the supported Spark Version is 1.6.1 Can we use this Spark-Hbase connector jar in Spark 1.6.1?

Online	Offline
Last Visited	‎11-06-2017 11:58 AM

Member Since	‎10-17-2016 03:48 PM
Last Visited	‎11-06-2017 11:58 AM
Posts	21
Kudos received	3

Cloudera Community

Re: how to create and store the avro files in hive...

Spark Hbase connector latest version for Spark 1.6...

Re: List hbase tables Spark sql

Re: List hbase tables Spark sql

List hbase tables Spark sql

Re: What is zookeeper base path and how it is get ...

Re: What is zookeeper base path and how it is get ...

What is zookeeper base path and how it is get crea...

Re: Spark Hbase connector for Spark 1.6.1 version

Spark Hbase connector for Spark 1.6.1 version