I could resolve this issue by modifying the following parameters yarn.scheduler.minimum-allocation-mb=2560 yarn.nodemanager.resource.memory-mb=7680 yarn.app.mapreduce.am.resource.mb=2560 ... View more

@Sami Ahmad The sqoop output is generating a orc snappy file and the hive table you have created is a orc table without any compression. Do create a table with compression type snappy. CREATE TABLE mytable (...) STORED AS orc tblproperties ("orc.compress"="SNAPPY"); ... View more

resolved .. the following missing url was causing the issue hbase.rest.authentication.kerberos.principal=HTTP/_HOST@ ... View more

found out .. was missing this parameter in hbase config hbase.rest.authentication.kerberos.principal=HTTP/_HOST@ ... View more

@Sami Ahmad yes its possible to read hbase data using rest api. You need to start the rest api server first: $ hbase rest start By default this will listen on port 8080. URL used should be similar to this: http://<myhost>:8080/<mytable>/<rowkey1>/<cf:q>/ Documentation at: https://hbase.apache.org/1.2/apidocs/org/apache/hadoop/hbase/rest/package-summary.html HTH *** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer. ... View more

@Sami Ahmad, Yes. You can use the hbase REST API to manipulate data in HDP. By default the hbase rest server is not started. You need to start it first To start rest server in foreground # su hbase # hbase rest start -p {port to start the server} To start in background # su hbase # /usr/hdp/current/hbase-master/bin/hbase-daemon.sh start rest -p {port to start the server} . Ref: http://hbase.apache.org/book.html#_rest http://blog.cloudera.com/blog/2013/03/how-to-use-the-apache-hbase-rest-interface-part-1/ . You can also use the phoenix query server to do the manipulation using http using sqlline.py. But the interface it not REST. Phoenix is built on Apache Calcite. http://phoenix.apache.org/server.html . Please "Accept" the answer if this helps. -Aditya ... View more