@Divya Gehlot Couple suggestions HBase is not performant for scans as it is a db for random reads/writes. If scans are to be performs do it on the key and not the columns. ... View more

disable iptables http://www.cyberciti.biz/faq/turn-on-turn-off-firewall-in-linux/ disable selinux http://www.crypt.gen.nz/selinux/disable_selinux.html ... View more

@Michael Rife On ambari home page what does it show in terms of resource usage on your sandbox? Are their any orphan jobs running? ... View more

straight out of the docs: SET pig.splitCombination false; A = LOAD 'hawq://mdw1:5432/gpadmin' USING com.gopivotal.pig.HawqLoader('retail_demo.products_dim', 'gpadmin'); DESCRIBE A; A: {product_id: int,category_id: int,price: bigdecimal,product_name: chararray} B = LOAD 'hawq://mdw1:5432/gpadmin' USING com.gopivotal.pig.HawqLoader('retail_demo.vinyl_counts', 'gpadmin'); DESCRIBE B; B: {category_id: int,count: int} C = JOIN A BY category_id, B by category_id USING 'replicated'; STORE C INTO '$output'; ... View more

@Amit SharmaDid this resolve your issue? ... View more

@also take a look here about spark security. SASL encryption is currently supported for the block transfer service when authentication ( spark.authenticate ) is enabled. To enable SASL encryption for an application, set spark.authenticate.enableSaslEncryption to true in the application’s configuration. When using an external shuffle service, it’s possible to disable unencrypted connections by setting spark.network.sasl.serverAlwaysEncrypt to true in the shuffle service’s configuration. If that option is enabled, applications that are not set up to use SASL encryption will fail to connect to the shuffle service. ... View more