@kanna k Try to set below parameters, hope it should work: add to ambari.properties: client.threadpool.size.max = 50 and then ambari-server restart ... View more

@Dhiraj Refer this article: http://www.michael-noll.com/blog/2011/04/09/benchmarking-and-stress-testing-an-hadoop-cluster-with-terasort-testdfsio-nnbench-mrbench/ ... View more

@Carlton Patterson In your table.hql, please copy all your query and past it. Then run below command, by passing your beeline connection and input as table.hql(which has your query) so that it will allow you to store your output in required format. The output format can anything from below formats. beeline -u 'jdbc:hive2://zookeeper1:2181,zookeeper2:2181,zookeeper3:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2'--outputformat=csv2 -f table.hql > /hadoop/hdfs/tableslist.csv --outputformat=[table/vertical/csv/tsv/dsv/csv2/tsv2] Format mode for result display. Default is table. See Separated-Value Output Formats below for description of recommended sv options. Usage: beeline --outputformat=tsv https://cwiki.apache.org/confluence/display/Hive/HiveServer2+Clients#HiveServer2Clients-OutputFormats Hope this helps you. ... View more

@karthik nedunchezhiyan Did you get chance to look this arictle https://community.hortonworks.com/articles/27225/how-qjm-works-in-namenode-ha.html ... View more

@Rodrigo Mendez I have just validated, if you set hive.server2.enable.doas=true. The end directory(hdfs://hdp_cluster/user/my_user/output_folder) will be created with user name who ever is running that job. Please check your Kerberos ticket for that user and proxy configurations. Hope this helps you. ... View more

@na I think thats expected behaaviour. For your scenario I would better suggest to go for DistCp between Snapshot Difference. distcp -update -diff -delete /source /destination How to Use This Feature To use this feature, you should first make sure all assumptions are met. Typical steps are described as follows: Create snapshot s0 in the source directory. Issue a default distcp command that copies everything from s0 to the target directory (command line is like distcp -update <sourceDir>/.snapshot/s0 <targetDir> ). Create snapshot s0 in the target dir. Make some changes in the source dir. Create a new snapshot s1, and issue a distcp command like distcp -update -diff s0 s1 <sourceDir> <targetDir> to copy all changes between s0 and s1 to the target directory. Create a snapshot with the same name s1 in the target dir. Repeat steps 4 to 6 with a new snapshot name—for example, s2. Link Hope this helps you. ... View more