Member since
11-09-2016
28
Posts
1
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1813 | 07-11-2017 05:42 AM | |
2812 | 07-10-2017 04:47 AM | |
2007 | 07-04-2017 06:36 AM | |
3821 | 06-08-2017 06:52 AM | |
5664 | 05-31-2017 04:35 PM |
07-13-2017
07:13 AM
@Tomomichi Hirano: Is this what you are looking for? https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_command-line-installation/content/ch09s15s02.html
... View more
07-13-2017
07:00 AM
@Harish Nerella If a table is to be used in ACID writes (insert, update, delete) then the table property "transactional=true" must be set on that table.Also, hive.txn.manager must be set to org.apache.hadoop.hive.ql.lockmgr.DbTxnManager either in hive-site.xml or in the beginning of the session before any query is run. Refer https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions for more details.
... View more
07-11-2017
05:42 AM
@Sami Ahmad The issue is happening as has_key has been removed starting from Python3. https://docs.python.org/3.1/whatsnew/3.0.html#builtins To solve the issue, edit yarn-utils.py to change the below lines and see if it helps:- if (reservedStack.has_key(memory)): to if (memory in reservedStack 😞 if (reservedHBase.has_key(memory)): to if (memory in reservedHBase):
... View more
07-11-2017
04:58 AM
@Greg Keys Yes. You are right. The JDBC URL for LLAP is same in HDP 2.5 and 2.6. And yes Hiveserver2 port is 10000 and LLAP port is 10500
... View more
07-10-2017
04:55 AM
@Guillaume Roger Hoping the attached link will help:- https://community.hortonworks.com/articles/14309/demystify-tez-tuning-step-by-step.html
... View more
07-10-2017
04:47 AM
@Greg Keys: The difference between LLAP and Hiveserver2 JDBC URL will be in zooKeeperNamespace. For LLAP the zookeeper namesepace would be hiveserver2-hive2 where as for hiveserver2 the zooKeeperNamespace=hiveserver2. Can you check the same?
... View more
07-04-2017
02:32 PM
@Guillaume Roger If AM memory (tez-site/tez.am.resource.memory.mb) is set to the min container size, only 1 application can be launched at any given point of time. Please tune the property depending on your requirement .
... View more
07-04-2017
06:36 AM
@Sylvain: Configured capacity of HDFS is calculated as Configured Capacity = Total Disk Space - Reserved Space Reserved space is the space which is allocated for OS level operations and set using the parameter dfs.datanode.du.reserved . Can you please let me know whats the total disk space in your scenario? Also is there any specific reason why dfs.datanode.du.reserved is set to a huge value?
... View more
07-04-2017
06:24 AM
@Guillaume Roger: The issue seems to be happening as the maximum application master limit has been set to 20%. Maximum percent of resources in the cluster which can be used to run application masters - controls number of concurrent active applications. Limits on each queue are directly proportional to their queue capacities and user limits. Since the limit here has been reached, I guess the application is not able to spawn another application master and hence the query is not running. Can we try increasing the parameter yarn.scheduler.capacity.maximum-am-resource-percent / yarn.scheduler.capacity.<queue-path>.maximum-am-resource-percent to 35% and see if it resolves the issue?
... View more
06-16-2017
04:21 AM
@Aditya Pratap: Please accept the answer if it solved your problem
... View more