Member since
02-02-2016
583
Posts
518
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1341 | 09-16-2016 11:56 AM | |
700 | 09-13-2016 08:47 PM | |
2677 | 09-06-2016 11:00 AM | |
1444 | 08-05-2016 11:51 AM | |
2784 | 08-03-2016 02:58 PM |
06-27-2016
08:38 AM
Hi @alain TSAFACK can you please share what other way you found? It will help all members also in future.
... View more
06-27-2016
07:02 AM
Hi @Kumar Veerappan please let me know if you need any other info on this or kindly accept the answer to close this thread.
... View more
06-26-2016
08:48 AM
Hi @Manoj Dhake please let me know if you still facing this issue after applying the patch or if not then please accept the answer to close this thread.
... View more
06-24-2016
10:13 AM
2 Kudos
Looks like your cluster doesn't have default queue in schedule, please follow below similar post. https://community.hortonworks.com/questions/26646/failed-to-execute-tez-graph.html
... View more
06-24-2016
07:57 AM
2 Kudos
Here is a good doc to explain how to access hive through python. https://cwiki.apache.org/confluence/display/Hive/HiveClient#HiveClient-Python
... View more
06-24-2016
07:48 AM
Thanks for confirming, Lets close this thread after accepting this answer and work on new issue through https://community.hortonworks.com/questions/41451/ambari-server-failed-to-start-namenode-after-insta.html
... View more
06-23-2016
08:54 PM
I didn't expected it to work 🙂 , just shared because you had issue with pg_ctl start pg_ctl with root. can you please check postgres logs on below location and see if there is any clue? /var/lib/pgsql/data/pg_log
... View more
06-23-2016
03:55 PM
Thanks @Aman Mundra Glad it worked 🙂 , please accept the answer to close this thread.
... View more
06-23-2016
03:53 PM
1 Kudo
@Aman Mundra Smartsense bundle comes with ambari 2.2+ repos, since you are using 2.1 then you need to download it from support website. please follow below doc. https://docs.hortonworks.com/HDPDocuments/SS1/SmartSense-1.1.0/bk_smartsense_admin/bk_smartsense_admin-20151101.pdf
... View more
06-23-2016
03:41 PM
can you please share the output below command? cat /etc/yum.repos.d/ambari.repo
... View more
06-23-2016
03:36 PM
2 Kudos
Are you able to list it manually on that node? yum list 'smartsense*'
... View more
06-23-2016
02:30 PM
Yes, Please increase the datanode heapsize to 6G and restart the datanode services on all the hosts.
... View more
06-23-2016
02:29 PM
Please start from below doc according to your current and target version. https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.1.0/bk_upgrading_Ambari/content/_upgrading_hdp_stack.html
... View more
06-23-2016
02:18 PM
Since you have 256g RAM of machine then I would suggest you to keep databnode heap size between 6-8G You can change the heapsize from Ambari UI i.e HDFS-> Config see screenshot. screen-shot-2016-06-23-at-31802-pm.png
... View more
06-23-2016
02:09 PM
3 Kudos
Seems to be an issue of OOM with datanode, please increase the heapsize of datanode process and see if that resolve the issue. (BPServiceActor.java:run(851)) - Unexpected exception in block pool Block pool BP-1415030235-10.107.10 7.100-1452778704087 (Datanode Uuid c0f91520-d7ca-4fa3-b618-0832721376ad) service to /10.107.107.100:8020 java.lang.OutOfMemoryError: unable to create Also check ulimit size is sufficient on datanode machines. bash-4.1$ ulimit -a
... View more
06-23-2016
01:46 PM
4 Kudos
@Xiaobing Zhou Here is why we need always true fencing as a second option. This is done for workaround cases where the primary NameNode machine goes down and the ssh method will fail, and no failover will be performed. We want to avoid this, so the second option would be to failover anyway, even without fencing, which, as already mentioned, is safe with our setup. To achieve this, we specify two fencing methods, which will be tried by ZKFC in the order of: if the first one fails, the second one will be tried. In our case, the second one will always return success and failover will be initiated, even if the server running the primary NameNode is not available via ssh. We have tested this approach and it worked fine specially when Primary NN host down due to major hardware/power failure. Ref. https://www.packtpub.com/books/content/setting-namenode-ha
... View more
06-23-2016
01:21 PM
I don't see any workaround for this apart from code fix, please contact HWX support for official support patch.
... View more
06-23-2016
12:45 PM
2 Kudos
Please refer this JIRA https://issues.apache.org/jira/browse/ATLAS-588 and fixed in 0.7
... View more
06-23-2016
10:55 AM
1 Kudo
Please follow below posts and see if that resolve this issue. https://community.hortonworks.com/questions/15506/error-cannot-retrieve-repository-metadata-repomdxm.html https://community.hortonworks.com/questions/31523/facing-error-while-upgrading-from-hdp-23-to-24-usi.html
... View more
06-23-2016
10:33 AM
1 Kudo
You added it in wrong way, you need to append those confs in AMBARI_JVM_ARGS variable. After that restart the ambari server. export AMBARI_JVM_ARGS=$AMBARI_JVM_ARGS' -Xms512m -Xmx2048m -Djava.security.auth.login.config=/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhttp.proxyHost=proxy.sgp.hp.com -Dhttp.proxyPort=8080'
... View more
06-23-2016
10:18 AM
please follow this doc for ambari internet proxy setup. http://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_reference_guide/content/_how_to_set_up_an_internet_proxy_server_for_ambari.html
... View more
06-23-2016
10:14 AM
can you please share the output of below command from that node where its failing? yum list 'hadoop_2_4*-libhdfs*'
... View more
06-23-2016
09:56 AM
2 Kudos
Are you using any proxy to access internet?
... View more
06-23-2016
08:44 AM
2 Kudos
Yes, you can use hdfs checksum to find the file integrity on hdfs. See below jira's for more information. https://issues.apache.org/jira/browse/HADOOP-9209 https://issues.apache.org/jira/browse/HDFS-219 https://issues.apache.org/jira/browse/HADOOP-3981
... View more
06-23-2016
08:33 AM
2 Kudos
@Raja Ray As per the logs I couldn't find where datanode is getting down, can you please provide more logs? Also the error might not be relevant since it seems to be related to https://issues.apache.org/jira/browse/AMBARI-12420. Check if you are using same ambari version.
... View more
06-23-2016
08:29 AM
2 Kudos
First please check if namenode is up and running. If yes, then from datanode host run below command and see if it able to connect to the NN port. From DN: telnet 192.168.1.100 9000 If telnet is not responding then you might have firewall rules blocking the connection. Try disabling firewall and see if that make any difference.
... View more
06-22-2016
09:01 PM
2 Kudos
@Kumar Veerappan We recommend to upgrade HDP stack so that you can get appropriate version of spark which comes with stack instead of manually installing spark.
... View more
06-20-2016
04:04 PM
2 Kudos
Try adding spark assembly jar while running pyspark. pyspark --jars /usr/hdp/current/spark-client/lib/spark-assembly-<version>-hadoop2<version>.jar
... View more