Member since
05-09-2016
421
Posts
54
Kudos Received
32
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2516 | 04-22-2022 11:31 AM | |
2268 | 01-20-2022 11:24 AM | |
2140 | 11-23-2021 12:53 PM | |
2862 | 02-07-2018 12:18 AM | |
4710 | 06-08-2017 09:13 AM |
06-14-2016
08:47 AM
Can you check yarn.resourcemanager.address in your yarn-site.xml? What is the value set there?
... View more
06-13-2016
07:06 PM
@Manikandan Durairaj Can you check your Namenode port. This generally occur when you are using wrong NN port number. Please share your oozie job properties file.
... View more
06-13-2016
07:00 PM
@Yogeshprabhu Check this out https://community.hortonworks.com/articles/38149/how-to-create-and-register-custom-ambari-alerts.html
... View more
06-13-2016
10:13 AM
@Manikandan Durairaj If you are using HDP hadoop with yarn then default port is 8088 which is same as resource manager port.
... View more
06-10-2016
07:29 AM
Yes kafka store its log at local disk. To push kafka logs to hdfs you need something like http://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/
... View more
06-10-2016
04:38 AM
@Sunile Manjee I did not follow. I guess Kafka uses local storage anyway for log storage not hdfs. Can you share more details?
... View more
06-10-2016
04:00 AM
@Kaliyug Antagonist Q. If the repositories and JDK is now available locally, will Ambari still try to access the Internet? Can you elaborate on the other dependencies ? Ans. Your ambari server will not need internet connection if you are not adding it to cluster hosts. However for all the hosts which you will register by ambari, assuming you are using centos or redhat server; when you try to register hosts it will do yum install for hadoop packages and there may be certain dependencies for that packages which will be fetched from Centos base repo. For installing those dependencies you will need internet or you have to create local base repo of centos.
... View more
06-09-2016
02:57 PM
Kaliyug Antagonist Q. To avoid installing JDK on the management(and others, too) machine, the Internet access to http://public-repo-1.hortonworks.com/ has been enabled on all the machines only for a day. I set the 'export http_proxy' and set-up the Ambari server which internally fetched the Oracle 8 JDK. Somehow, 'java -version' still doesn't work, does Ambari really install JDK. Ans. Have you set JAVA_HOME correctly? Ambari by default install java at /usr/jdk64 Q. The Ambari agents will be installed auto. during the cluster install later but then there would be NO Internet connection. How is java(jdk) installed on the other nodes then ? Is it that Ambari pushes the /var/lib/ambari-server/resources/jdk-8u60-linux-x64.tar.gz to all the nodes manually(after all, hadoop would require java) Ans. Yes that is correct. Q. Is it safe to remove the Internet access now Ans. Yes it is safe. However not sure of you have other dependencies on internet.
... View more
06-08-2016
10:05 AM
1 Kudo
NameNode Last Checkpoint alert of Ambari looks to have bug in case cluster have Namenode HA configured. The alert runs script /var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/alerts/alert_checkpoint_time.py This script uses dfs.namenode.http-address property of hdfs-site.xml as per below NN_HTTP_ADDRESS_KEY = '{{hdfs-site/dfs.namenode.http-address}}' However in case of HA enabled cluster this will not work as this property will not be there in HA enabled cluster. Can anyone confirm if this is a bug? Rahul
... View more
Labels:
- Labels:
-
Apache Ambari
06-08-2016
04:55 AM
@bandhu gupta I can see you have mounted /var and /usr on different filesystem which has enough space available. You can ignore the warning and continue if possible. Let me know how it goes.
... View more