Member since
02-08-2016
793
Posts
669
Kudos Received
85
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3072 | 06-30-2017 05:30 PM | |
3994 | 06-30-2017 02:57 PM | |
3314 | 05-30-2017 07:00 AM | |
3888 | 01-20-2017 10:18 AM | |
8406 | 01-11-2017 02:11 PM |
06-20-2016
12:05 PM
@Silvio del Valhbase keeps the replication WAL logs until the peer is removed. remove_peer can fixed the problem. This can help out - http://stackoverflow.com/questions/28725364/hbase-oldwals-what-it-is-and-how-can-i-clean-it
... View more
06-20-2016
09:17 AM
@Pradeep Bhadani Run MySQL install on that machine manually to resolve dependency issues, you have conflicts between Marian and MySQL
... View more
06-17-2016
01:06 PM
@Ahmad Debbas 1. kafka server host should only have kafka broker service. 2. Edge node will only have "Clients" services like [HDFS,Yarn,Kafka,ZK]. You only need to tick for "client" over here. 3. Unless you have any specific services to be allotted to any host let it be evenly distributed across 3 master nodes For Production scenario we usually have below scenario Master1 - NN,ZK Master2 - RM,SNN,ZK,AM EdgeNode - All clients + hive,oozie,sqoop,etc.. Rest DN's +NM ===
... View more
06-17-2016
12:42 PM
5 Kudos
1.Configure sample ambari alert
using Ambari UI. . 2.Login to ambari webui using
[admin/admin] . 3.Click on "Alerts" .
. 4.Click "Action"->
"Manage Notification" . 5.Add sample alert for service . 6. In above example you can use
Gmail username and password to test connection. . 7. After adding sample alert close the screen. . 8.From
the ambari ui now stop one of the zookeeper service . . 9.You
should be able to see alert indication in ambari ui for the zookeeper service
stopped . . 10. Same time if you tail for
ambari-alerts.log you will be able to see "Connection Failed"
log messages for zookeeper service. . 2016-05-27 14:57:31,541 [CRITICAL] [ZOOKEEPER] [zookeeper_server_process] (ZooKeeper Server Process) Connection failed: [Errno 111] Connection refused to node1.example.com:2181 . 11. Check your email and make
sure you receive the alert. . 12. If you don’t see alerts the
enable debugging for Alerts in ambari log4j.properties as shown below. . 13. Login to ambari server cli
using superuser credentials [eg. root] . vi /etc/ambari-server/conf/log4j.properties
Modify
- log4j.logger.alerts=INFO,alerts to log4j.logger.alerts=DEBUG,alerts
Add below line to Alerts section -
log4j.logger.org.apache.ambari.server.notifications.dispatchers=DEBUG,alerts . 14. Save the file and restart
ambari server service. . 15. Try to stop zookeeper on any
one of the node and check for the ambari-server.log and amabri-alerts.log. . 16. You should be able to see the
alert logs sent on email via smtp settings you did. . 17. If there are any smtp errors
you will see those in "/var/log/ambari-server/ambari-server.log"
... View more
Labels:
06-15-2016
06:08 PM
2 Kudos
@chandramouli muthukumaran 1. Namenode : 2 directories are enough for backing up namenode metadata in case of any crash of namenode. Usually 1st disk should be local disk and prefer 2nd disk as network storage[san/nas](Just incase local machine goes down you can have backup of namenode metadata on network storage). If you do not have network storage then 2 local disk are fine. Disadvantage of multiple disk for storage - I/O performance will hamper as namenode will copy metadata to all the disk. 2. Datanodes : If you have multiple HDD attached to the machine then we can usually use them for HDFS data storage. Multiple disk on datanode is not a problem. For datanode it will not store multiple copies of same data on all disk as of Namenode. Please check link below with basic concept explained -http://hortonworks.com/blog/hdfs-metadata-directories-explained/
... View more
06-15-2016
03:07 PM
1 Kudo
It clearly say its OutOfMemory issue "java.lang.OutOfMemoryError: PermGen space java.lang.OutOfMemoryError: PermGen space" Pls check this to resolve the issue - https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.2.0/bk_ambari_views_guide/content/ch_preparing_ambari_for_views.html
... View more
06-14-2016
06:42 PM
@Mukesh Burman You can also check Ambari Blueprints for automation
... View more
06-14-2016
03:49 PM
Thanks for the update.
... View more
06-14-2016
03:32 PM
1 Kudo
@Pranay Vyas Pls check this - http://hortonworks.com/blog/enabling-kerberos-hdp-active-directory-integration/ This is internally manager within script by ambari. You can check the process details on what command it executes when ambari tries to create principals for services.
... View more
06-14-2016
03:03 PM
1 Kudo
@Raghu Ramamoorthi Can you let us know which link you followed for HIVE view installation ? Can you check ambari-server logs for fore error log details
... View more