Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2452 | 04-27-2020 03:48 AM | |
4891 | 04-26-2020 06:18 PM | |
3977 | 04-26-2020 06:05 PM | |
3222 | 04-13-2020 08:53 PM | |
4930 | 03-31-2020 02:10 AM |
03-20-2017
06:33 AM
@pratik vagyani An example of Sqoop’s export process will be to read a set of delimited text files from HDFS in parallel, parse them into records, and insert them as new rows in a target database table, for consumption by external applications or users. So ideally it can be any node in your HDP cluster where you have the sqoop installed and can access the HDFS.
... View more
03-20-2017
06:26 AM
@vrathod
As this issue is resolved then please mark the answer as "Accepted".
... View more
03-20-2017
05:04 AM
@Elvis Zhang
It is strange to see the following error: [WARNING] emitter.py:84 - Error sending metrics to server. [Errno 113] No route to host . Which means the ambari metrics monitors are not able to communicate to AMS collector on the mentioned port. hence the data (memory/CPU ...etc) are not being emitted. Can you please check if from the metrics monitor host you are able to connect to AMS collector host/port (Just to see that there is no Firewall restriction on the port.) # telnet bn-003.hadoop 6188
. Also are the FQDNs correctly configured through out the cluster. So that you get the correct hostname in the following command output: # hostname -f
. Also please see: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/set_the_hostname.html and http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-installation/content/edit_the_network_configuration_file.html
... View more
03-20-2017
03:09 AM
@Elvis Zhang
If you have just added AMS to your cluster then the services need to be restarted to initiate the Sink. That is controlled by metrics properties file like: # cat /etc/hadoop/conf/hadoop-metrics2.properties Also in the NameNode (DataNode) logs do you see that the "Sink timeline started" is started as following: # less /var/log/hadoop/hdfs/hadoop-hdfs-namenode-erie1.example.com.log
INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(82)) - Initializing Timeline metrics sink.
INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(100)) - Identified hostname = erie1.example.com, serviceName = namenode
INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(118)) - Collector Uri: <a href="http://erie2.example.com:6188/ws/v1/timeline/metrics">http://erie2.example.com:6188/ws/v1/timeline/metrics</a>
INFO timeline.HadoopTimelineMetricsSink (HadoopTimelineMetricsSink.java:init(166)) - RPC port properties configured: {8020=client}
NFO impl.MetricsSinkAdapter (MetricsSinkAdapter.java:start(206)) - Sink timeline started
... View more
03-20-2017
03:04 AM
@Elvis Zhang
In the following log file do you see any error? /var/log/ambari-metrics-collector/ambari-metrics-collector.log . What is the ambari server ambari metrics collector version? Is it same on all hosts? Are you seeing the same version for all AMS & ambari components? # rpm -qa | grep ambari* .
... View more
03-20-2017
02:49 AM
@Elvis Zhang Can you please check if the "metrics-monitor" component is running on all the hosts? Please check: # ps -ef | grep ^ams
ams 14933 1 0 02:50 ? 00:00:00 /usr/bin/python2.6 /usr/lib/python2.6/site-packages/resource_monitoring/main.py start . If it is not running then please start it and then check the Amabri UI again in few minutes. Also please let us know which version of ambari is it? And do you see any error inside the following log? # less /var/log//ambari-metrics-monitor/ambari-metrics-monitor.out (all hosts) . Also please check if the following file is pointing to correct AMS collector host & port. # less /etc/ambari-metrics-monitor/conf/metric_monitor.ini
... View more
03-19-2017
02:40 PM
@Allen Niu
Unfortunately currently there is no HA feature available for Ambari yet. However you can refer to the following JIRAs where the discussion is going on in this regard: https://issues.apache.org/jira/browse/AMBARI-17126 AND https://issues.apache.org/jira/browse/AMBARI-7896 - Following link also has some good information regarding the same: https://community.hortonworks.com/questions/402/how-to-setup-high-availability-for-ambari-server.html
... View more
03-19-2017
12:57 PM
@Francisco Pires Please check if your sandbox host has the following service crashed/stopped? # service shellinaboxd status
# service shellinaboxd start
# netstat -tnlpa | grep 4200 . Also pelase check if by mistake someone has changed the port int he following config? # cat /etc/sysconfig/shellinaboxd | grep -i PORT
PORT=4200 .
... View more
03-18-2017
07:10 PM
@vrathod
The driver jar might have been deleted accidentally. As i have never seen such issue earlier, there is no existing JIRA as well on the similar issue. So i am suspecting that it might be deleted accidentally.
... View more
03-18-2017
02:58 PM
@Micaël Dias Are you able to access the port where you are getting the "connection to broker kafka.host.com:6667 (id: 1003 rack: null) was unsuccessful" error "Failed to find leader for Set([newmikl,0]) (kafka.consumer.ConsumerFetcherManager$LeaderFinderThread)" ? telnet kafka.host.com 6667 . On the kafka broker host please verify if the port is opened. Example: # netstat -tnlpa | grep 6667
tcp 0 0 ::ffff:172.26.70.154:6667 :::* LISTEN 15573/java
tcp 0 0 ::ffff:172.26.70.154:6667 ::ffff:172.26.70.154:48623 ESTABLISHED 15573/java
tcp 0 0 ::ffff:172.26.70.154:48623 ::ffff:172.26.70.154:6667 ESTABLISHED 15573/java .
... View more