Sorry. The details on the data node are as follows: /usr/hdp 2.4.0.0-169 current /usr/hdp/current accumulo-client falcon-client flume-server -> /usr/hdp/2.4.0.0-169/flume hadoop-client -> /usr/hdp/2.4.0.0-169/hadoop hadoop-hdfs-client -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-datanode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-journalnode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-namenode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-nfs3 -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-portmap -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-secondarynamenode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-httpfs -> /usr/hdp/2.4.0.0-169/hadoop-httpfs hadoop-mapreduce-client -> /usr/hdp/2.4.0.0-169/hadoop-mapreduce hadoop-mapreduce-historyserver -> /usr/hdp/2.4.0.0-169/hadoop-mapreduce hadoop-yarn-client -> /usr/hdp/2.4.0.0-169/hadoop-yarn hadoop-yarn-nodemanager -> /usr/hdp/2.4.0.0-169/hadoop-yarn hadoop-yarn-resourcemanager -> /usr/hdp/2.4.0.0-169/hadoop-yarn hadoop-yarn-timelineserver -> /usr/hdp/2.4.0.0-169/hadoop-yarn hbase-client -> /usr/hdp/2.4.0.0-169/hbase hbase-master -> /usr/hdp/2.4.0.0-169/hbase hbase-regionserver -> /usr/hdp/2.4.0.0-169/hbase hive-client -> /usr/hdp/2.4.0.0-169/hive phoenix-client -> /usr/hdp/2.4.0.0-169/phoenix phoenix-server -> /usr/hdp/2.4.0.0-169/phoenix pig-client -> /usr/hdp/2.4.0.0-169/pig spark-client -> /usr/hdp/2.4.0.0-169/spark tez-client -> /usr/hdp/2.4.0.0-169/tez zookeeper-client -> /usr/hdp/2.4.0.0-169/zookeeper zookeeper-server -> /usr/hdp/2.4.0.0-169/zookeeper ... View more

Thanks Alejandro Fernandez namenode: hdp-select-version 2.4.0.0-169 hdp-select status: accumulo-client - 2.4.0.0-169 accumulo-gc - 2.4.0.0-169 accumulo-master - 2.4.0.0-169 accumulo-monitor - 2.4.0.0-169 accumulo-tablet - 2.4.0.0-169 accumulo-tracer - 2.4.0.0-169 atlas-server - 2.4.0.0-169 falcon-client - None falcon-server - None flume-server - None hadoop-client - 2.4.0.0-169 hadoop-hdfs-datanode - 2.4.0.0-169 hadoop-hdfs-journalnode - 2.4.0.0-169 hadoop-hdfs-namenode - 2.4.0.0-169 hadoop-hdfs-nfs3 - 2.4.0.0-169 hadoop-hdfs-portmap - 2.4.0.0-169 hadoop-hdfs-secondarynamenode - 2.4.0.0-169 hadoop-httpfs - None hadoop-mapreduce-historyserver - 2.4.0.0-169 hadoop-yarn-nodemanager - 2.4.0.0-169 hadoop-yarn-resourcemanager - 2.4.0.0-169 hadoop-yarn-timelineserver - 2.4.0.0-169 hbase-client - None hbase-master - None hbase-regionserver - None hive-metastore - None hive-server2 - None hive-webhcat - None kafka-broker - None knox-server - None mahout-client - None oozie-client - None oozie-server - None phoenix-client - None phoenix-server - None ranger-admin - None ranger-kms - None ranger-usersync - None slider-client - None spark-client - 2.4.0.0-169 spark-historyserver - 2.4.0.0-169 spark-thriftserver - 2.4.0.0-169 sqoop-client - None sqoop-server - None storm-client - None storm-nimbus - None storm-slider-client - None storm-supervisor - None zeppelin-server - None zookeeper-client - 2.4.0.0-169 zookeeper-server - 2.4.0.0-169 /usr/hdp folder in namenode 2.4.0.0-169 current /usr/hdp/current accumulo-client -> /usr/hdp/2.4.0.0-169/accumulo accumulo-gc -> /usr/hdp/2.4.0.0-169/accumulo accumulo-master -> /usr/hdp/2.4.0.0-169/accumulo accumulo-monitor -> /usr/hdp/2.4.0.0-169/accumulo accumulo-tablet -> /usr/hdp/2.4.0.0-169/accumulo accumulo-tracer -> /usr/hdp/2.4.0.0-169/accumulo atlas-server -> /usr/hdp/2.4.0.0-169/atlas falcon-client -> /usr/hdp/2.4.0.0-169/falcon falcon-server -> /usr/hdp/2.4.0.0-169/falcon flume-server -> /usr/hdp/2.4.0.0-169/flume hadoop-client -> /usr/hdp/2.4.0.0-169/hadoop hadoop-hdfs-client -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-datanode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-journalnode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-namenode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-nfs3 -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-portmap -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-hdfs-secondarynamenode -> /usr/hdp/2.4.0.0-169/hadoop-hdfs hadoop-httpfs -> /usr/hdp/2.4.0.0-169/hadoop-httpfs hadoop-mapreduce-client -> /usr/hdp/2.4.0.0-169/hadoop-mapreduce hadoop-mapreduce-historyserver -> /usr/hdp/2.4.0.0-169/hadoop-mapreduce hadoop-yarn-client -> /usr/hdp/2.4.0.0-169/hadoop-yarn hadoop-yarn-nodemanager -> /usr/hdp/2.4.0.0-169/hadoop-yarn hadoop-yarn-resourcemanager -> /usr/hdp/2.4.0.0-169/hadoop-yarn hadoop-yarn-timelineserver -> /usr/hdp/2.4.0.0-169/hadoop-yarn hbase-client -> /usr/hdp/2.4.0.0-169/hbase hbase-master -> /usr/hdp/2.4.0.0-169/hbase hbase-regionserver -> /usr/hdp/2.4.0.0-169/hbase hive-client -> /usr/hdp/2.4.0.0-169/hive hive-metastore -> /usr/hdp/2.4.0.0-169/hive hive-server2 -> /usr/hdp/2.4.0.0-169/hive hive-webhcat -> /usr/hdp/2.4.0.0-169/hive-hcatalog kafka-broker -> /usr/hdp/2.4.0.0-169/kafka knox-server -> /usr/hdp/2.4.0.0-169/knox mahout-client -> /usr/hdp/2.4.0.0-169/mahout oozie-client -> /usr/hdp/2.4.0.0-169/oozie oozie-server -> /usr/hdp/2.4.0.0-169/oozie phoenix-client -> /usr/hdp/2.4.0.0-169/phoenix phoenix-server -> /usr/hdp/2.4.0.0-169/phoenix pig-client -> /usr/hdp/2.4.0.0-169/pig lranger-admin -> /usr/hdp/2.4.0.0-169/ranger-admin ranger-kms -> /usr/hdp/2.4.0.0-169/ranger-kms ranger-usersync -> /usr/hdp/2.4.0.0-169/ranger-usersync slider-client -> /usr/hdp/2.4.0.0-169/slider spark-client -> /usr/hdp/2.4.0.0-169/spark spark-historyserver -> /usr/hdp/2.4.0.0-169/spark spark-thriftserver -> /usr/hdp/2.4.0.0-169/spark sqoop-client -> /usr/hdp/2.4.0.0-169/sqoop sqoop-server -> /usr/hdp/2.4.0.0-169/sqoop storm-client -> /usr/hdp/2.4.0.0-169/storm storm-nimbus -> /usr/hdp/2.4.0.0-169/storm storm-slider-client -> /usr/hdp/2.4.0.0-169/storm-slider-client storm-supervisor -> /usr/hdp/2.4.0.0-169/storm tez-client -> /usr/hdp/2.4.0.0-169/tez zeppelin-server -> /usr/hdp/2.4.0.0-169/zeppelin zookeeper-client -> /usr/hdp/2.4.0.0-169/zookeeper Zookeeper-server -> /usr/hdp/2.4.0.0-169/zookeeper I guess I need to uninstall Ambari-server, agent and all files/folders/users, etc and try again. Thanks for the help. ... View more

What a struggle this has become! I cleaned out everything. All the errors and warnings in the previous posts have gone 🙂 App timeline server failed to install File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call raise Fail(err_msg) resource_management.core.exceptions.Fail: Execution of 'ambari-sudo.sh /usr/bin/hdp-select set all `ambari-python-wrap /usr/bin/hdp-select versions | grep ^2.4 | tail -1`' returned 1. Traceback (most recent call last): File "/usr/bin/hdp-select", line 375, in <module> setPackages(pkgs, args[2], options.rpm_mode) File "/usr/bin/hdp-select", line 268, in setPackages os.symlink(target + "/" + leaves[pkg], linkname) OSError: [Errno 17] File exists @Neeraj Sabharwal : Could you please advise what's causing this error please? I have no idea what's causing this problem. I did clean everything inc ambari-server and ambari-agent before this reinstall. I look forward to some help and guidance. Thanks - Sundar ... View more

Having not found anything on the net to resolve the process issue warning, I ignored it (not sure if this is wise). It will be great to get a resolution of this java-classpath warning. In addition, after ignoring it, I am now stuck on a mysql error. I have not found anything on this either. My repository does not have anything on mysql either, although community edition 5.7.11 is running. The error on the namenode is as follows. I hope some one will be able to guide me on the process issue as well as the mysql conflict. resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install mysql-community-release' returned 1. Error: mysql57-community-release conflicts with mysql-community-release-el7-5.noarch You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest ... View more

Can I ignore this warning message please? Process Issues (1) The following process should not be running /usr/lib/jvm/jre/bin/java -classpath ... View more

I manually registered the datanode (slave) after installing/starting ambari-agent. Cllcking register and confirm produced (1) one failed --- master node and (2) one success - datanode containing the agent - response. I ran python /usr/lib/python2.6/site-packages/ambari_agent/HostCleanup.py in the master node. I got "no such file or directory" Thanks for looking into this. ... View more

I still do not know why ssh (pw-less) works only from the master to slave and not vice versa. I am getting the following errors. I hope some one can guide here please. thanks 11 Mar 2016 15:54:44,732 WARN [qtp-ambari-agent-55] SecurityFilter:103 - Request https://namenode.teg:8440/ca doesn't match any pattern. 11 Mar 2016 15:54:44,732 WARN [qtp-ambari-agent-55] SecurityFilter:62 - This request is not allowed on this port: https://namenode.teg:8440/ca ... View more

I used the below command to set up pwless ssh between two ec2 instances. It works from master to slave but vice-versa. [ec2-user@datanode .ssh]$ cat id_rsa.pub |ssh ec2-user@ec2-xx-xx-xx-xx.compute-1.amazonaws.com `cat >> .ssh/authorized_keys` -bash: .ssh/authorized_keys: No such file or directory cat: id_rsa.pub: Permission denied Pseudo-terminal will not be allocated because stdin is not a terminal. Permission denied (publickey,gssapi-keyex,gssapi-with-mic). [ec2-user@datanode .ssh]$ -- [ec2-user@datanode ~]$ ssh ec2-user@ip-xxx.ec2.internal Permission denied (publickey,gssapi-keyex,gssapi-with-mic). [ec2-user@datanode .ssh]$ ... View more