Created 03-29-2016 04:31 AM
I use ambari 2.2.1.0 and use nonroot user running ther server and the agent.
Install hdp 2.3.4.0-3485 is ok,when I try to start the service such as hdfs ,it was failed with errors,the logs content is blow...
stderr: /var/lib/ambari-agent/data/errors-69.txtTraceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 39, in <module> BeforeStartHook().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute method(env) File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 28, in hook import params File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 141, in <module> ambari_db_rca_password = config['hostLevelParams']['ambari_db_rca_password'][0] TypeError: 'int' object is unsubscriptable stdout: /var/lib/ambari-agent/data/output-69.txt 2016-03-29 12:21:52,902 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.3.4.0-3485 2016-03-29 12:21:52,902 - Checking if need to create versioned conf dir /etc/hadoop/2.3.4.0-3485/0 2016-03-29 12:21:52,903 - call['conf-select create-conf-dir --package hadoop --stack-version 2.3.4.0-3485 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1} 2016-03-29 12:21:52,952 - call returned (1, '/etc/hadoop/2.3.4.0-3485/0 exist already', '') 2016-03-29 12:21:52,952 - checked_call['conf-select set-conf-dir --package hadoop --stack-version 2.3.4.0-3485 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False} 2016-03-29 12:21:52,996 - checked_call returned (0, '/usr/hdp/2.3.4.0-3485/hadoop/conf -> /etc/hadoop/2.3.4.0-3485/0') 2016-03-29 12:21:52,997 - Ensuring that hadoop has the correct symlink structure 2016-03-29 12:21:52,997 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
I had google it for times but no result about.
Created 04-07-2016 03:17 AM
I have reslove the problem.
as I posrt above ,I print the data struct
'ambari_db_rca_password':'123456',
I think it is a sting ,but when I print its type,it is a int type.
So I change the password to 'ambari',it is a sting,then every thing is goto OK!!!
Is still a problem of ambari
Created 03-29-2016 04:36 AM
Was there any errors while installation ?
Can you run the below command and paste the output here -
#ls -ltr /etc/hadoop
#ls -ltr /usr/hdp/current/
#hdp-select
Thanks
Sagar
Created 03-29-2016 05:49 AM
the informations is there:
ls -ltr /etc/hadoop total 8 drwxr-xr-x 2 root root 4096 Mar 28 16:07 conf.backup drwxr-xr-x 3 root root 4096 Mar 28 16:07 2.3.4.0-3485 lrwxrwxrwx 1 root root 35 Mar 28 16:07 conf -> /usr/hdp/current/hadoop-client/conf
ls -ltr /usr/hdp/current/ total 0 lrwxrwxrwx 1 root root 27 Mar 29 11:27 atlas-server -> /usr/hdp/2.3.4.0-3485/atlas lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-tracer -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-tablet -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-monitor -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-master -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-gc -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-client -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 31 Mar 29 11:27 zookeeper-server -> /usr/hdp/2.3.4.0-3485/zookeeper lrwxrwxrwx 1 root root 31 Mar 29 11:27 zookeeper-client -> /usr/hdp/2.3.4.0-3485/zookeeper lrwxrwxrwx 1 root root 25 Mar 29 11:27 tez-client -> /usr/hdp/2.3.4.0-3485/tez lrwxrwxrwx 1 root root 27 Mar 29 11:27 storm-supervisor -> /usr/hdp/2.3.4.0-3485/storm lrwxrwxrwx 1 root root 41 Mar 29 11:27 storm-slider-client -> /usr/hdp/2.3.4.0-3485/storm-slider-client lrwxrwxrwx 1 root root 27 Mar 29 11:27 storm-nimbus -> /usr/hdp/2.3.4.0-3485/storm lrwxrwxrwx 1 root root 27 Mar 29 11:27 storm-client -> /usr/hdp/2.3.4.0-3485/storm lrwxrwxrwx 1 root root 27 Mar 29 11:27 sqoop-server -> /usr/hdp/2.3.4.0-3485/sqoop lrwxrwxrwx 1 root root 27 Mar 29 11:27 sqoop-client -> /usr/hdp/2.3.4.0-3485/sqoop lrwxrwxrwx 1 root root 27 Mar 29 11:27 spark-thriftserver -> /usr/hdp/2.3.4.0-3485/spark lrwxrwxrwx 1 root root 27 Mar 29 11:27 spark-historyserver -> /usr/hdp/2.3.4.0-3485/spark lrwxrwxrwx 1 root root 27 Mar 29 11:27 spark-client -> /usr/hdp/2.3.4.0-3485/spark lrwxrwxrwx 1 root root 28 Mar 29 11:27 slider-client -> /usr/hdp/2.3.4.0-3485/slider lrwxrwxrwx 1 root root 37 Mar 29 11:27 ranger-usersync -> /usr/hdp/2.3.4.0-3485/ranger-usersync lrwxrwxrwx 1 root root 32 Mar 29 11:27 ranger-kms -> /usr/hdp/2.3.4.0-3485/ranger-kms lrwxrwxrwx 1 root root 34 Mar 29 11:27 ranger-admin -> /usr/hdp/2.3.4.0-3485/ranger-admin lrwxrwxrwx 1 root root 25 Mar 29 11:27 pig-client -> /usr/hdp/2.3.4.0-3485/pig lrwxrwxrwx 1 root root 29 Mar 29 11:27 phoenix-server -> /usr/hdp/2.3.4.0-3485/phoenix lrwxrwxrwx 1 root root 29 Mar 29 11:27 phoenix-client -> /usr/hdp/2.3.4.0-3485/phoenix lrwxrwxrwx 1 root root 27 Mar 29 11:27 oozie-server -> /usr/hdp/2.3.4.0-3485/oozie lrwxrwxrwx 1 root root 27 Mar 29 11:27 oozie-client -> /usr/hdp/2.3.4.0-3485/oozie lrwxrwxrwx 1 root root 28 Mar 29 11:27 mahout-client -> /usr/hdp/2.3.4.0-3485/mahout lrwxrwxrwx 1 root root 26 Mar 29 11:27 knox-server -> /usr/hdp/2.3.4.0-3485/knox lrwxrwxrwx 1 root root 27 Mar 29 11:27 kafka-broker -> /usr/hdp/2.3.4.0-3485/kafka lrwxrwxrwx 1 root root 35 Mar 29 11:27 hive-webhcat -> /usr/hdp/2.3.4.0-3485/hive-hcatalog lrwxrwxrwx 1 root root 26 Mar 29 11:27 hive-server2 -> /usr/hdp/2.3.4.0-3485/hive lrwxrwxrwx 1 root root 26 Mar 29 11:27 hive-metastore -> /usr/hdp/2.3.4.0-3485/hive lrwxrwxrwx 1 root root 26 Mar 29 11:27 hive-client -> /usr/hdp/2.3.4.0-3485/hive lrwxrwxrwx 1 root root 27 Mar 29 11:27 hbase-regionserver -> /usr/hdp/2.3.4.0-3485/hbase lrwxrwxrwx 1 root root 27 Mar 29 11:27 hbase-master -> /usr/hdp/2.3.4.0-3485/hbase lrwxrwxrwx 1 root root 27 Mar 29 11:27 hbase-client -> /usr/hdp/2.3.4.0-3485/hbase lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-timelineserver -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-resourcemanager -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-nodemanager -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-client -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 38 Mar 29 11:27 hadoop-mapreduce-historyserver -> /usr/hdp/2.3.4.0-3485/hadoop-mapreduce lrwxrwxrwx 1 root root 38 Mar 29 11:27 hadoop-mapreduce-client -> /usr/hdp/2.3.4.0-3485/hadoop-mapreduce lrwxrwxrwx 1 root root 35 Mar 29 11:27 hadoop-httpfs -> /usr/hdp/2.3.4.0-3485/hadoop-httpfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-secondarynamenode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-portmap -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-nfs3 -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-namenode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-journalnode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-datanode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-client -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 28 Mar 29 11:27 hadoop-client -> /usr/hdp/2.3.4.0-3485/hadoop lrwxrwxrwx 1 root root 27 Mar 29 11:27 flume-server -> /usr/hdp/2.3.4.0-3485/flume lrwxrwxrwx 1 root root 28 Mar 29 11:27 falcon-server -> /usr/hdp/2.3.4.0-3485/falcon lrwxrwxrwx 1 root root 28 Mar 29 11:27 falcon-client -> /usr/hdp/2.3.4.0-3485/falcon
hdp-select accumulo-client - None accumulo-gc - None accumulo-master - None accumulo-monitor - None accumulo-tablet - None accumulo-tracer - None atlas-server - None falcon-client - None falcon-server - None flume-server - 2.3.4.0-3485 hadoop-client - 2.3.4.0-3485 hadoop-hdfs-datanode - 2.3.4.0-3485 hadoop-hdfs-journalnode - 2.3.4.0-3485 hadoop-hdfs-namenode - 2.3.4.0-3485 hadoop-hdfs-nfs3 - 2.3.4.0-3485 hadoop-hdfs-portmap - 2.3.4.0-3485 hadoop-hdfs-secondarynamenode - 2.3.4.0-3485 hadoop-httpfs - None hadoop-mapreduce-historyserver - 2.3.4.0-3485 hadoop-yarn-nodemanager - 2.3.4.0-3485 hadoop-yarn-resourcemanager - 2.3.4.0-3485 hadoop-yarn-timelineserver - 2.3.4.0-3485 hbase-client - None hbase-master - None hbase-regionserver - None hive-metastore - None hive-server2 - None hive-webhcat - None kafka-broker - None knox-server - None mahout-client - None oozie-client - None oozie-server - None phoenix-client - None phoenix-server - None ranger-admin - None ranger-kms - None ranger-usersync - None slider-client - None spark-client - None spark-historyserver - None spark-thriftserver - None sqoop-client - None sqoop-server - None storm-client - None storm-nimbus - None storm-slider-client - None storm-supervisor - None zookeeper-client - 2.3.4.0-3485 zookeeper-server - 2.3.4.0-3485
Created 03-29-2016 05:57 AM
Did you upgrade your HDP from 2.0.6 to HDP2.3.4?
Why your logs are shwoing "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/"
Created 03-29-2016 06:04 AM
No,I am not upgrade HDP,just test upgrade ambari,when I met the error:
and the problem is resolved now.
Then I install hdp,then met the error as I show in this topic
Created 03-29-2016 07:07 AM
do you resolved this problem ? i also has this problem
Created 03-29-2016 07:55 AM
I have google it and find out some people have the same problem ,but no body resloved it yet.
Just wait some to tell us and I will have some try.
Created 03-29-2016 08:13 AM
How to see the real command line ambari-agent execute? So I can debug the python yo find out what problem it is??
Created 03-29-2016 08:50 AM
@Sagar Shimpi @Divakar Annapureddy @gor don
I modifythe code of
/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
and find line 141:
ambari_db_rca_url = config['hostLevelParams']['ambari_db_rca_url'][0]
I add
import pprint print "xxxxxxxxxxxxxxx" pprint.pprint(config['hostLevelParams']) print "xxxxxxxxxxxxxxx"
to debug the dictionary content:
{'agentCacheDir': '/var/lib/ambari-agent/cache', 'ambari_db_rca_driver': 'com.mysql.jdbc.Driver', 'ambari_db_rca_password': '123456', 'ambari_db_rca_url': 'jdbc:mysql://127.0.0.1:3306/ambari', 'ambari_db_rca_username': 'ambari', ...
So I think it call wrong,so I change
ambari_db_rca_url = config['hostLevelParams']['ambari_db_rca_url'][0]
to
ambari_db_rca_url = config['hostLevelParams']['ambari_db_rca_url']
then start the service is OK.
so I think is a bug of ambari-agent ??
Created 03-29-2016 11:20 AM
I have try to use an new virtual machine install the new ambari-agent version 2.2.1,but when I start server on that virtual machine,the ,og still told me :
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 141, in <module> ambari_db_rca_password = config['hostLevelParams']['ambari_db_rca_password'][0] TypeError: 'int' object is unsubscriptable
So I think there must be something wrong about the ambari-agent code.
May be the basic ambari-agent python lib change lead the problem??
PS: I use the local ambari and hdp repo.