Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 03-29-2016 04:31 AM
I use ambari 2.2.1.0 and use nonroot user running ther server and the agent.
Install hdp 2.3.4.0-3485 is ok,when I try to start the service such as hdfs ,it was failed with errors,the logs content is blow...
stderr: /var/lib/ambari-agent/data/errors-69.txtTraceback (most recent call last):
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 39, in <module>
BeforeStartHook().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 219, in execute
method(env)
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/hook.py", line 28, in hook
import params
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 141, in <module>
ambari_db_rca_password = config['hostLevelParams']['ambari_db_rca_password'][0]
TypeError: 'int' object is unsubscriptable
stdout: /var/lib/ambari-agent/data/output-69.txt
2016-03-29 12:21:52,902 - The hadoop conf dir /usr/hdp/current/hadoop-client/conf exists, will call conf-select on it for version 2.3.4.0-3485
2016-03-29 12:21:52,902 - Checking if need to create versioned conf dir /etc/hadoop/2.3.4.0-3485/0
2016-03-29 12:21:52,903 - call['conf-select create-conf-dir --package hadoop --stack-version 2.3.4.0-3485 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False, 'stderr': -1}
2016-03-29 12:21:52,952 - call returned (1, '/etc/hadoop/2.3.4.0-3485/0 exist already', '')
2016-03-29 12:21:52,952 - checked_call['conf-select set-conf-dir --package hadoop --stack-version 2.3.4.0-3485 --conf-version 0'] {'logoutput': False, 'sudo': True, 'quiet': False}
2016-03-29 12:21:52,996 - checked_call returned (0, '/usr/hdp/2.3.4.0-3485/hadoop/conf -> /etc/hadoop/2.3.4.0-3485/0')
2016-03-29 12:21:52,997 - Ensuring that hadoop has the correct symlink structure
2016-03-29 12:21:52,997 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
I had google it for times but no result about.
Created 04-07-2016 03:17 AM
I have reslove the problem.
as I posrt above ,I print the data struct
'ambari_db_rca_password':'123456',
I think it is a sting ,but when I print its type,it is a int type.
So I change the password to 'ambari',it is a sting,then every thing is goto OK!!!
Is still a problem of ambari
Created 03-29-2016 04:36 AM
Was there any errors while installation ?
Can you run the below command and paste the output here -
#ls -ltr /etc/hadoop
#ls -ltr /usr/hdp/current/
#hdp-select
Thanks
Sagar
Created 03-29-2016 05:49 AM
the informations is there:
ls -ltr /etc/hadoop total 8 drwxr-xr-x 2 root root 4096 Mar 28 16:07 conf.backup drwxr-xr-x 3 root root 4096 Mar 28 16:07 2.3.4.0-3485 lrwxrwxrwx 1 root root 35 Mar 28 16:07 conf -> /usr/hdp/current/hadoop-client/conf
ls -ltr /usr/hdp/current/ total 0 lrwxrwxrwx 1 root root 27 Mar 29 11:27 atlas-server -> /usr/hdp/2.3.4.0-3485/atlas lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-tracer -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-tablet -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-monitor -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-master -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-gc -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 30 Mar 29 11:27 accumulo-client -> /usr/hdp/2.3.4.0-3485/accumulo lrwxrwxrwx 1 root root 31 Mar 29 11:27 zookeeper-server -> /usr/hdp/2.3.4.0-3485/zookeeper lrwxrwxrwx 1 root root 31 Mar 29 11:27 zookeeper-client -> /usr/hdp/2.3.4.0-3485/zookeeper lrwxrwxrwx 1 root root 25 Mar 29 11:27 tez-client -> /usr/hdp/2.3.4.0-3485/tez lrwxrwxrwx 1 root root 27 Mar 29 11:27 storm-supervisor -> /usr/hdp/2.3.4.0-3485/storm lrwxrwxrwx 1 root root 41 Mar 29 11:27 storm-slider-client -> /usr/hdp/2.3.4.0-3485/storm-slider-client lrwxrwxrwx 1 root root 27 Mar 29 11:27 storm-nimbus -> /usr/hdp/2.3.4.0-3485/storm lrwxrwxrwx 1 root root 27 Mar 29 11:27 storm-client -> /usr/hdp/2.3.4.0-3485/storm lrwxrwxrwx 1 root root 27 Mar 29 11:27 sqoop-server -> /usr/hdp/2.3.4.0-3485/sqoop lrwxrwxrwx 1 root root 27 Mar 29 11:27 sqoop-client -> /usr/hdp/2.3.4.0-3485/sqoop lrwxrwxrwx 1 root root 27 Mar 29 11:27 spark-thriftserver -> /usr/hdp/2.3.4.0-3485/spark lrwxrwxrwx 1 root root 27 Mar 29 11:27 spark-historyserver -> /usr/hdp/2.3.4.0-3485/spark lrwxrwxrwx 1 root root 27 Mar 29 11:27 spark-client -> /usr/hdp/2.3.4.0-3485/spark lrwxrwxrwx 1 root root 28 Mar 29 11:27 slider-client -> /usr/hdp/2.3.4.0-3485/slider lrwxrwxrwx 1 root root 37 Mar 29 11:27 ranger-usersync -> /usr/hdp/2.3.4.0-3485/ranger-usersync lrwxrwxrwx 1 root root 32 Mar 29 11:27 ranger-kms -> /usr/hdp/2.3.4.0-3485/ranger-kms lrwxrwxrwx 1 root root 34 Mar 29 11:27 ranger-admin -> /usr/hdp/2.3.4.0-3485/ranger-admin lrwxrwxrwx 1 root root 25 Mar 29 11:27 pig-client -> /usr/hdp/2.3.4.0-3485/pig lrwxrwxrwx 1 root root 29 Mar 29 11:27 phoenix-server -> /usr/hdp/2.3.4.0-3485/phoenix lrwxrwxrwx 1 root root 29 Mar 29 11:27 phoenix-client -> /usr/hdp/2.3.4.0-3485/phoenix lrwxrwxrwx 1 root root 27 Mar 29 11:27 oozie-server -> /usr/hdp/2.3.4.0-3485/oozie lrwxrwxrwx 1 root root 27 Mar 29 11:27 oozie-client -> /usr/hdp/2.3.4.0-3485/oozie lrwxrwxrwx 1 root root 28 Mar 29 11:27 mahout-client -> /usr/hdp/2.3.4.0-3485/mahout lrwxrwxrwx 1 root root 26 Mar 29 11:27 knox-server -> /usr/hdp/2.3.4.0-3485/knox lrwxrwxrwx 1 root root 27 Mar 29 11:27 kafka-broker -> /usr/hdp/2.3.4.0-3485/kafka lrwxrwxrwx 1 root root 35 Mar 29 11:27 hive-webhcat -> /usr/hdp/2.3.4.0-3485/hive-hcatalog lrwxrwxrwx 1 root root 26 Mar 29 11:27 hive-server2 -> /usr/hdp/2.3.4.0-3485/hive lrwxrwxrwx 1 root root 26 Mar 29 11:27 hive-metastore -> /usr/hdp/2.3.4.0-3485/hive lrwxrwxrwx 1 root root 26 Mar 29 11:27 hive-client -> /usr/hdp/2.3.4.0-3485/hive lrwxrwxrwx 1 root root 27 Mar 29 11:27 hbase-regionserver -> /usr/hdp/2.3.4.0-3485/hbase lrwxrwxrwx 1 root root 27 Mar 29 11:27 hbase-master -> /usr/hdp/2.3.4.0-3485/hbase lrwxrwxrwx 1 root root 27 Mar 29 11:27 hbase-client -> /usr/hdp/2.3.4.0-3485/hbase lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-timelineserver -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-resourcemanager -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-nodemanager -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-yarn-client -> /usr/hdp/2.3.4.0-3485/hadoop-yarn lrwxrwxrwx 1 root root 38 Mar 29 11:27 hadoop-mapreduce-historyserver -> /usr/hdp/2.3.4.0-3485/hadoop-mapreduce lrwxrwxrwx 1 root root 38 Mar 29 11:27 hadoop-mapreduce-client -> /usr/hdp/2.3.4.0-3485/hadoop-mapreduce lrwxrwxrwx 1 root root 35 Mar 29 11:27 hadoop-httpfs -> /usr/hdp/2.3.4.0-3485/hadoop-httpfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-secondarynamenode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-portmap -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-nfs3 -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-namenode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-journalnode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-datanode -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 33 Mar 29 11:27 hadoop-hdfs-client -> /usr/hdp/2.3.4.0-3485/hadoop-hdfs lrwxrwxrwx 1 root root 28 Mar 29 11:27 hadoop-client -> /usr/hdp/2.3.4.0-3485/hadoop lrwxrwxrwx 1 root root 27 Mar 29 11:27 flume-server -> /usr/hdp/2.3.4.0-3485/flume lrwxrwxrwx 1 root root 28 Mar 29 11:27 falcon-server -> /usr/hdp/2.3.4.0-3485/falcon lrwxrwxrwx 1 root root 28 Mar 29 11:27 falcon-client -> /usr/hdp/2.3.4.0-3485/falcon
hdp-select accumulo-client - None accumulo-gc - None accumulo-master - None accumulo-monitor - None accumulo-tablet - None accumulo-tracer - None atlas-server - None falcon-client - None falcon-server - None flume-server - 2.3.4.0-3485 hadoop-client - 2.3.4.0-3485 hadoop-hdfs-datanode - 2.3.4.0-3485 hadoop-hdfs-journalnode - 2.3.4.0-3485 hadoop-hdfs-namenode - 2.3.4.0-3485 hadoop-hdfs-nfs3 - 2.3.4.0-3485 hadoop-hdfs-portmap - 2.3.4.0-3485 hadoop-hdfs-secondarynamenode - 2.3.4.0-3485 hadoop-httpfs - None hadoop-mapreduce-historyserver - 2.3.4.0-3485 hadoop-yarn-nodemanager - 2.3.4.0-3485 hadoop-yarn-resourcemanager - 2.3.4.0-3485 hadoop-yarn-timelineserver - 2.3.4.0-3485 hbase-client - None hbase-master - None hbase-regionserver - None hive-metastore - None hive-server2 - None hive-webhcat - None kafka-broker - None knox-server - None mahout-client - None oozie-client - None oozie-server - None phoenix-client - None phoenix-server - None ranger-admin - None ranger-kms - None ranger-usersync - None slider-client - None spark-client - None spark-historyserver - None spark-thriftserver - None sqoop-client - None sqoop-server - None storm-client - None storm-nimbus - None storm-slider-client - None storm-supervisor - None zookeeper-client - 2.3.4.0-3485 zookeeper-server - 2.3.4.0-3485
Created 03-29-2016 05:57 AM
Did you upgrade your HDP from 2.0.6 to HDP2.3.4?
Why your logs are shwoing "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/"
Created 03-29-2016 06:04 AM
No,I am not upgrade HDP,just test upgrade ambari,when I met the error:
and the problem is resolved now.
Then I install hdp,then met the error as I show in this topic
Created 03-29-2016 07:07 AM
do you resolved this problem ? i also has this problem
Created 03-29-2016 07:55 AM
I have google it and find out some people have the same problem ,but no body resloved it yet.
Just wait some to tell us and I will have some try.
Created 03-29-2016 08:13 AM
How to see the real command line ambari-agent execute? So I can debug the python yo find out what problem it is??
Created 03-29-2016 08:50 AM
@Sagar Shimpi @Divakar Annapureddy @gor don
I modifythe code of
/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
and find line 141:
ambari_db_rca_url = config['hostLevelParams']['ambari_db_rca_url'][0]
I add
import pprint print "xxxxxxxxxxxxxxx" pprint.pprint(config['hostLevelParams']) print "xxxxxxxxxxxxxxx"
to debug the dictionary content:
{'agentCacheDir': '/var/lib/ambari-agent/cache',
'ambari_db_rca_driver': 'com.mysql.jdbc.Driver',
'ambari_db_rca_password': '123456',
'ambari_db_rca_url': 'jdbc:mysql://127.0.0.1:3306/ambari',
'ambari_db_rca_username': 'ambari',
...So I think it call wrong,so I change
ambari_db_rca_url = config['hostLevelParams']['ambari_db_rca_url'][0]
to
ambari_db_rca_url = config['hostLevelParams']['ambari_db_rca_url']
then start the service is OK.
so I think is a bug of ambari-agent ??
Created 03-29-2016 11:20 AM
I have try to use an new virtual machine install the new ambari-agent version 2.2.1,but when I start server on that virtual machine,the ,og still told me :
File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py", line 141, in <module>
ambari_db_rca_password = config['hostLevelParams']['ambari_db_rca_password'][0]
TypeError: 'int' object is unsubscriptableSo I think there must be something wrong about the ambari-agent code.
May be the basic ambari-agent python lib change lead the problem??
PS: I use the local ambari and hdp repo.