Support Questions
Find answers, ask questions, and share your expertise

Zookeeper issues with new 5.4.7 Manager install on CentOS

Zookeeper issues with new 5.4.7 Manager install on CentOS

Explorer

Hi - I am trying to install a cluster with Manager, I think it's 5.4.7 and I am using CentOS.

 

I've chosen the roles, but when the Manager is trying to start and initialize services it fails on Zookeeper.

 

The errror I get is:

 

Initializing ZooKeeper Service
Completed only 1/3 steps. First failure: Command (62) has failed

 

Nothing is going in to the zookeeper log folder.   It makes an empty subfolder called stacks only.

 

supervisord.log has entries like these:

 

2015-10-26 13:57:14,782 INFO exited: 23-zookeeper-init (exit status 1; not expected)
2015-10-26 14:06:27,297 INFO spawned: '26-zookeeper-init' with pid 3281
2015-10-26 14:06:27,319 INFO success: 26-zookeeper-init entered RUNNING state, process has stayed up for > than 0 seconds (startsecs)

 

the cloudera-scm-agent.log when I click "retry":

 

[26/Oct/2015 14:11:41 +0000] 15438 CP Server Thread-8 _cplogging INFO 172.26.0.41 - - [26/Oct/2015:14:11:41] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[26/Oct/2015 14:11:42 +0000] 15438 CP Server Thread-9 _cplogging INFO 172.26.0.41 - - [26/Oct/2015:14:11:42] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[26/Oct/2015 14:11:42 +0000] 15438 CP Server Thread-10 _cplogging INFO 172.26.0.41 - - [26/Oct/2015:14:11:42] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Deleting process 29-zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Triggering supervisord update.
[26/Oct/2015 14:11:42 +0000] 15438 CP Server Thread-11 _cplogging INFO 172.26.0.41 - - [26/Oct/2015:14:11:42] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Retiring process 29-zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread util INFO Using generic audit plugin for process zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread util INFO Creating metadata plugin for process zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread util INFO Using specific metadata plugin for process zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread util INFO Using generic metadata plugin for process zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent WARNING Not creating a monitor for 32-zookeeper-init: MonitorDaemon not created yet
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Activating Process 32-zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Created /var/run/cloudera-scm-agent/process/32-zookeeper-init
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Chowning /var/run/cloudera-scm-agent/process/32-zookeeper-init to zookeeper (406) zookeeper (488)
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/32-zookeeper-init to 0751
[26/Oct/2015 14:11:42 +0000] 15438 MainThread parcel INFO prepare_environment begin: {u'CDH': u'5.4.7-1.cdh5.4.7.p0.3'}, [u'cdh'], [u'cdh-plugin', u'zookeeper-plugin']
[26/Oct/2015 14:11:42 +0000] 15438 MainThread parcel INFO The following requested parcels are not available: {}
[26/Oct/2015 14:11:42 +0000] 15438 MainThread parcel INFO Obtained tags ['cdh', 'impala', 'sentry', 'solr', 'spark'] for parcel CDH
[26/Oct/2015 14:11:42 +0000] 15438 MainThread parcel INFO prepare_environment end: {'CDH': '5.4.7-1.cdh5.4.7.p0.3'}
[26/Oct/2015 14:11:42 +0000] 15438 MainThread util INFO Extracted 10 files and 0 dirs to /var/run/cloudera-scm-agent/process/32-zookeeper-init.
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Created /var/run/cloudera-scm-agent/process/32-zookeeper-init/logs
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Chowning /var/run/cloudera-scm-agent/process/32-zookeeper-init/logs to zookeeper (406) zookeeper (488)
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/32-zookeeper-init/logs to 0751
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO reading limits: {u'limit_memlock': None, u'limit_fds': None}
[26/Oct/2015 14:11:42 +0000] 15438 MainThread agent INFO Triggering supervisord update.
[26/Oct/2015 14:11:42 +0000] 15438 MainThread navigator_plugin INFO Scheduling a refresh for Audit Plugin for zookeeper-init with pipelines []
[26/Oct/2015 14:11:42 +0000] 15438 MainThread navigator_plugin INFO Scheduling a refresh for Metadata Plugin for zookeeper-init with pipelines []
[26/Oct/2015 14:11:42 +0000] 15438 Metadata-Plugin navigator_plugin INFO Refreshing Metadata Plugin for zookeeper-init with pipelines []
[26/Oct/2015 14:11:42 +0000] 15438 Metadata-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[26/Oct/2015 14:11:42 +0000] 15438 Audit-Plugin navigator_plugin INFO Refreshing Audit Plugin for zookeeper-init with pipelines []
[26/Oct/2015 14:11:42 +0000] 15438 Audit-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[26/Oct/2015 14:11:44 +0000] 15438 MainThread agent INFO PID '3817' associated with process '32-zookeeper-init' with payload 'processname:32-zookeeper-init groupname:32-zookeeper-init from_state:RUNNING expected:0 pid:3817' exited unexpectedly
[26/Oct/2015 14:11:44 +0000] 15438 MainThread agent WARNING Process exited event for process '32-zookeeper-init' does not have a monitor to handle event - the event will be ignored.
[26/Oct/2015 14:11:59 +0000] 15438 MainThread agent INFO Process with same id has changed: 32-zookeeper-init.
[26/Oct/2015 14:11:59 +0000] 15438 MainThread agent INFO Deactivating process 32-zookeeper-init
[26/Oct/2015 14:12:02 +0000] 15438 Metadata-Plugin navigator_plugin INFO stopping Metadata Plugin for zookeeper-init with pipelines []
[26/Oct/2015 14:12:02 +0000] 15438 Metadata-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)
[26/Oct/2015 14:12:02 +0000] 15438 Audit-Plugin navigator_plugin INFO stopping Audit Plugin for zookeeper-init with pipelines []
[26/Oct/2015 14:12:02 +0000] 15438 Audit-Plugin navigator_plugin_pipeline INFO Stopping Navigator Plugin Pipeline '' for zookeeper-init (log dir: None)

 

 

Does anyone know why it would do this and how to fix it?

 

Thanks!

7 REPLIES 7

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

Do you see any clues in stderrand stdout in
/var/run/cloudera-scm-agent/process/32-zookeeper-init/logs? You could also
ensure the permissions of the /var/lib/zookeeper/version-2 directory is
writable by the zookeeper user.

Regards,
Gautam Gopalakrishnan

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

Explorer

I didn't get a 34 folder.   I guess since I have retried this a few times I have several:

 

# ls -al | grep zoo
drwxr-x--x 3 zookeeper zookeeper 280 Oct 26 13:55 19-zookeeper-init
drwxr-x--x 3 zookeeper zookeeper 280 Oct 26 13:57 21-zookeeper-init
drwxr-x--x 3 zookeeper zookeeper 280 Oct 26 14:06 24-zookeeper-init
drwxr-x--x 3 zookeeper zookeeper 280 Oct 26 14:06 27-zookeeper-init
drwxr-x--x 3 zookeeper zookeeper 280 Oct 26 14:11 30-zookeeper-init
drwxr-x--x 3 zookeeper zookeeper 280 Oct 26 14:15 34-zookeeper-init
drwxr-x--x 3 zookeeper zookeeper 260 Oct 26 14:15 37-zookeeper-init

 

I will paste the stderr from the 19 and 37 folders below.

 

19:

 

Mon Oct 26 13:54:32 PDT 2015
+ source_parcel_environment
+ '[' '!' -z /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/meta/cdh_env.sh ']'
+ OLD_IFS='
'
+ IFS=:
+ SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS)
+ DIRNAME_ARRAY=($PARCEL_DIRNAMES)
+ IFS='
'
+ COUNT=1
++ seq 1 1
+ for i in '`seq 1 $COUNT`'
+ SCRIPT=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/meta/cdh_env.sh
+ PARCEL_DIRNAME=CDH-5.4.7-1.cdh5.4.7.p0.3
+ . /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/meta/cdh_env.sh
++ CDH_DIRNAME=CDH-5.4.7-1.cdh5.4.7.p0.3
++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-0.20-mapreduce
++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-0.20-mapreduce
++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-hdfs
++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-hdfs
++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-httpfs
++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-httpfs
++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-mapreduce
++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-mapreduce
++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-yarn
++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-yarn
++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase
++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase
++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive
++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive
++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hue
++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hue
++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/oozie
++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/oozie
++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/flume-ng
++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/flume-ng
++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/pig
++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/pig
++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive-hcatalog
++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive-hcatalog
++ export CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sqoop2
++ CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sqoop2
++ export CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/llama
++ CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/llama
++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sentry
++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sentry
++ export TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-tomcat
++ TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-tomcat
++ export JSVC_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils
++ JSVC_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils
++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop/bin/hadoop
++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop/bin/hadoop
++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/impala
++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/impala
++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/solr
++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/solr
++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase-solr
++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase-solr
++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/search
++ SEARCH_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/search
++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark
++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark
++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-kms
++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-kms
+ locate_cdh_java_home
+ '[' -z '' ']'
+ '[' -z /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils ']'
+ local BIGTOP_DETECT_JAVAHOME=
+ for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"'
+ '[' -e /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome ']'
+ BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome
+ break
+ '[' -z /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome ']'
+ . /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome
++ BIGTOP_DEFAULTS_DIR=/etc/default
++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']'
++ JAVA6_HOME_CANDIDATES=('/usr/lib/j2sdk1.6-sun' '/usr/lib/jvm/java-6-sun' '/usr/lib/jvm/java-1.6.0-sun-1.6.0' '/usr/lib/jvm/j2sdk1.6-oracle' '/usr/lib/jvm/j2sdk1.6
-oracle/jre' '/usr/java/jdk1.6' '/usr/java/jre1.6')
++ OPENJAVA6_HOME_CANDIDATES=('/usr/lib/jvm/java-1.6.0-openjdk' '/usr/lib/jvm/jre-1.6.0-openjdk')
++ JAVA7_HOME_CANDIDATES=('/usr/java/jdk1.7' '/usr/java/jre1.7' '/usr/lib/jvm/j2sdk1.7-oracle' '/usr/lib/jvm/j2sdk1.7-oracle/jre' '/usr/lib/jvm/java-7-oracle')
++ OPENJAVA7_HOME_CANDIDATES=('/usr/lib/jvm/java-1.7.0-openjdk' '/usr/lib/jvm/java-7-openjdk')
++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle')
++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk')
++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk')
++ case ${BIGTOP_JAVA_MAJOR} in
++ JAVA_HOME_CANDIDATES=(${JAVA7_HOME_CANDIDATES[@]} ${JAVA6_HOME_CANDIDATES[@]} ${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA7_HOME_CANDIDAT
ES[@]} ${OPENJAVA6_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]})
++ '[' -z '' ']'
++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}'
+++ ls -rvd /usr/java/jdk1.7.0_67-cloudera
++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`'
++ '[' -e /usr/java/jdk1.7.0_67-cloudera/bin/java ']'
++ export JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
++ JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
++ break 2
+ verify_java_home
+ '[' -z /usr/java/jdk1.7.0_67-cloudera ']'
+ echo JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
+ echo 'using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME'
+ echo 'using 5 as CDH_VERSION'
+ echo 'using /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper as CDH_ZOOKEEPER_HOME'
+ echo 'using /var/run/cloudera-scm-agent/process/19-zookeeper-init as CONF_DIR'
+ set_zookeeper_classpath
+ set_classpath_in_var ZOOKEEPER_CLASSPATH
+ '[' -z ZOOKEEPER_CLASSPATH ']'
+ '[' /usr/share/cmf ']'
+ local INCLUDE_CDH_DIR=
+ '[' 5 ']'
+ INCLUDE_CDH_DIR=/usr/share/cmf/lib/plugins/cdh5
+ '[' 5 == 5 ']'
+ local JAVA_MAJOR_VERSION=
+ get_java_major_version JAVA_MAJOR_VERSION
+ '[' -z /usr/java/jdk1.7.0_67-cloudera/bin/java ']'
++ /usr/java/jdk1.7.0_67-cloudera/bin/java -version
+ local 'VERSION_STRING=java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)'
+ local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.+'
+ [[ java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.+ ]]
+ eval JAVA_MAJOR_VERSION=7
++ JAVA_MAJOR_VERSION=7
+ '[' 7 == 6 ']'
++ find /usr/share/cmf/lib/plugins /usr/share/cmf/lib/plugins/cdh5 -maxdepth 1 -name '*.jar'
++ tr '\n' :
+ ADD_TO_CP=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cdh5/audit-p
lugin-cdh5-2.3.7-shaded.jar:
+ ADD_TO_CP=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cdh5/audit-p
lugin-cdh5-2.3.7-shaded.jar
+ eval 'OLD_VALUE=$ZOOKEEPER_CLASSPATH'
++ OLD_VALUE=
+ '[' -z ']'
+ export ZOOKEEPER_CLASSPATH=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plu
gins/cdh5/audit-plugin-cdh5-2.3.7-shaded.jar
+ ZOOKEEPER_CLASSPATH=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cd
h5/audit-plugin-cdh5-2.3.7-shaded.jar
+ echo 'using /usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cdh5/audit
-plugin-cdh5-2.3.7-shaded.jar as ZOOKEEPER_CLASSPATH'
+ export ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
+ ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
+ export ZOOKEEPER_CONF=/var/run/cloudera-scm-agent/process/19-zookeeper-init
+ ZOOKEEPER_CONF=/var/run/cloudera-scm-agent/process/19-zookeeper-init
+ echo 'ZOOKEEPER_HOME is /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper'
+ echo 'configuration directory is /var/run/cloudera-scm-agent/process/19-zookeeper-init'
+ export 'CLASSPATH=:/var/run/cloudera-scm-agent/process/19-zookeeper-init:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/*:/opt/cloudera/parcels/CDH-
5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/lib/*:/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/shar
e/cmf/lib/plugins/cdh5/audit-plugin-cdh5-2.3.7-shaded.jar'
+ CLASSPATH=':/var/run/cloudera-scm-agent/process/19-zookeeper-init:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/*:/opt/cloudera/parcels/CDH-5.4.7-1
.cdh5.4.7.p0.3/lib/zookeeper/lib/*:/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/l
ib/plugins/cdh5/audit-plugin-cdh5-2.3.7-shaded.jar'
+ export 'JAVA_OPTS=-Djava.net.preferIPv4Stack=true '
+ JAVA_OPTS='-Djava.net.preferIPv4Stack=true '
+ '[' init = init ']'
+ IGNORE=
+ export ZOOPIDFILE=/var/run/zookeeper/zookeeper-server.pid
+ ZOOPIDFILE=/var/run/zookeeper/zookeeper-server.pid
+ export ZOOCFGDIR=/var/run/cloudera-scm-agent/process/19-zookeeper-init
+ ZOOCFGDIR=/var/run/cloudera-scm-agent/process/19-zookeeper-init
+ export 'JVMFLAGS= -Dzookeeper.log.file=zookeeper-cmf-zookeeper-SERVER-rlordstgcdhadmin001.log -Dzookeeper.log.dir=/var/log/zookeeper -Dcom.sun.management.jmxremote
.port=9010 -Dcom.sun.management.jmxremote.rmi.port=9010 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djute.maxbuffer=4
194304 -Dzookeeper.datadir.autocreate=false -Xms1073741824 -Xmx1073741824 -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh'
+ JVMFLAGS=' -Dzookeeper.log.file=zookeeper-cmf-zookeeper-SERVER-rlordstgcdhadmin001.log -Dzookeeper.log.dir=/var/log/zookeeper -Dcom.sun.management.jmxremote.port=9
010 -Dcom.sun.management.jmxremote.rmi.port=9010 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djute.maxbuffer=4194304
-Dzookeeper.datadir.autocreate=false -Xms1073741824 -Xmx1073741824 -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh'
+ export ZOO_DATADIR_AUTOCREATE_DISABLE=true
+ ZOO_DATADIR_AUTOCREATE_DISABLE=true
+ '[' '' '!=' ignoreExists ']'
+ exec /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/bin/zkServer-initialize.sh --myid=3

 

 

37:

 

Mon Oct 26 14:15:33 PDT 2015
+ source_parcel_environment
+ '[' '!' -z /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/meta/cdh_env.sh ']'
+ OLD_IFS='
'
+ IFS=:
+ SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS)
+ DIRNAME_ARRAY=($PARCEL_DIRNAMES)
+ IFS='
'
+ COUNT=1
++ seq 1 1
+ for i in '`seq 1 $COUNT`'
+ SCRIPT=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/meta/cdh_env.sh
+ PARCEL_DIRNAME=CDH-5.4.7-1.cdh5.4.7.p0.3
+ . /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/meta/cdh_env.sh
++ CDH_DIRNAME=CDH-5.4.7-1.cdh5.4.7.p0.3
++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-0.20-mapreduce
++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-0.20-mapreduce
++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-hdfs
++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-hdfs
++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-httpfs
++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-httpfs
++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-mapreduce
++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-mapreduce
++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-yarn
++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-yarn
++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase
++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase
++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive
++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive
++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hue
++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hue
++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/oozie
++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/oozie
++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop
++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/flume-ng
++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/flume-ng
++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/pig
++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/pig
++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive-hcatalog
++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hive-hcatalog
++ export CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sqoop2
++ CDH_SQOOP2_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sqoop2
++ export CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/llama
++ CDH_LLAMA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/llama
++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sentry
++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/sentry
++ export TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-tomcat
++ TOMCAT_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-tomcat
++ export JSVC_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils
++ JSVC_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils
++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop/bin/hadoop
++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop/bin/hadoop
++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/impala
++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/impala
++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/solr
++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/solr
++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase-solr
++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hbase-solr
++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/search
++ SEARCH_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/search
++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark
++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/spark
++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-kms
++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/hadoop-kms
+ locate_cdh_java_home
+ '[' -z '' ']'
+ '[' -z /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils ']'
+ local BIGTOP_DETECT_JAVAHOME=
+ for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"'
+ '[' -e /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome ']'
+ BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome
+ break
+ '[' -z /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome ']'
+ . /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/bigtop-utils/bigtop-detect-javahome
++ BIGTOP_DEFAULTS_DIR=/etc/default
++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']'
++ JAVA6_HOME_CANDIDATES=('/usr/lib/j2sdk1.6-sun' '/usr/lib/jvm/java-6-sun' '/usr/lib/jvm/java-1.6.0-sun-1.6.0' '/usr/lib/jvm/j2sdk1.6-oracle' '/usr/lib/jvm/j2sdk1.6
-oracle/jre' '/usr/java/jdk1.6' '/usr/java/jre1.6')
++ OPENJAVA6_HOME_CANDIDATES=('/usr/lib/jvm/java-1.6.0-openjdk' '/usr/lib/jvm/jre-1.6.0-openjdk')
++ JAVA7_HOME_CANDIDATES=('/usr/java/jdk1.7' '/usr/java/jre1.7' '/usr/lib/jvm/j2sdk1.7-oracle' '/usr/lib/jvm/j2sdk1.7-oracle/jre' '/usr/lib/jvm/java-7-oracle')
++ OPENJAVA7_HOME_CANDIDATES=('/usr/lib/jvm/java-1.7.0-openjdk' '/usr/lib/jvm/java-7-openjdk')
++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle')
++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk')
++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk')
++ case ${BIGTOP_JAVA_MAJOR} in
++ JAVA_HOME_CANDIDATES=(${JAVA7_HOME_CANDIDATES[@]} ${JAVA6_HOME_CANDIDATES[@]} ${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA7_HOME_CANDIDAT
ES[@]} ${OPENJAVA6_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]})
++ '[' -z '' ']'
++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}'
+++ ls -rvd /usr/java/jdk1.7.0_67-cloudera
++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`'
++ '[' -e /usr/java/jdk1.7.0_67-cloudera/bin/java ']'
++ export JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
++ JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
++ break 2
+ verify_java_home
+ '[' -z /usr/java/jdk1.7.0_67-cloudera ']'
+ echo JAVA_HOME=/usr/java/jdk1.7.0_67-cloudera
+ echo 'using /usr/java/jdk1.7.0_67-cloudera as JAVA_HOME'
+ echo 'using 5 as CDH_VERSION'
+ echo 'using /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper as CDH_ZOOKEEPER_HOME'
+ echo 'using /var/run/cloudera-scm-agent/process/37-zookeeper-init as CONF_DIR'
+ set_zookeeper_classpath
+ set_classpath_in_var ZOOKEEPER_CLASSPATH
+ '[' -z ZOOKEEPER_CLASSPATH ']'
+ '[' /usr/share/cmf ']'
+ local INCLUDE_CDH_DIR=
+ '[' 5 ']'
+ INCLUDE_CDH_DIR=/usr/share/cmf/lib/plugins/cdh5
+ '[' 5 == 5 ']'
+ local JAVA_MAJOR_VERSION=
+ get_java_major_version JAVA_MAJOR_VERSION
+ '[' -z /usr/java/jdk1.7.0_67-cloudera/bin/java ']'
++ /usr/java/jdk1.7.0_67-cloudera/bin/java -version
+ local 'VERSION_STRING=java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode)'
+ local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.+'
+ [[ java version "1.7.0_67"
Java(TM) SE Runtime Environment (build 1.7.0_67-b01)
Java HotSpot(TM) 64-Bit Server VM (build 24.65-b04, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.+ ]]
+ eval JAVA_MAJOR_VERSION=7
++ JAVA_MAJOR_VERSION=7
+ '[' 7 == 6 ']'
++ find /usr/share/cmf/lib/plugins /usr/share/cmf/lib/plugins/cdh5 -maxdepth 1 -name '*.jar'
++ tr '\n' :
+ ADD_TO_CP=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cdh5/audit-p
lugin-cdh5-2.3.7-shaded.jar:
+ ADD_TO_CP=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cdh5/audit-p
lugin-cdh5-2.3.7-shaded.jar
+ eval 'OLD_VALUE=$ZOOKEEPER_CLASSPATH'
++ OLD_VALUE=
+ '[' -z ']'
+ export ZOOKEEPER_CLASSPATH=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plu
gins/cdh5/audit-plugin-cdh5-2.3.7-shaded.jar
+ ZOOKEEPER_CLASSPATH=/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cd
h5/audit-plugin-cdh5-2.3.7-shaded.jar
+ echo 'using /usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/lib/plugins/cdh5/audit
-plugin-cdh5-2.3.7-shaded.jar as ZOOKEEPER_CLASSPATH'
+ export ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
+ ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper
+ export ZOOKEEPER_CONF=/var/run/cloudera-scm-agent/process/37-zookeeper-init
+ ZOOKEEPER_CONF=/var/run/cloudera-scm-agent/process/37-zookeeper-init
+ echo 'ZOOKEEPER_HOME is /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper'
+ echo 'configuration directory is /var/run/cloudera-scm-agent/process/37-zookeeper-init'
+ export 'CLASSPATH=:/var/run/cloudera-scm-agent/process/37-zookeeper-init:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/*:/opt/cloudera/parcels/CDH-
5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/lib/*:/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/shar
e/cmf/lib/plugins/cdh5/audit-plugin-cdh5-2.3.7-shaded.jar'
+ CLASSPATH=':/var/run/cloudera-scm-agent/process/37-zookeeper-init:/opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/*:/opt/cloudera/parcels/CDH-5.4.7-1
.cdh5.4.7.p0.3/lib/zookeeper/lib/*:/usr/share/cmf/lib/plugins/tt-instrumentation-5.4.7.jar:/usr/share/cmf/lib/plugins/event-publish-5.4.7-shaded.jar:/usr/share/cmf/l
ib/plugins/cdh5/audit-plugin-cdh5-2.3.7-shaded.jar'
+ export 'JAVA_OPTS=-Djava.net.preferIPv4Stack=true '
+ JAVA_OPTS='-Djava.net.preferIPv4Stack=true '
+ '[' init = init ']'
+ IGNORE=ignoreExists
+ export ZOOPIDFILE=/var/run/zookeeper/zookeeper-server.pid
+ ZOOPIDFILE=/var/run/zookeeper/zookeeper-server.pid
+ export ZOOCFGDIR=/var/run/cloudera-scm-agent/process/37-zookeeper-init
+ ZOOCFGDIR=/var/run/cloudera-scm-agent/process/37-zookeeper-init
+ export 'JVMFLAGS= -Dzookeeper.log.file=zookeeper-cmf-zookeeper-SERVER-rlordstgcdhadmin001.log -Dzookeeper.log.dir=/var/log/zookeeper -Dcom.sun.management.jmxremote
.port=9010 -Dcom.sun.management.jmxremote.rmi.port=9010 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djute.maxbuffer=4
194304 -Dzookeeper.datadir.autocreate=false -Xms1073741824 -Xmx1073741824 -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh'
+ JVMFLAGS=' -Dzookeeper.log.file=zookeeper-cmf-zookeeper-SERVER-rlordstgcdhadmin001.log -Dzookeeper.log.dir=/var/log/zookeeper -Dcom.sun.management.jmxremote.port=9
010 -Dcom.sun.management.jmxremote.rmi.port=9010 -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Djute.maxbuffer=4194304
-Dzookeeper.datadir.autocreate=false -Xms1073741824 -Xmx1073741824 -XX:OnOutOfMemoryError=/usr/lib64/cmf/service/common/killparent.sh'
+ export ZOO_DATADIR_AUTOCREATE_DISABLE=true
+ ZOO_DATADIR_AUTOCREATE_DISABLE=true
+ '[' ignoreExists '!=' ignoreExists ']'
++ /opt/cloudera/parcels/CDH-5.4.7-1.cdh5.4.7.p0.3/lib/zookeeper/bin/zkServer-initialize.sh --myid=3
+ INIT_OUT='ZooKeeper data directory already exists at /var/lib/zookeeper (or use --force to force re-initialization)'
+ RET=1
+ '[' 1 -eq 0 ']'
+ echo ZooKeeper data directory already exists at /var/lib/zookeeper '(or' use --force to force 're-initialization)'
+ grep -q 'already exists'
+ '[' 0 -eq 0 ']'
+ exit 0

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

+ echo ZooKeeper data directory already exists at /var/lib/zookeeper '(or'
use --force to force 're-initialization)'

This indicates /var/lib/zookeeper/version-2 already exists and has content
in it. Is this node being reused from an earlier installation? Since this
is a new cluster build, you can simply move /var/lib/zookeeper/version-2
elsewhere and recreate it with identical permissions.

Regards,
Gautam Gopalakrishnan

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

Explorer

These were new VMs that were just built a few days ago, so they have never had CDH on them before.   I wonder if it's because I've used the "retry" button?

 

So I should do something like:

 

mv /var/lib/zookeeper /var/lib/_zookeeper

 

And then make empty folders?   Right now this is all that is in there:

 

# find /var/lib/zookeeper/ -ls
912778 4 drwxr-xr-x 3 zookeeper zookeeper 4096 Oct 26 13:54 /var/lib/zookeeper/
912783 4 drwxr-xr-x 2 zookeeper zookeeper 4096 Oct 26 13:54 /var/lib/zookeeper/version-2
912784 4 -rw-r--r-- 1 zookeeper zookeeper 2 Oct 26 13:54 /var/lib/zookeeper/myid

 

 

 

 

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

Explorer

I've tried removing those folders and it didn't help.   The installer recreates them as they were before and still errors out, still nothing going to the logs folder and nothing new to the init/process logs.

 

Any other suggestions?

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

Explorer

FYI I went ahead and restarted this install from the beginning.   The only change I made was to choose the free version instead of the premium trial and I had 0 zookeeper issues, the cluster is up and running now.

Re: Zookeeper issues with new 5.4.7 Manager install on CentOS

Sorry I couldn't get back sooner yesterday. Glad you got it working though
I don't see how the trial version would be any different to the free one.
Strange.

Regards,
Gautam Gopalakrishnan