Member since
09-15-2020
19
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2122 | 10-04-2020 01:44 AM |
05-24-2021
12:47 AM
Please find the attached screen shot.. Not able to attach full role log
... View more
05-24-2021
12:44 AM
Hi , Getting this error -ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: RECEIVED SIGNAL 15: SIGTERM while setting up High Availabilty in cluster CDP7.1.4. Attached ful role logs. Please advise .
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
11-20-2020
03:03 AM
Hi Team, Could you please help to fix this issue . Getting the below error :Caused by: java.net.ConnectException: Connection refused (Connection refused) and CM service on port 7180 is not opening. while restarting the Clodera services getting the below error.
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
11-12-2020
05:19 AM
Hi Team,
Could you please advise on this issue .
Getting the below error when running Hive or Beeline
Error: org.apache.hive.jdbc.ZooKeeperHiveClientException: Unable to read HiveServer2 configs from ZooKeeper (state=,code=0) Already performed thee steps :
1) Verified Hive server 2 and restart and could see again it is going to stop mode.
2) Verified 10000 port listening or not - found the port is listening and connection established for Hive server 2
3) Verified Zookeeper (leader and followers) and no issue there
4) In Hue interface - Hive tables loading but issue coming only in CLI
... View more
Labels:
10-04-2020
01:44 AM
@Scharan , Its working . Thank you!!.
... View more
10-01-2020
12:11 AM
Hi @Scharan , I tried to remove the below PAM properties but not removing . It automatically adding . also I have added the admin user in the below property " zeppelin.shiro.user.block" . But still same issue . Please advise.
... View more
09-30-2020
05:02 AM
Jupiter is working fine in cluster but not able to login with Default usename and passord. admin/admin. Please advise.
... View more
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
09-28-2020
10:53 PM
Hi @carrossoni , I followed the same as mentioned in below . But still getting this error and Not able to find the RC . Please advise. SERVICE=[zookeeper], SERVICE_TYPE=[ZOOKEEPER], LOG_LEVEL=[WARN], SEVERITY=[IMPORTANT]}, content=Cannot open channel to 3 at election address matrix-mlsec-05.cisco.com/10.83.35.145:4181, timestamp=1599765151156} - 1 of 56 failure(s) in last 1831s java.io.IOException: Error connecting to matrix-mlsec-01.cisco.com/10.83.35.141:7184 at com.cloudera.cmf.event.shaded.org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:292) at com.cloudera.cmf.event.shaded.org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:206) at com.cloudera.cmf.event.shaded.org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:141) at com.cloudera.cmf.event.publish.AvroEventStorePublishProxy.checkSpecificRequestor(AvroEventStorePublishProxy.java:135) at com.cloudera.cmf.event.publish.AvroEventStorePublishProxy.publishEvent(AvroEventStorePublishProxy.java:210) at com.cloudera.cmf.event.publish.EventStorePublisherWithRetry$PublishEventTask.run(EventStorePublisherWithRetry.java:242) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.net.NoRouteToHostException: No route to host at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at com.cloudera.cmf.event.shaded.org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:152) at com.cloudera.cmf.event.shaded.org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:105) at com.cloudera.cmf.event.shaded.org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:79) at com.cloudera.cmf.event.shaded.org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) at com.cloudera.cmf.event.shaded.org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:42) at com.cloudera.cmf.event.shaded.org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) at com.cloudera.cmf.event.shaded.org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) ... 3 more .
... View more
09-26-2020
06:50 AM
Below error in Zookeeper 2020-09-18 14:30:38,331 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open java.io.EOFException at java.io.DataInputStream.readFully(DataInputStream.java:197) at java.io.DataInputStream.readFully(DataInputStream.java:169) at org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:113) at org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:87) at org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:118) at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:379) 2020-09-18 14:30:38,332 WARN org.apache.zookeeper.server.quorum.LearnerHandler: ******* GOODBYE /64.102.14.234:55960 ******** 2020-09-18 14:30:38,337 ERROR org.apache.zookeeper.server.quorum.LearnerHandler: Unexpected exception causing shutdown while sock still open java.io.IOException: Unreasonable length = 541611092 at org.apache.jute.BinaryInputArchive.checkLength(BinaryInputArchive.java:146) at org.apache.jute.BinaryInputArchive.readBuffer(BinaryInputArchive.java:111) at org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:87) at org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:118) at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:379) 2020-09-18 14:30:38,338 WARN org.apache.zookeeper.server.quorum.LearnerHandler: ******* GOODBYE /64.102.14.234:56947 ******** 2020-09-18 14:31:41,053 INFO org.apache.zookeeper.server.ZooKeeperServer: Submitting global closeSession request for session 0x300261365d7006e
... View more
09-24-2020
12:45 AM
Hi @carrossoni , You are Right . Hive server 2 is down on Hive on Tez. Please find the Error log below. Please advise how to overcome this issue. 20/09/24 02:39:04 ERROR server.HiveServer2: [shutdown-hook-0]: Error stopping schq
java.lang.IllegalStateException: The current ScheduledQueryExecutionService INSTANCE is invalid
at org.apache.hadoop.hive.ql.scheduled.ScheduledQueryExecutionService.close(ScheduledQueryExecutionService.java:308) ~[hive-exec-3.1.3000.7.1.3.0-100.jar:3.1.3000.7.1.3.0-100]
at org.apache.hive.service.server.HiveServer2.stop(HiveServer2.java:886) ~[hive-service-3.1.3000.7.1.3.0-100.jar:3.1.3000.7.1.3.0-100]
at org.apache.hive.service.server.HiveServer2.lambda$init$0(HiveServer2.java:433) ~[hive-service-3.1.3000.7.1.3.0-100.jar:3.1.3000.7.1.3.0-100]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_232]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_232]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232] s
... View more
09-23-2020
10:10 AM
Please advise-Getting this error in Hue - Could not connect to any of [('10.83.35.142', 10000)] (code THRIFTTRANSPORT): TTransportException("Could not connect to any of [('10.83.35.142', 10000)]",)
... View more
Labels:
- Labels:
-
Cloudera Hue
09-23-2020
06:39 AM
Thanks a lot @GangWar !! Its working.
... View more
09-20-2020
07:20 AM
Thank you @GangWar .
... View more
09-20-2020
07:13 AM
Exception in thread "main" java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.spark.deploy.history.HistoryServer$.main(HistoryServer.scala:294) at org.apache.spark.deploy.history.HistoryServer.main(HistoryServer.scala) Caused by: java.io.FileNotFoundException: Log directory specified does not exist: hdfs://nameservice1/user/spark/applicationHistory at org.apache.spark.deploy.history.FsHistoryProvider.org$apache$spark$deploy$history$FsHistoryProvider$$startPolling(FsHistoryProvider.scala:268) at org.apache.spark.deploy.history.FsHistoryProvider.initialize(FsHistoryProvider.scala:212) at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:208) at org.apache.spark.deploy.history.FsHistoryProvider.<init>(FsHistoryProvider.scala:87) ... 6 more Caused by: java.io.FileNotFoundException: File does not exist: hdfs://nameservice1/user/spark/applicationHistory at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1735) at org.apache.hadoop.hdfs.DistributedFileSystem$29.doCall(DistributedFileSystem.java:1728) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1743) at org.apache.spark.deploy.history.FsHistoryProvider.org$apache$spark$deploy$history$FsHistoryProvider$$startPolling(FsHistoryProvider.scala:258) ... 9 more
... View more
- Tags:
- stack-trace
Labels:
- Labels:
-
Cloudera Data Platform (CDP)
09-15-2020
10:54 PM
@GangWar , Please find the full trace log from stderr and screen shot.After that warning message no more process has been done and Name node role not started . Kindly advice. [15/Sep/2020 06:48:09 +0000] 22918 MainThread redactor INFO Started launcher: /opt/cloudera/cm-agent/service/hdfs/hdfs.sh namenode [15/Sep/2020 06:48:09 +0000] 22918 MainThread redactor INFO Re-exec watcher: /opt/cloudera/cm-agent/bin/cm proc_watcher 22927 [15/Sep/2020 06:48:09 +0000] 22928 MainThread redactor INFO Re-exec redactor: /opt/cloudera/cm-agent/bin/cm redactor --fds 3 5 [15/Sep/2020 06:48:09 +0000] 22928 MainThread redactor INFO Started redactor Tue Sep 15 06:48:09 EDT 2020 + source_parcel_environment + '[' '!' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ']' + OLD_IFS=' ' + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid22927.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid22927.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_pid ++ echo ++ sed 's#{{PID}}#22927#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#22927#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#22927#g' + export HADOOP_NFS3_OPTS= + HADOOP_NFS3_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#22927#g' + export HADOOP_JOURNALNODE_OPTS= + HADOOP_JOURNALNODE_OPTS= + get_gc_args ++ echo /var/log/hadoop-hdfs + GC_LOG_DIR=/var/log/hadoop-hdfs ++ date +%Y-%m-%d_%H-%M-%S + GC_DATE=2020-09-15_06-48-09 + JAVA8_VERBOSE_GC_VAR='-Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA8_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA11_VERBOSE_GC_VAR=-Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log + JAVA11_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log' + set_basic_gc_tuning_args_based_on_java_version + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + BASIC_GC_TUNING_ARGS= + case $JAVA_MAJOR in + BASIC_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + DATANODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + SECONDARY_NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + [[ ! -z '' ]] + [[ ! -z '' ]] + [[ ! -z '' ]] ++ replace_gc_args '-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid22927.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid22927.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid22927.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid22927.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-09.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= + '[' 7 -ge 4 ']' + HDFS_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs + export 'HADOOP_OPTS=-Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Djava.net.preferIPv4Stack=true ' + echo 'using /usr/java/jdk1.8.0_232-cloudera as JAVA_HOME' + echo 'using 7 as CDH_VERSION' + echo 'using /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE as CONF_DIR' + echo 'using as SECURE_USER' + echo 'using as SECURE_GROUP' + set_hadoop_classpath + set_classpath_in_var HADOOP_CLASSPATH + '[' -z HADOOP_CLASSPATH ']' + [[ -n /opt/cloudera/cm ]] ++ find /opt/cloudera/cm/lib/plugins -maxdepth 1 -name '*.jar' ++ tr '\n' : + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar: + [[ -n navigator/cdh6 ]] + for DIR in '$CM_ADD_TO_CP_DIRS' ++ find /opt/cloudera/cm/lib/plugins/navigator/cdh6 -maxdepth 1 -name '*.jar' ++ tr '\n' : + PLUGIN=/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + eval 'OLD_VALUE=$HADOOP_CLASSPATH' ++ OLD_VALUE= + NEW_VALUE=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + export HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + set -x + replace_conf_dir + echo CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE + echo CMF_CONF_DIR= + EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks' 'supervisor_status') ++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' hdfs.keytab '*jceks' supervisor_status + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -type f '!' -path '/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name hdfs.keytab '!' -name '*jceks' '!' -name supervisor_status -exec perl -pi -e 's#\{\{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE#g' '{}' ';' + make_scripts_executable + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';' + '[' DATANODE_MAX_LOCKED_MEMORY '!=' '' ']' + ulimit -l + export HADOOP_IDENT_STRING=hdfs + HADOOP_IDENT_STRING=hdfs + '[' -n '' ']' + '[' mkdir '!=' namenode ']' + acquire_kerberos_tgt hdfs.keytab + '[' -z hdfs.keytab ']' + KERBEROS_PRINCIPAL= + '[' '!' -z '' ']' + '[' -n '' ']' + '[' validate-writable-empty-dirs = namenode ']' + '[' file-operation = namenode ']' + '[' bootstrap = namenode ']' + '[' failover = namenode ']' + '[' transition-to-active = namenode ']' + '[' initializeSharedEdits = namenode ']' + '[' initialize-znode = namenode ']' + '[' format-namenode = namenode ']' + '[' monitor-decommission = namenode ']' + '[' jnSyncWait = namenode ']' + '[' nnRpcWait = namenode ']' + '[' -safemode = '' -a get = '' ']' + '[' monitor-upgrade = namenode ']' + '[' finalize-upgrade = namenode ']' + '[' rolling-upgrade-prepare = namenode ']' + '[' rolling-upgrade-finalize = namenode ']' + '[' nnDnLiveWait = namenode ']' + '[' monitor-offline = namenode ']' + '[' refresh-datanode = namenode ']' + '[' put = namenode ']' + '[' mkdir = namenode ']' + '[' setfacl = namenode ']' + '[' nfs3 = namenode ']' + '[' namenode = namenode -o secondarynamenode = namenode -o datanode = namenode ']' + HADOOP_OPTS='-Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + export 'HADOOP_OPTS=-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + '[' namenode = namenode -a rollingUpgrade = '' ']' + exec /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs --config /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE namenode WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. WARNING: HADOOP_NAMENODE_OPTS has been replaced by HDFS_NAMENODE_OPTS. Using value of HADOOP_NAMENODE_OPTS. [15/Sep/2020 06:48:14 +0000] 23141 MainThread redactor INFO Started launcher: /opt/cloudera/cm-agent/service/hdfs/hdfs.sh namenode [15/Sep/2020 06:48:14 +0000] 23141 MainThread redactor INFO Re-exec watcher: /opt/cloudera/cm-agent/bin/cm proc_watcher 23148 [15/Sep/2020 06:48:14 +0000] 23149 MainThread redactor INFO Re-exec redactor: /opt/cloudera/cm-agent/bin/cm redactor --fds 3 5 [15/Sep/2020 06:48:14 +0000] 23149 MainThread redactor INFO Started redactor Tue Sep 15 06:48:14 EDT 2020 + source_parcel_environment + '[' '!' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ']' + OLD_IFS=' ' + IFS=: + SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS) + DIRNAME_ARRAY=($PARCEL_DIRNAMES) + IFS=' ' + COUNT=1 ++ seq 1 1 + for i in '`seq 1 $COUNT`' + SCRIPT=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh + PARCEL_DIRNAME=CDH-7.1.3-1.cdh7.1.3.p0.4992530 + . /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ++ CDH_DIRNAME=CDH-7.1.3-1.cdh7.1.3.p0.4992530 ++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-0.20-mapreduce ++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-0.20-mapreduce ++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ export CDH_OZONE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-ozone ++ CDH_OZONE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-ozone ++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-httpfs ++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-httpfs ++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase ++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase ++ export CDH_HBASE_FILESYSTEM_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_filesystem ++ CDH_HBASE_FILESYSTEM_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_filesystem ++ export CDH_HBASE_CONNECTORS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_connectors ++ CDH_HBASE_CONNECTORS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_connectors ++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zookeeper ++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zookeeper ++ export CDH_ZEPPELIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zeppelin ++ CDH_ZEPPELIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zeppelin ++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive ++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive ++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hue ++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hue ++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/oozie ++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/oozie ++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive-hcatalog ++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive-hcatalog ++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/sentry ++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/sentry ++ export JSVC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ++ JSVC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/bin/hadoop ++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/bin/hadoop ++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/impala ++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/impala ++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/solr ++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/solr ++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase-solr ++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase-solr ++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/search ++ SEARCH_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/search ++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/spark ++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/spark ++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-kms ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-kms ++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/parquet ++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/parquet ++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/avro ++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/avro ++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kafka ++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kafka ++ export CDH_SCHEMA_REGISTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/schemaregistry ++ CDH_SCHEMA_REGISTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/schemaregistry ++ export CDH_STREAMS_MESSAGING_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager ++ CDH_STREAMS_MESSAGING_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager ++ export CDH_STREAMS_MESSAGING_MANAGER_UI_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager_ui ++ CDH_STREAMS_MESSAGING_MANAGER_UI_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager_ui ++ export CDH_STREAMS_REPLICATION_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_replication_manager ++ CDH_STREAMS_REPLICATION_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_replication_manager ++ export CDH_CRUISE_CONTROL_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/cruise_control ++ CDH_CRUISE_CONTROL_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/cruise_control ++ export CDH_KNOX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/knox ++ CDH_KNOX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/knox ++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kudu ++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kudu ++ export CDH_RANGER_ADMIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-admin ++ CDH_RANGER_ADMIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-admin ++ export CDH_RANGER_TAGSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-tagsync ++ CDH_RANGER_TAGSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-tagsync ++ export CDH_RANGER_USERSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-usersync ++ CDH_RANGER_USERSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-usersync ++ export CDH_RANGER_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-kms ++ CDH_RANGER_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-kms ++ export CDH_RANGER_RAZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-raz ++ CDH_RANGER_RAZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-raz ++ export CDH_ATLAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/atlas ++ CDH_ATLAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/atlas ++ export CDH_TEZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/tez ++ CDH_TEZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/tez ++ export CDH_PHOENIX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/phoenix ++ CDH_PHOENIX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/phoenix ++ export DAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/data_analytics_studio ++ DAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/data_analytics_studio ++ export QUEUEMANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/queuemanager ++ QUEUEMANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/queuemanager + locate_cdh_java_home + '[' -z '' ']' + '[' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ']' + local BIGTOP_DETECT_JAVAHOME= + for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"' + '[' -e /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ']' + BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome + break + '[' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ']' + . /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ++ BIGTOP_DEFAULTS_DIR=/etc/default ++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']' ++ JAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/jdk-11' '/usr/lib/jvm/java-11-oracle') ++ OPENJAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/java-11' '/usr/lib/jvm/jdk-11' '/usr/lib64/jvm/jdk-11') ++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle') ++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk' '/usr/lib64/jvm/java-1.8.0-openjdk' '/usr/lib64/jvm/java-8-openjdk') ++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk') ++ case ${BIGTOP_JAVA_MAJOR} in ++ JAVA_HOME_CANDIDATES=(${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]} ${JAVA11_HOME_CANDIDATES[@]} ${OPENJAVA11_HOME_CANDIDATES[@]}) ++ '[' -z '' ']' ++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}' +++ ls -rvd /usr/java/jdk1.8.0_232-cloudera ++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`' ++ '[' -e /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ export JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera ++ JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera ++ break 2 + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + '[' 8 -lt 8 ']' + verify_java_home + '[' -z /usr/java/jdk1.8.0_232-cloudera ']' + echo JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera + . /opt/cloudera/cm-agent/service/common/cdh-default-hadoop ++ [[ -z 7 ]] ++ '[' 7 = 3 ']' ++ '[' 7 = -3 ']' ++ '[' 7 -ge 4 ']' ++ export HADOOP_HOME_WARN_SUPPRESS=true ++ HADOOP_HOME_WARN_SUPPRESS=true ++ export HADOOP_PREFIX=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ HADOOP_PREFIX=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export HADOOP_LIBEXEC_DIR=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/libexec ++ HADOOP_LIBEXEC_DIR=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/libexec ++ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE ++ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE ++ export HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ export HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ '[' 7 = 4 ']' ++ '[' 7 -ge 5 ']' ++ export HADOOP_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ HADOOP_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ replace_pid -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError '-XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid{{PID}}.hprof' -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError '-XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid{{PID}}.hprof' -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ sed 's#{{PID}}#23148#g' + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23148.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23148.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_pid ++ echo ++ sed 's#{{PID}}#23148#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23148#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23148#g' + export HADOOP_NFS3_OPTS= + HADOOP_NFS3_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23148#g' + export HADOOP_JOURNALNODE_OPTS= + HADOOP_JOURNALNODE_OPTS= + get_gc_args ++ echo /var/log/hadoop-hdfs + GC_LOG_DIR=/var/log/hadoop-hdfs ++ date +%Y-%m-%d_%H-%M-%S + GC_DATE=2020-09-15_06-48-15 + JAVA8_VERBOSE_GC_VAR='-Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA8_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA11_VERBOSE_GC_VAR=-Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log + JAVA11_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log' + set_basic_gc_tuning_args_based_on_java_version + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + BASIC_GC_TUNING_ARGS= + case $JAVA_MAJOR in + BASIC_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + DATANODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + SECONDARY_NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + [[ ! -z '' ]] + [[ ! -z '' ]] + [[ ! -z '' ]] ++ replace_gc_args '-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23148.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23148.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23148.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23148.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-15.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= + '[' 7 -ge 4 ']' + HDFS_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs + export 'HADOOP_OPTS=-Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Djava.net.preferIPv4Stack=true ' + echo 'using /usr/java/jdk1.8.0_232-cloudera as JAVA_HOME' + echo 'using 7 as CDH_VERSION' + echo 'using /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE as CONF_DIR' + echo 'using as SECURE_USER' + echo 'using as SECURE_GROUP' + set_hadoop_classpath + set_classpath_in_var HADOOP_CLASSPATH + '[' -z HADOOP_CLASSPATH ']' + [[ -n /opt/cloudera/cm ]] ++ find /opt/cloudera/cm/lib/plugins -maxdepth 1 -name '*.jar' ++ tr '\n' : + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar: + [[ -n navigator/cdh6 ]] + for DIR in '$CM_ADD_TO_CP_DIRS' ++ find /opt/cloudera/cm/lib/plugins/navigator/cdh6 -maxdepth 1 -name '*.jar' ++ tr '\n' : + PLUGIN=/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + eval 'OLD_VALUE=$HADOOP_CLASSPATH' ++ OLD_VALUE= + NEW_VALUE=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + export HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + set -x + replace_conf_dir + echo CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE + echo CMF_CONF_DIR= + EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks' 'supervisor_status') ++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' hdfs.keytab '*jceks' supervisor_status + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -type f '!' -path '/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name hdfs.keytab '!' -name '*jceks' '!' -name supervisor_status -exec perl -pi -e 's#\{\{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE#g' '{}' ';' + make_scripts_executable + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';' + '[' DATANODE_MAX_LOCKED_MEMORY '!=' '' ']' + ulimit -l + export HADOOP_IDENT_STRING=hdfs + HADOOP_IDENT_STRING=hdfs + '[' -n '' ']' + '[' mkdir '!=' namenode ']' + acquire_kerberos_tgt hdfs.keytab + '[' -z hdfs.keytab ']' + KERBEROS_PRINCIPAL= + '[' '!' -z '' ']' + '[' -n '' ']' + '[' validate-writable-empty-dirs = namenode ']' + '[' file-operation = namenode ']' + '[' bootstrap = namenode ']' + '[' failover = namenode ']' + '[' transition-to-active = namenode ']' + '[' initializeSharedEdits = namenode ']' + '[' initialize-znode = namenode ']' + '[' format-namenode = namenode ']' + '[' monitor-decommission = namenode ']' + '[' jnSyncWait = namenode ']' + '[' nnRpcWait = namenode ']' + '[' -safemode = '' -a get = '' ']' + '[' monitor-upgrade = namenode ']' + '[' finalize-upgrade = namenode ']' + '[' rolling-upgrade-prepare = namenode ']' + '[' rolling-upgrade-finalize = namenode ']' + '[' nnDnLiveWait = namenode ']' + '[' monitor-offline = namenode ']' + '[' refresh-datanode = namenode ']' + '[' put = namenode ']' + '[' mkdir = namenode ']' + '[' setfacl = namenode ']' + '[' nfs3 = namenode ']' + '[' namenode = namenode -o secondarynamenode = namenode -o datanode = namenode ']' + HADOOP_OPTS='-Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + export 'HADOOP_OPTS=-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + '[' namenode = namenode -a rollingUpgrade = '' ']' + exec /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs --config /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE namenode WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. WARNING: HADOOP_NAMENODE_OPTS has been replaced by HDFS_NAMENODE_OPTS. Using value of HADOOP_NAMENODE_OPTS. [15/Sep/2020 06:48:21 +0000] 23363 MainThread redactor INFO Started launcher: /opt/cloudera/cm-agent/service/hdfs/hdfs.sh namenode [15/Sep/2020 06:48:21 +0000] 23363 MainThread redactor INFO Re-exec watcher: /opt/cloudera/cm-agent/bin/cm proc_watcher 23370 [15/Sep/2020 06:48:21 +0000] 23371 MainThread redactor INFO Re-exec redactor: /opt/cloudera/cm-agent/bin/cm redactor --fds 3 5 [15/Sep/2020 06:48:21 +0000] 23371 MainThread redactor INFO Started redactor Tue Sep 15 06:48:21 EDT 2020 + source_parcel_environment + '[' '!' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ']' + OLD_IFS=' ' + IFS=: + SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS) + DIRNAME_ARRAY=($PARCEL_DIRNAMES) + IFS=' ' + COUNT=1 ++ seq 1 1 + for i in '`seq 1 $COUNT`' + SCRIPT=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh + PARCEL_DIRNAME=CDH-7.1.3-1.cdh7.1.3.p0.4992530 + . /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ++ CDH_DIRNAME=CDH-7.1.3-1.cdh7.1.3.p0.4992530 ++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-0.20-mapreduce ++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-0.20-mapreduce ++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ export CDH_OZONE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-ozone ++ CDH_OZONE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-ozone ++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-httpfs ++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-httpfs ++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase ++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase ++ export CDH_HBASE_FILESYSTEM_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_filesystem ++ CDH_HBASE_FILESYSTEM_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_filesystem ++ export CDH_HBASE_CONNECTORS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_connectors ++ CDH_HBASE_CONNECTORS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_connectors ++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zookeeper ++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zookeeper ++ export CDH_ZEPPELIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zeppelin ++ CDH_ZEPPELIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zeppelin ++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive ++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive ++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hue ++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hue ++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/oozie ++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/oozie ++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive-hcatalog ++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive-hcatalog ++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/sentry ++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/sentry ++ export JSVC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ++ JSVC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/bin/hadoop ++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/bin/hadoop ++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/impala ++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/impala ++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/solr ++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/solr ++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase-solr ++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase-solr ++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/search ++ SEARCH_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/search ++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/spark ++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/spark ++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-kms ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-kms ++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/parquet ++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/parquet ++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/avro ++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/avro ++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kafka ++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kafka ++ export CDH_SCHEMA_REGISTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/schemaregistry ++ CDH_SCHEMA_REGISTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/schemaregistry ++ export CDH_STREAMS_MESSAGING_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager ++ CDH_STREAMS_MESSAGING_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager ++ export CDH_STREAMS_MESSAGING_MANAGER_UI_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager_ui ++ CDH_STREAMS_MESSAGING_MANAGER_UI_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager_ui ++ export CDH_STREAMS_REPLICATION_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_replication_manager ++ CDH_STREAMS_REPLICATION_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_replication_manager ++ export CDH_CRUISE_CONTROL_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/cruise_control ++ CDH_CRUISE_CONTROL_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/cruise_control ++ export CDH_KNOX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/knox ++ CDH_KNOX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/knox ++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kudu ++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kudu ++ export CDH_RANGER_ADMIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-admin ++ CDH_RANGER_ADMIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-admin ++ export CDH_RANGER_TAGSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-tagsync ++ CDH_RANGER_TAGSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-tagsync ++ export CDH_RANGER_USERSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-usersync ++ CDH_RANGER_USERSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-usersync ++ export CDH_RANGER_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-kms ++ CDH_RANGER_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-kms ++ export CDH_RANGER_RAZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-raz ++ CDH_RANGER_RAZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-raz ++ export CDH_ATLAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/atlas ++ CDH_ATLAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/atlas ++ export CDH_TEZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/tez ++ CDH_TEZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/tez ++ export CDH_PHOENIX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/phoenix ++ CDH_PHOENIX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/phoenix ++ export DAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/data_analytics_studio ++ DAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/data_analytics_studio ++ export QUEUEMANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/queuemanager ++ QUEUEMANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/queuemanager + locate_cdh_java_home + '[' -z '' ']' + '[' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ']' + local BIGTOP_DETECT_JAVAHOME= + for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"' + '[' -e /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ']' + BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome + break + '[' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ']' + . /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ++ BIGTOP_DEFAULTS_DIR=/etc/default ++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']' ++ JAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/jdk-11' '/usr/lib/jvm/java-11-oracle') ++ OPENJAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/java-11' '/usr/lib/jvm/jdk-11' '/usr/lib64/jvm/jdk-11') ++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle') ++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk' '/usr/lib64/jvm/java-1.8.0-openjdk' '/usr/lib64/jvm/java-8-openjdk') ++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk') ++ case ${BIGTOP_JAVA_MAJOR} in ++ JAVA_HOME_CANDIDATES=(${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]} ${JAVA11_HOME_CANDIDATES[@]} ${OPENJAVA11_HOME_CANDIDATES[@]}) ++ '[' -z '' ']' ++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}' +++ ls -rvd /usr/java/jdk1.8.0_232-cloudera ++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`' ++ '[' -e /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ export JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera ++ JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera ++ break 2 + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + '[' 8 -lt 8 ']' + verify_java_home + '[' -z /usr/java/jdk1.8.0_232-cloudera ']' + echo JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera + . /opt/cloudera/cm-agent/service/common/cdh-default-hadoop ++ [[ -z 7 ]] ++ '[' 7 = 3 ']' ++ '[' 7 = -3 ']' ++ '[' 7 -ge 4 ']' ++ export HADOOP_HOME_WARN_SUPPRESS=true ++ HADOOP_HOME_WARN_SUPPRESS=true ++ export HADOOP_PREFIX=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ HADOOP_PREFIX=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export HADOOP_LIBEXEC_DIR=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/libexec ++ HADOOP_LIBEXEC_DIR=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/libexec ++ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE ++ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE ++ export HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ export HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ '[' 7 = 4 ']' ++ '[' 7 -ge 5 ']' ++ export HADOOP_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ HADOOP_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ replace_pid -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError '-XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid{{PID}}.hprof' -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError '-XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid{{PID}}.hprof' -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ sed 's#{{PID}}#23370#g' + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23370.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23370.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_pid ++ echo ++ sed 's#{{PID}}#23370#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23370#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23370#g' + export HADOOP_NFS3_OPTS= + HADOOP_NFS3_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23370#g' + export HADOOP_JOURNALNODE_OPTS= + HADOOP_JOURNALNODE_OPTS= + get_gc_args ++ echo /var/log/hadoop-hdfs + GC_LOG_DIR=/var/log/hadoop-hdfs ++ date +%Y-%m-%d_%H-%M-%S + GC_DATE=2020-09-15_06-48-21 + JAVA8_VERBOSE_GC_VAR='-Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA8_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA11_VERBOSE_GC_VAR=-Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log + JAVA11_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log' + set_basic_gc_tuning_args_based_on_java_version + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + BASIC_GC_TUNING_ARGS= + case $JAVA_MAJOR in + BASIC_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + DATANODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + SECONDARY_NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + [[ ! -z '' ]] + [[ ! -z '' ]] + [[ ! -z '' ]] ++ replace_gc_args '-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23370.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23370.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23370.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23370.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-21.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= + '[' 7 -ge 4 ']' + HDFS_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs + export 'HADOOP_OPTS=-Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Djava.net.preferIPv4Stack=true ' + echo 'using /usr/java/jdk1.8.0_232-cloudera as JAVA_HOME' + echo 'using 7 as CDH_VERSION' + echo 'using /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE as CONF_DIR' + echo 'using as SECURE_USER' + echo 'using as SECURE_GROUP' + set_hadoop_classpath + set_classpath_in_var HADOOP_CLASSPATH + '[' -z HADOOP_CLASSPATH ']' + [[ -n /opt/cloudera/cm ]] ++ find /opt/cloudera/cm/lib/plugins -maxdepth 1 -name '*.jar' ++ tr '\n' : + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar: + [[ -n navigator/cdh6 ]] + for DIR in '$CM_ADD_TO_CP_DIRS' ++ find /opt/cloudera/cm/lib/plugins/navigator/cdh6 -maxdepth 1 -name '*.jar' ++ tr '\n' : + PLUGIN=/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + eval 'OLD_VALUE=$HADOOP_CLASSPATH' ++ OLD_VALUE= + NEW_VALUE=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + export HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + set -x + replace_conf_dir + echo CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE + echo CMF_CONF_DIR= + EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks' 'supervisor_status') ++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' hdfs.keytab '*jceks' supervisor_status + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -type f '!' -path '/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name hdfs.keytab '!' -name '*jceks' '!' -name supervisor_status -exec perl -pi -e 's#\{\{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE#g' '{}' ';' + make_scripts_executable + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';' + '[' DATANODE_MAX_LOCKED_MEMORY '!=' '' ']' + ulimit -l + export HADOOP_IDENT_STRING=hdfs + HADOOP_IDENT_STRING=hdfs + '[' -n '' ']' + '[' mkdir '!=' namenode ']' + acquire_kerberos_tgt hdfs.keytab + '[' -z hdfs.keytab ']' + KERBEROS_PRINCIPAL= + '[' '!' -z '' ']' + '[' -n '' ']' + '[' validate-writable-empty-dirs = namenode ']' + '[' file-operation = namenode ']' + '[' bootstrap = namenode ']' + '[' failover = namenode ']' + '[' transition-to-active = namenode ']' + '[' initializeSharedEdits = namenode ']' + '[' initialize-znode = namenode ']' + '[' format-namenode = namenode ']' + '[' monitor-decommission = namenode ']' + '[' jnSyncWait = namenode ']' + '[' nnRpcWait = namenode ']' + '[' -safemode = '' -a get = '' ']' + '[' monitor-upgrade = namenode ']' + '[' finalize-upgrade = namenode ']' + '[' rolling-upgrade-prepare = namenode ']' + '[' rolling-upgrade-finalize = namenode ']' + '[' nnDnLiveWait = namenode ']' + '[' monitor-offline = namenode ']' + '[' refresh-datanode = namenode ']' + '[' put = namenode ']' + '[' mkdir = namenode ']' + '[' setfacl = namenode ']' + '[' nfs3 = namenode ']' + '[' namenode = namenode -o secondarynamenode = namenode -o datanode = namenode ']' + HADOOP_OPTS='-Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + export 'HADOOP_OPTS=-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + '[' namenode = namenode -a rollingUpgrade = '' ']' + exec /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs --config /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE namenode WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. WARNING: HADOOP_NAMENODE_OPTS has been replaced by HDFS_NAMENODE_OPTS. Using value of HADOOP_NAMENODE_OPTS. [15/Sep/2020 06:48:28 +0000] 23586 MainThread redactor INFO Started launcher: /opt/cloudera/cm-agent/service/hdfs/hdfs.sh namenode [15/Sep/2020 06:48:28 +0000] 23586 MainThread redactor INFO Re-exec watcher: /opt/cloudera/cm-agent/bin/cm proc_watcher 23593 [15/Sep/2020 06:48:28 +0000] 23594 MainThread redactor INFO Re-exec redactor: /opt/cloudera/cm-agent/bin/cm redactor --fds 3 5 [15/Sep/2020 06:48:29 +0000] 23594 MainThread redactor INFO Started redactor Tue Sep 15 06:48:29 EDT 2020 + source_parcel_environment + '[' '!' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ']' + OLD_IFS=' ' + IFS=: + SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS) + DIRNAME_ARRAY=($PARCEL_DIRNAMES) + IFS=' ' + COUNT=1 ++ seq 1 1 + for i in '`seq 1 $COUNT`' + SCRIPT=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh + PARCEL_DIRNAME=CDH-7.1.3-1.cdh7.1.3.p0.4992530 + . /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/meta/cdh_env.sh ++ CDH_DIRNAME=CDH-7.1.3-1.cdh7.1.3.p0.4992530 ++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-0.20-mapreduce ++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-0.20-mapreduce ++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ export CDH_OZONE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-ozone ++ CDH_OZONE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-ozone ++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-httpfs ++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-httpfs ++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase ++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase ++ export CDH_HBASE_FILESYSTEM_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_filesystem ++ CDH_HBASE_FILESYSTEM_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_filesystem ++ export CDH_HBASE_CONNECTORS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_connectors ++ CDH_HBASE_CONNECTORS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase_connectors ++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zookeeper ++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zookeeper ++ export CDH_ZEPPELIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zeppelin ++ CDH_ZEPPELIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/zeppelin ++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive ++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive ++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hue ++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hue ++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/oozie ++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/oozie ++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive-hcatalog ++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hive-hcatalog ++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/sentry ++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/sentry ++ export JSVC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ++ JSVC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/bin/hadoop ++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/bin/hadoop ++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/impala ++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/impala ++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/solr ++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/solr ++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase-solr ++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hbase-solr ++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/search ++ SEARCH_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/search ++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/spark ++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/spark ++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/etc/hive-webhcat/conf.dist/webhcat-default.xml ++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-kms ++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-kms ++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/parquet ++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/parquet ++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/avro ++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/avro ++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kafka ++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kafka ++ export CDH_SCHEMA_REGISTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/schemaregistry ++ CDH_SCHEMA_REGISTRY_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/schemaregistry ++ export CDH_STREAMS_MESSAGING_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager ++ CDH_STREAMS_MESSAGING_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager ++ export CDH_STREAMS_MESSAGING_MANAGER_UI_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager_ui ++ CDH_STREAMS_MESSAGING_MANAGER_UI_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_messaging_manager_ui ++ export CDH_STREAMS_REPLICATION_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_replication_manager ++ CDH_STREAMS_REPLICATION_MANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/streams_replication_manager ++ export CDH_CRUISE_CONTROL_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/cruise_control ++ CDH_CRUISE_CONTROL_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/cruise_control ++ export CDH_KNOX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/knox ++ CDH_KNOX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/knox ++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kudu ++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/kudu ++ export CDH_RANGER_ADMIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-admin ++ CDH_RANGER_ADMIN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-admin ++ export CDH_RANGER_TAGSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-tagsync ++ CDH_RANGER_TAGSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-tagsync ++ export CDH_RANGER_USERSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-usersync ++ CDH_RANGER_USERSYNC_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-usersync ++ export CDH_RANGER_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-kms ++ CDH_RANGER_KMS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-kms ++ export CDH_RANGER_RAZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-raz ++ CDH_RANGER_RAZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/ranger-raz ++ export CDH_ATLAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/atlas ++ CDH_ATLAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/atlas ++ export CDH_TEZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/tez ++ CDH_TEZ_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/tez ++ export CDH_PHOENIX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/phoenix ++ CDH_PHOENIX_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/phoenix ++ export DAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/data_analytics_studio ++ DAS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/data_analytics_studio ++ export QUEUEMANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/queuemanager ++ QUEUEMANAGER_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/queuemanager + locate_cdh_java_home + '[' -z '' ']' + '[' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils ']' + local BIGTOP_DETECT_JAVAHOME= + for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"' + '[' -e /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ']' + BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome + break + '[' -z /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ']' + . /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/bigtop-utils/bigtop-detect-javahome ++ BIGTOP_DEFAULTS_DIR=/etc/default ++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']' ++ JAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/jdk-11' '/usr/lib/jvm/java-11-oracle') ++ OPENJAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/java-11' '/usr/lib/jvm/jdk-11' '/usr/lib64/jvm/jdk-11') ++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle') ++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk' '/usr/lib64/jvm/java-1.8.0-openjdk' '/usr/lib64/jvm/java-8-openjdk') ++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk') ++ case ${BIGTOP_JAVA_MAJOR} in ++ JAVA_HOME_CANDIDATES=(${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]} ${JAVA11_HOME_CANDIDATES[@]} ${OPENJAVA11_HOME_CANDIDATES[@]}) ++ '[' -z '' ']' ++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}' +++ ls -rvd /usr/java/jdk1.8.0_232-cloudera ++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`' ++ '[' -e /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ export JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera ++ JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera ++ break 2 + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + '[' 8 -lt 8 ']' + verify_java_home + '[' -z /usr/java/jdk1.8.0_232-cloudera ']' + echo JAVA_HOME=/usr/java/jdk1.8.0_232-cloudera + . /opt/cloudera/cm-agent/service/common/cdh-default-hadoop ++ [[ -z 7 ]] ++ '[' 7 = 3 ']' ++ '[' 7 = -3 ']' ++ '[' 7 -ge 4 ']' ++ export HADOOP_HOME_WARN_SUPPRESS=true ++ HADOOP_HOME_WARN_SUPPRESS=true ++ export HADOOP_PREFIX=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ HADOOP_PREFIX=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export HADOOP_LIBEXEC_DIR=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/libexec ++ HADOOP_LIBEXEC_DIR=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop/libexec ++ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE ++ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE ++ export HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ HADOOP_COMMON_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop ++ export HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ HADOOP_HDFS_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs ++ export HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-mapreduce ++ '[' 7 = 4 ']' ++ '[' 7 -ge 5 ']' ++ export HADOOP_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ HADOOP_YARN_HOME=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-yarn ++ replace_pid -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError '-XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid{{PID}}.hprof' -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh ++ sed 's#{{PID}}#23593#g' ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError '-XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid{{PID}}.hprof' -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23593.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23593.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_pid ++ echo ++ sed 's#{{PID}}#23593#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23593#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23593#g' + export HADOOP_NFS3_OPTS= + HADOOP_NFS3_OPTS= ++ replace_pid ++ echo ++ sed 's#{{PID}}#23593#g' + export HADOOP_JOURNALNODE_OPTS= + HADOOP_JOURNALNODE_OPTS= + get_gc_args ++ echo /var/log/hadoop-hdfs + GC_LOG_DIR=/var/log/hadoop-hdfs ++ date +%Y-%m-%d_%H-%M-%S + GC_DATE=2020-09-15_06-48-29 + JAVA8_VERBOSE_GC_VAR='-Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA8_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + JAVA11_VERBOSE_GC_VAR=-Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log + JAVA11_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xlog:gc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log' + set_basic_gc_tuning_args_based_on_java_version + get_java_major_version JAVA_MAJOR + '[' -z /usr/java/jdk1.8.0_232-cloudera/bin/java ']' ++ /usr/java/jdk1.8.0_232-cloudera/bin/java -version + local 'VERSION_STRING=openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode)' + local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+' + [[ openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]] + eval JAVA_MAJOR=8 ++ JAVA_MAJOR=8 + BASIC_GC_TUNING_ARGS= + case $JAVA_MAJOR in + BASIC_GC_TUNING_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + DATANODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + SECONDARY_NAMENODE_GC_ARGS='-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' + [[ ! -z '' ]] + [[ ! -z '' ]] + [[ ! -z '' ]] ++ replace_gc_args '-Xms4294967296 -Xmx4294967296 {{JAVA_GC_ARGS}} -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23593.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' ++ echo -Xms4294967296 -Xmx4294967296 '{{JAVA_GC_ARGS}}' -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23593.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh + export 'HADOOP_NAMENODE_OPTS=-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23593.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' + HADOOP_NAMENODE_OPTS='-Xms4294967296 -Xmx4294967296 -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp/hdfs_hdfs-NAMENODE-c7949fa2ac00e5e5b128a321193b5883_pid23593.hprof -XX:OnOutOfMemoryError=/opt/cloudera/cm-agent/service/common/killparent.sh' ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_DATANODE_OPTS= + HADOOP_DATANODE_OPTS= ++ replace_gc_args '' '-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps' ++ echo ++ sed 's#{{JAVA_GC_ARGS}}#-XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -Xloggc:/var/log/hadoop-hdfs/gc-2020-09-15_06-48-29.log -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps#g' + export HADOOP_SECONDARYNAMENODE_OPTS= + HADOOP_SECONDARYNAMENODE_OPTS= + '[' 7 -ge 4 ']' + HDFS_BIN=/opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs + export 'HADOOP_OPTS=-Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Djava.net.preferIPv4Stack=true ' + echo 'using /usr/java/jdk1.8.0_232-cloudera as JAVA_HOME' + echo 'using 7 as CDH_VERSION' + echo 'using /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE as CONF_DIR' + echo 'using as SECURE_USER' + echo 'using as SECURE_GROUP' + set_hadoop_classpath + set_classpath_in_var HADOOP_CLASSPATH + '[' -z HADOOP_CLASSPATH ']' + [[ -n /opt/cloudera/cm ]] ++ find /opt/cloudera/cm/lib/plugins -maxdepth 1 -name '*.jar' ++ tr '\n' : + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar: + [[ -n navigator/cdh6 ]] + for DIR in '$CM_ADD_TO_CP_DIRS' ++ find /opt/cloudera/cm/lib/plugins/navigator/cdh6 -maxdepth 1 -name '*.jar' ++ tr '\n' : + PLUGIN=/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + eval 'OLD_VALUE=$HADOOP_CLASSPATH' ++ OLD_VALUE= + NEW_VALUE=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar: + export HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + HADOOP_CLASSPATH=/opt/cloudera/cm/lib/plugins/event-publish-7.1.3-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-7.1.3.jar:/opt/cloudera/cm/lib/plugins/navigator/cdh6/audit-plugin-cdh6-7.1.3-shaded.jar + set -x + replace_conf_dir + echo CONF_DIR=/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE + echo CMF_CONF_DIR= + EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks' 'supervisor_status') ++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' hdfs.keytab '*jceks' supervisor_status + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -type f '!' -path '/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name hdfs.keytab '!' -name '*jceks' '!' -name supervisor_status -exec perl -pi -e 's#\{\{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE#g' '{}' ';' + make_scripts_executable + find /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';' + '[' DATANODE_MAX_LOCKED_MEMORY '!=' '' ']' + ulimit -l + export HADOOP_IDENT_STRING=hdfs + HADOOP_IDENT_STRING=hdfs + '[' -n '' ']' + '[' mkdir '!=' namenode ']' + acquire_kerberos_tgt hdfs.keytab + '[' -z hdfs.keytab ']' + KERBEROS_PRINCIPAL= + '[' '!' -z '' ']' + '[' -n '' ']' + '[' validate-writable-empty-dirs = namenode ']' + '[' file-operation = namenode ']' + '[' bootstrap = namenode ']' + '[' failover = namenode ']' + '[' transition-to-active = namenode ']' + '[' initializeSharedEdits = namenode ']' + '[' initialize-znode = namenode ']' + '[' format-namenode = namenode ']' + '[' monitor-decommission = namenode ']' + '[' jnSyncWait = namenode ']' + '[' nnRpcWait = namenode ']' + '[' -safemode = '' -a get = '' ']' + '[' monitor-upgrade = namenode ']' + '[' finalize-upgrade = namenode ']' + '[' rolling-upgrade-prepare = namenode ']' + '[' rolling-upgrade-finalize = namenode ']' + '[' nnDnLiveWait = namenode ']' + '[' monitor-offline = namenode ']' + '[' refresh-datanode = namenode ']' + '[' put = namenode ']' + '[' mkdir = namenode ']' + '[' setfacl = namenode ']' + '[' nfs3 = namenode ']' + '[' namenode = namenode -o secondarynamenode = namenode -o datanode = namenode ']' + HADOOP_OPTS='-Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + export 'HADOOP_OPTS=-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + HADOOP_OPTS='-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true ' + '[' namenode = namenode -a rollingUpgrade = '' ']' + exec /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs --config /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE namenode WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX. WARNING: HADOOP_NAMENODE_OPTS has been replaced by HDFS_NAMENODE_OPTS. Using value of HADOOP_NAMENODE_OPTS.
... View more
09-15-2020
04:50 AM
+ export HADOOP_IDENT_STRING=hdfs
+ HADOOP_IDENT_STRING=hdfs
+ '[' -n '' ']'
+ '[' mkdir '!=' namenode ']'
+ acquire_kerberos_tgt hdfs.keytab
+ '[' -z hdfs.keytab ']'
+ KERBEROS_PRINCIPAL=
+ '[' '!' -z '' ']'
+ '[' -n '' ']'
+ '[' validate-writable-empty-dirs = namenode ']'
+ '[' file-operation = namenode ']'
+ '[' bootstrap = namenode ']'
+ '[' failover = namenode ']'
+ '[' transition-to-active = namenode ']'
+ '[' initializeSharedEdits = namenode ']'
+ '[' initialize-znode = namenode ']'
+ '[' format-namenode = namenode ']'
+ '[' monitor-decommission = namenode ']'
+ '[' jnSyncWait = namenode ']'
+ '[' nnRpcWait = namenode ']'
+ '[' -safemode = '' -a get = '' ']'
+ '[' monitor-upgrade = namenode ']'
+ '[' finalize-upgrade = namenode ']'
+ '[' rolling-upgrade-prepare = namenode ']'
+ '[' rolling-upgrade-finalize = namenode ']'
+ '[' nnDnLiveWait = namenode ']'
+ '[' monitor-offline = namenode ']'
+ '[' refresh-datanode = namenode ']'
+ '[' put = namenode ']'
+ '[' mkdir = namenode ']'
+ '[' setfacl = namenode ']'
+ '[' nfs3 = namenode ']'
+ '[' namenode = namenode -o secondarynamenode = namenode -o datanode = namenode ']'
+ HADOOP_OPTS='-Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true '
+ export 'HADOOP_OPTS=-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true '
+ HADOOP_OPTS='-Dhdfs.audit.logger=INFO,RFAAUDIT -Dsecurity.audit.logger=INFO,RFAS -Djava.net.preferIPv4Stack=true '
+ '[' namenode = namenode -a rollingUpgrade = '' ']'
+ exec /opt/cloudera/parcels/CDH-7.1.3-1.cdh7.1.3.p0.4992530/lib/hadoop-hdfs/bin/hdfs --config /var/run/cloudera-scm-agent/process/1546335592-hdfs-NAMENODE namenode
WARNING: HADOOP_PREFIX has been replaced by HADOOP_HOME. Using value of HADOOP_PREFIX.
WARNING: HADOOP_NAMENODE_OPTS has been replaced by HDFS_NAMENODE_OPTS. Using value of HADOOP_NAMENODE_OPTS.
... View more
- Tags:
- CDP
- private cloud
Labels: