question Re: Found Error when install the CDP Trial Version in Support Questions

question Re: Found Error when install the CDP Trial Version in Support Questions https://community.cloudera.com/t5/Support-Questions/Found-Error-when-install-the-CDP-Trial-Version/m-p/297674#M218809 Hi <a href="https://community.cloudera.com/t5/user/viewprofilepage/user-id/12296">@Bender</a>  These are the last  cloudera-scm-agent.log [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO ================================================================================ [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO SCM Agent Version: 7.0.3 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent Protocol Version: 4 [07/Jun/2020 09:29:38 +0000] 1182 MainThread __init__ INFO Agent UUID file was last modified at 2020-05-19 00:58:10.773525 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using Host ID: 8e7960ee-38e1-4aff-85fd-cf35fff80d6d [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using directory: /run/cloudera-scm-agent [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using supervisor binary path: /opt/cloudera/cm-agent/bin/../bin/supervisord [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent Logging Level: INFO [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent config: [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.use_tls = 0 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.minimum_tls_protocol = TLSv1.2 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.cipher_list = HIGH:!DSS:!DH:!ADH:!DES:!3DES:!SHA1:!aNULL:!eNULL:!EXPORT:!SSLv2:!SSLv3:!TLSv1 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.max_cert_depth = 9 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.orphan_process_dir_staleness_threshold = 5184000 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.dns_resolution_collection_timeout_seconds = 30 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.orphan_process_dir_refresh_interval = 3600 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.local_filesystem_whitelist = ext2,ext3,ext4,xfs [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.stacks_log_bundle_max_bytes = 1073741824 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.metrics_url_timeout_seconds = 30.0 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.max_collection_wait_seconds = 10.0 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.task_metrics_timeout_seconds = 5.0 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.stacks_log_max_uncompressed_file_size_bytes = 5242880 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.scm_debug = INFO [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.server_host = 192.168.1.8 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.monitored_nodev_filesystem_types = nfs,nfs4,tmpfs [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.server_port = 7182 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.dns_resolution_collection_interval_seconds = 60 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.impala_profile_bundle_max_bytes = 1073741824 [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation. [07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent starting as pid 1182 user root(0) group root(0). [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem memory at /sys/fs/cgroup/memory [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem devices at /sys/fs/cgroup/devices [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem blkio at /sys/fs/cgroup/blkio [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: cpu [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'writable_cgroup_dot_procs': True, 'default_cpu_shares': 1024, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True} [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: cpuacct [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_cpuacct': True} [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: memory [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_memory_soft_limit_in_bytes': 8796093022207} [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: devices [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_devices': True} [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: blkio [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_blkio': True, 'default_blkio_weight': 1000} [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_memory_limit_in_bytes [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_blkio_weight [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: writable_cgroup_dot_procs [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_cpu_rt_runtime_us [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_memory_soft_limit_in_bytes [07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_cpu_shares [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_blkio_weight': 1000, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_memory_soft_limit_in_bytes': 8796093022207, 'has_cpuacct': True, 'default_cpu_shares': 1024, 'has_devices': True, 'has_blkio': True} [07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs'] [07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using timeout of 2.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using join timeout of 0.100000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using tolerance of 60.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs'] [07/Jun/2020 09:29:40 +0000] 1182 MainThread kt_renewer INFO Agent wide credential cache set to /var/run/cloudera-scm-agent/krb5cc_cm_agent_0 [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Setting up supervisord event monitor. [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using max_collection_wait_seconds of 10.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread metrics INFO Importing tasktracker metric schema from file /opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/tasktracker/schema.json [07/Jun/2020 09:29:40 +0000] 1182 MainThread tcp_metrics WARNING File '/proc/net/tcp6' couldn't be opened for tcp statistic collection, error=2 [07/Jun/2020 09:29:40 +0000] 1182 MainThread ntp_monitor INFO Using timeout of 2.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread dns_names INFO Using timeout of 30.000000 [07/Jun/2020 09:29:40 +0000] 1182 MainThread __init__ INFO Created DNS monitor. [07/Jun/2020 09:29:40 +0000] 1182 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880 [07/Jun/2020 09:29:40 +0000] 1182 MainThread daemon INFO Importing metric schema from file /opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/schema.json [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CMF_PACKAGE_DIR': '/opt/cloudera/cm-agent/service', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HBASE_CONNECTORS_HOME': '/usr/lib/hbase-connectors', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_KNOX_HOME': '/usr/lib/knox', 'CDH_PARQUET_HOME': '/usr/lib/parquet', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cloudera/cm', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_SERVER_ROOT': '/opt/cloudera/cm', 'CDH_KUDU_HOME': '/usr/lib/kudu', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CDH_HBASE_FILESYSTEM_HOME': '/usr/lib/hbase-filesystem', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_HUE_HOME': '/usr/lib/hue', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_TEZ_HOME': '/usr/lib/tez', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'} [07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels. [07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Trying to connect to supervisor (Attempt 1) [07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Supervisor version: 3.2.0, pid: 1181 [07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Successfully connected to supervisor [07/Jun/2020 09:29:42 +0000] 1182 MainThread agent INFO Supervisor version: 3.2.0, pid: 1181 [07/Jun/2020 09:29:42 +0000] 1182 MainThread agent INFO Connecting to previous supervisor: agent-1181-1591536577. [07/Jun/2020 09:29:44 +0000] 1182 MainThread supervisor INFO Triggering supervisord update. [07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Bus STARTING [07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Started monitor thread '_TimeoutMonitor'. [07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Serving on <A href="http://127.0.0.1:9001" target="_blank">http://127.0.0.1:9001</A> [07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Bus STARTED [07/Jun/2020 09:29:44 +0000] 1182 MainThread daemon INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7fc839302cd0>,) [07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Setting default socket timeout to 45 [07/Jun/2020 09:29:44 +0000] 1182 MonitorDaemon-Scheduler daemon INFO Monitor ready to report: ('HostMonitor',) [07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Previously active parcels: {'CDH': '7.0.3-1.cdh7.0.3.p0.1635019'} [07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Loading last saved hb response to complete initialization: /var/lib/cloudera-scm-agent/response.avro [07/Jun/2020 09:29:44 +0000] 1182 Monitor-HostMonitor network_interfaces INFO NIC iface virbr0 doesn't support ETHTOOL (95) [07/Jun/2020 09:29:44 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed. Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/agent.py", line 1428, in _send_heartbeat self.cfg.master_port) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/avro/ipc.py", line 469, in __init__ self.conn.connect() File "/usr/lib64/python2.7/httplib.py", line 824, in connect self.timeout, self.source_address) File "/usr/lib64/python2.7/socket.py", line 571, in create_connection raise err error: [Errno 111] Connection refused [07/Jun/2020 09:29:44 +0000] 1182 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.00 min:0.00 mean:0.00 max:0.00 LIFE_MAX:0.00 [07/Jun/2020 09:30:46 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed. Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/agent.py", line 1428, in _send_heartbeat self.cfg.master_port) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/avro/ipc.py", line 469, in __init__ self.conn.connect() File "/usr/lib64/python2.7/httplib.py", line 824, in connect self.timeout, self.source_address) File "/usr/lib64/python2.7/socket.py", line 571, in create_connection raise err error: [Errno 111] Connection refused [07/Jun/2020 09:31:16 +0000] 1182 MainThread agent INFO CM server guid: 69ed5c03-ba34-4036-bb2e-8bf1ba637574 [07/Jun/2020 09:31:16 +0000] 1182 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels [07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Agent does create users/groups and apply file permissions [07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Loading parcel manifest for: CDH-7.0.3-1.cdh7.0.3.p0.1635019 [07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Ensuring users/groups exist for new parcel CDH-7.0.3-1.cdh7.0.3.p0.1635019. [07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hadoop'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'httpfs'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'yarn'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hbase'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'knox'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hdfs'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'livy'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kms'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'atlas'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'flume'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hue'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zookeeper'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'accumulo'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'phoenix'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'mapred'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'druid'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'ranger'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zeppelin'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'oozie'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kudu'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'spark'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'superset'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'solr'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hive'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'impala'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'httpfs', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-httpfs', '--comment', 'Hadoop HTTPFS', '--shell', '/sbin/nologin', 'httpfs'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'sqoop', '-K', 'UMASK=022', '--home', '/var/lib/sqoop', '--comment', 'Sqoop', '--shell', '/sbin/nologin', 'sqoop'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kafka', '-K', 'UMASK=022', '--home', '/var/lib/kafka', '--comment', 'Kafka', '--shell', '/sbin/nologin', 'kafka'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'yarn', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-yarn', '--comment', 'Hadoop Yarn', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'yarn'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hbase', '-K', 'UMASK=022', '--home', '/var/lib/hbase', '--comment', 'HBase', '--shell', '/sbin/nologin', 'hbase'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'knox', '-K', 'UMASK=022', '--home', '/var/lib/knox', '--comment', 'Knox', '--shell', '/bin/bash', '--groups', 'hadoop', 'knox'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hdfs', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-hdfs', '--comment', 'Hadoop HDFS', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'hdfs'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'livy', '-K', 'UMASK=022', '--home', '/var/lib/livy', '--comment', 'Livy', '--shell', '/sbin/nologin', 'livy'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kms', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-kms', '--comment', 'Hadoop HDFS', '--shell', '/sbin/nologin', 'kms'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'atlas', '-K', 'UMASK=022', '--home', '/var/lib/atlas', '--comment', 'Atlas', '--shell', '/bin/bash', '--groups', 'hadoop', 'atlas'] [07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'flume', '-K', 'UMASK=022', '--home', '/var/lib/flume-ng', '--comment', 'Flume', '--shell', '/sbin/nologin', 'flume'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hue', '-K', 'UMASK=022', '--home', '/usr/lib/hue', '--comment', 'Hue', '--shell', '/sbin/nologin', 'hue'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'zookeeper', '-K', 'UMASK=022', '--home', '/var/lib/zookeeper', '--comment', 'ZooKeeper', '--shell', '/sbin/nologin', 'zookeeper'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'accumulo', '-K', 'UMASK=022', '--home', '/var/lib/accumulo', '--comment', 'Accumulo', '--shell', '/bin/bash', 'accumulo'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'phoenix', '-K', 'UMASK=022', '--home', '/var/lib/phoenix', '--comment', 'Phoenix User', '--shell', '/sbin/nologin', 'phoenix'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'mapred', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-mapreduce', '--comment', 'Hadoop MapReduce', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'mapred'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'druid', '-K', 'UMASK=022', '--home', '/var/lib/druid', '--comment', 'Druid', '--shell', '/bin/bash', '--groups', 'hadoop', 'druid'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'ranger', '-K', 'UMASK=022', '--home', '/var/lib/ranger', '--comment', 'Ranger', '--shell', '/bin/bash', '--groups', 'hadoop', 'ranger'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'zeppelin', '-K', 'UMASK=022', '--home', '/var/lib/zeppelin', '--comment', 'Zeppelin', '--shell', '/bin/bash', 'zeppelin'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'oozie', '-K', 'UMASK=022', '--home', '/var/lib/oozie', '--comment', 'Oozie User', '--shell', '/sbin/nologin', 'oozie'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kudu', '-K', 'UMASK=022', '--home', '/var/lib/kudu', '--comment', 'Kudu', '--shell', '/sbin/nologin', 'kudu'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'spark', '-K', 'UMASK=022', '--home', '/var/lib/spark', '--comment', 'Spark', '--shell', '/sbin/nologin', 'spark'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'superset', '-K', 'UMASK=022', '--home', '/var/lib/superset', '--comment', 'Superset', '--shell', '/bin/bash', 'superset'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'solr', '-K', 'UMASK=022', '--home', '/var/lib/solr', '--comment', 'Solr', '--shell', '/sbin/nologin', 'solr'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hive', '-K', 'UMASK=022', '--home', '/var/lib/hive', '--comment', 'Hive', '--shell', '/sbin/nologin', 'hive'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'impala', '-K', 'UMASK=022', '--home', '/var/lib/impala', '--comment', 'Impala', '--shell', '/sbin/nologin', '--groups', 'hive', 'impala'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Ensuring correct file permissions for new parcel CDH-7.0.3-1.cdh7.0.3.p0.1635019. [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db hue hue [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db 0660 [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '0660', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop hue hue [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop 0755 [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '0755', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor root yarn [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'root:yarn', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor 6050 [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '6050', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor'] [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel ERROR Error while attempting to modify permissions of file '/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller'. Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel.py", line 520, in ensure_permissions file = cmf.util.validate_and_open_fd(path, self.get_parcel_home(parcel)) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/__init__.py", line 358, in validate_and_open_fd fd = os.open(path, flags) OSError: [Errno 2] No such file or directory: '/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller' [07/Jun/2020 09:31:18 +0000] 1182 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache [07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache [07/Jun/2020 09:31:18 +0000] 1182 MainThread throttling_logger WARNING Failed parsing alternatives line: cli_mt string index out of range link currently points to /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/bin/cli_mt [07/Jun/2020 09:31:21 +0000] 1182 MainThread agent INFO Flood daemon (re)start attempt [07/Jun/2020 09:31:23 +0000] 1182 MainThread agent INFO Reloading status server config, sending SIGHUP [07/Jun/2020 09:31:24 +0000] 1182 MainThread throttling_logger INFO Identified java component java8 with full version openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) for requested version . [07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Instantiating process [07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Updating process: False {} [07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Deactivating process (skipped) [07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] stopping monitors [07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process ERROR [1546332019-host-inspector] Failed to write out saved config: [Errno 2] No such file or directory: '/var/run/cloudera-scm-agent/process/1546332019-host-inspector/proc.json' Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/process.py", line 481, in update_heartbeat f = self.agent.os_ops.open_write_file(os.path.join(self.dir, self.PROC_JSON)) File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/os_ops.py", line 342, in open_write_file fd = os.open(path, os.O_RDWR | os.O_CREAT | write_mode, mode) OSError: [Errno 2] No such file or directory: '/var/run/cloudera-scm-agent/process/1546332019-host-inspector/proc.json' [07/Jun/2020 09:31:24 +0000] 1182 MainThread agent WARNING Long HB processing time: 8.12568593025 [07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Updating process (remove). [07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Deactivating process (skipped) [07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] stopping monitors [07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Orphaning process [07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process ERROR Error creating marker /var/run/cloudera-scm-agent/process/1546332019-host-inspector/process_timestamp Traceback (most recent call last): File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/process.py", line 1050, in mark_orphan f = open(marker, 'w') IOError: [Errno 2] No such file or directory: u'/var/run/cloudera-scm-agent/process/1546332019-host-inspector/process_timestamp' [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Instantiating process [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Updating process: True {} [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO First time to activate the process [1546332040-host-inspector]. [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Created /var/run/cloudera-scm-agent/process/1546332040-host-inspector [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chowning /var/run/cloudera-scm-agent/process/1546332040-host-inspector to root (0) root (0) [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1546332040-host-inspector to 0751 [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Created /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chowning /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs to root (0) root (0) [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs to 0751 [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Refreshing process files: None [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 parcel INFO prepare_environment begin: {}, [], [] [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 parcel INFO No parcels activated for use [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 __init__ INFO Extracted 1 files and 0 dirs to /var/run/cloudera-scm-agent/process/1546332040-host-inspector. [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Launching process. one-off True, command mgmt/mgmt.sh, args [u'inspector', u'input.json', u'output.json', u'DEFAULT'] [07/Jun/2020 09:37:09 +0000] 1182 Thread-15 supervisor WARNING Failed while getting process info. Retrying. (<Fault 10: 'BAD_NAME: 1546332040-host-inspector'>) [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 supervisor INFO Triggering supervisord update. [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using generic audit plugin for process host-inspector [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Creating metadata plugin for process host-inspector [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using specific metadata plugin for process host-inspector [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using generic metadata plugin for process host-inspector [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Begin audit plugin refresh [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 throttling_logger INFO Scheduling a refresh for Audit Plugin for host-inspector with count 1 pipelines names ['']. [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Begin metadata plugin refresh [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Not creating a monitor for 1546332040-host-inspector: should_monitor returns false [07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Daemon refresh complete for process 1546332040-host-inspector. [07/Jun/2020 09:37:15 +0000] 1182 Audit-Plugin navigator_plugin INFO Pipelines updated for Audit Plugin: [] [07/Jun/2020 09:37:15 +0000] 1182 Audit-Plugin throttling_logger INFO Refreshing Audit Plugin for host-inspector with count 0 pipelines names []. [07/Jun/2020 09:37:15 +0000] 1182 Metadata-Plugin navigator_plugin INFO Pipelines updated for Metadata Plugin: [] [07/Jun/2020 09:37:20 +0000] 1182 MainThread process INFO [1546332040-host-inspector] Unregistered supervisor process EXITED [07/Jun/2020 09:37:22 +0000] 1182 MainThread supervisor INFO Triggering supervisord update. [07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)} [07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] Deactivating process (skipped) [07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] stopping monitors [07/Jun/2020 09:37:40 +0000] 1182 Audit-Plugin navigator_plugin INFO stopping Audit Plugin for host-inspector with count 0 pipelines names []. [07/Jun/2020 09:37:40 +0000] 1182 Metadata-Plugin navigator_plugin INFO stopping Metadata Plugin for host-inspector with count 0 pipelines names []. Tue, 09 Jun 2020 11:37:17 GMT BSST 2020-06-09T11:37:17Z