Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Found Error when install the CDP Trial Version

avatar
Contributor

Dear Cloudera Community,

 

Please help, I found the errors when install the CDP Trial Version,

The error messages like these :

 

https://cdn.redhat.com/content/eus/rhel/server/7/7Server/x86_64/sat-tools/6.6/os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found

Trying other mirror.

 


One of the configured repositories failed (Red Hat Satellite Tools 6.6 (for RHEL 7 Server - EUS) (RPMs)),

and yum doesn't have enough cached data to continue.

At this point the only safe thing yum can do is fail.

 

failure: repodata/repomd.xml from rhel-7-server-eus-satellite-tools-6.6-rpms: [Errno 256] No more mirrors to try.


https://cdn.redhat.com/content/eus/rhel/server/7/7Server/x86_64/sat-tools/6.6/os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
END (1)
remote package openjdk8 could not be installed, giving up

 

Regards,

BSST

 

24 REPLIES 24

avatar
Contributor

Hi @Bender 

 

Hi Ferenc,

 

1. To overcome the  Error “message “Null value(s) passed to lookup by non-nullable natural-id”

 

I add  the ip and hostname to these files  :

  /etc/hostname

xxx.xxx.xx.xx     test.testing.com

 

 /etc/hosts

127.0.0.1          localhost localhost.localdomain localhost4 localhost4.localdomain4

xxx.xxx.xx.xx  test.testing.com     test

 

 /etc/sysconfig/network :

NETWORKING=yes

NETWORKING_IPV6=no

HOSTNAME= test.testing.com

                                                      

2. For "Error 404 command has no file attached" message .

It occurs when I run Inspect Network Performance,

 

Does it occur when you change the scope by any chance? No

 

Do you get the expected results apart from the error message displayed, please?

It will show the message

 “Insufficient hosts in cluster Cluster 1.Cluster must have at least 2 hosts to run performance inspector.”

 

Regards,

BSST

avatar
Moderator

Hello @BSST ,

 

thank you for the more detailed report. Checking internally if we can re-produce.

 

Kind regards:

Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

avatar
Moderator

Hello @BSST ,

 

thinking it through my impression is that the agents are not able to reach the server and vice versa.

 

The screenshot shows that CM is waiting for the CM agent to heartbeat in, which doesn’t happen.

 

Did you completed this step in [1], please?

"Firewalls (such as iptables and firewalld) must be disabled or configured to allow access to ports used by Cloudera Manager, CDH, and related services."

 

Another possibility is that SELinux is enabled. [1] points out that "Security-Enhanced Linux (SELinux) must not block Cloudera Manager or CDH operations"

 

Please check the CM agent logs that would assist to find the root cause. 

 

Thank you:

Ferenc

 

[1] https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_network_and_security_re...

 


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

avatar
Contributor

Hi @Bender 

 

I have disabled the firewall and selinux with these messages :

 

[root@localhost selinux]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
Active: inactive (dead)
Docs: man:firewalld(1)

 

[root@localhost selinux]# sestatus
SELinux status: disabled

 

But I don't know about how to configured to allow access to ports used by Cloudera Manager, CDH, and related services ?

 

Regards,

 

BSST

 

avatar
Moderator

Hello @BSST ,

 

thank you for letting us know that you need clarification on how to set the ports used by CM and related products.

 

Please see our "Ports Used by Cloudera Runtime Components" documentation [1] that hopefully covers your enquiry.

 

Kind regards:

Ferenc

 

[1] https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-ports-used-by-runtime.html


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

avatar
Contributor

Hi @Bender 

 

These are the last  cloudera-scm-agent.log

 

[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO ================================================================================
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO SCM Agent Version: 7.0.3
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent Protocol Version: 4
[07/Jun/2020 09:29:38 +0000] 1182 MainThread __init__ INFO Agent UUID file was last modified at 2020-05-19 00:58:10.773525
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using Host ID: 8e7960ee-38e1-4aff-85fd-cf35fff80d6d
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using directory: /run/cloudera-scm-agent
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using supervisor binary path: /opt/cloudera/cm-agent/bin/../bin/supervisord
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent Logging Level: INFO
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent config:
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.use_tls = 0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.minimum_tls_protocol = TLSv1.2
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.cipher_list = HIGH:!DSS:!DH:!ADH:!DES:!3DES:!SHA1:!aNULL:!eNULL:!EXPORT:!SSLv2:!SSLv3:!TLSv1
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.max_cert_depth = 9
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.orphan_process_dir_staleness_threshold = 5184000
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.dns_resolution_collection_timeout_seconds = 30
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.orphan_process_dir_refresh_interval = 3600
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.local_filesystem_whitelist = ext2,ext3,ext4,xfs
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.stacks_log_bundle_max_bytes = 1073741824
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.metrics_url_timeout_seconds = 30.0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.max_collection_wait_seconds = 10.0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.task_metrics_timeout_seconds = 5.0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.stacks_log_max_uncompressed_file_size_bytes = 5242880
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.scm_debug = INFO
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.server_host = 192.168.1.8
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.monitored_nodev_filesystem_types = nfs,nfs4,tmpfs
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.server_port = 7182
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.dns_resolution_collection_interval_seconds = 60
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.impala_profile_bundle_max_bytes = 1073741824
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation.
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent starting as pid 1182 user root(0) group root(0).
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem memory at /sys/fs/cgroup/memory
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem devices at /sys/fs/cgroup/devices
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem blkio at /sys/fs/cgroup/blkio
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: cpu
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'writable_cgroup_dot_procs': True, 'default_cpu_shares': 1024, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: cpuacct
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_cpuacct': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: memory
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_memory_soft_limit_in_bytes': 8796093022207}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: devices
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_devices': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: blkio
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_blkio': True, 'default_blkio_weight': 1000}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_memory_limit_in_bytes
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_blkio_weight
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: writable_cgroup_dot_procs
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_cpu_rt_runtime_us
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_memory_soft_limit_in_bytes
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_cpu_shares
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_blkio_weight': 1000, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_memory_soft_limit_in_bytes': 8796093022207, 'has_cpuacct': True, 'default_cpu_shares': 1024, 'has_devices': True, 'has_blkio': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using timeout of 2.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using join timeout of 0.100000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using tolerance of 60.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs']
[07/Jun/2020 09:29:40 +0000] 1182 MainThread kt_renewer INFO Agent wide credential cache set to /var/run/cloudera-scm-agent/krb5cc_cm_agent_0
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Setting up supervisord event monitor.
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread metrics INFO Importing tasktracker metric schema from file /opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/tasktracker/schema.json
[07/Jun/2020 09:29:40 +0000] 1182 MainThread tcp_metrics WARNING File '/proc/net/tcp6' couldn't be opened for tcp statistic collection, error=2
[07/Jun/2020 09:29:40 +0000] 1182 MainThread ntp_monitor INFO Using timeout of 2.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread dns_names INFO Using timeout of 30.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread __init__ INFO Created DNS monitor.
[07/Jun/2020 09:29:40 +0000] 1182 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
[07/Jun/2020 09:29:40 +0000] 1182 MainThread daemon INFO Importing metric schema from file /opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/schema.json
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CMF_PACKAGE_DIR': '/opt/cloudera/cm-agent/service', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HBASE_CONNECTORS_HOME': '/usr/lib/hbase-connectors', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_KNOX_HOME': '/usr/lib/knox', 'CDH_PARQUET_HOME': '/usr/lib/parquet', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cloudera/cm', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_SERVER_ROOT': '/opt/cloudera/cm', 'CDH_KUDU_HOME': '/usr/lib/kudu', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CDH_HBASE_FILESYSTEM_HOME': '/usr/lib/hbase-filesystem', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_HUE_HOME': '/usr/lib/hue', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_TEZ_HOME': '/usr/lib/tez', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Trying to connect to supervisor (Attempt 1)
[07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Supervisor version: 3.2.0, pid: 1181
[07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Successfully connected to supervisor
[07/Jun/2020 09:29:42 +0000] 1182 MainThread agent INFO Supervisor version: 3.2.0, pid: 1181
[07/Jun/2020 09:29:42 +0000] 1182 MainThread agent INFO Connecting to previous supervisor: agent-1181-1591536577.
[07/Jun/2020 09:29:44 +0000] 1182 MainThread supervisor INFO Triggering supervisord update.
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Bus STARTING
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Started monitor thread '_TimeoutMonitor'.
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Serving on http://127.0.0.1:9001
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Bus STARTED
[07/Jun/2020 09:29:44 +0000] 1182 MainThread daemon INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7fc839302cd0>,)
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Setting default socket timeout to 45
[07/Jun/2020 09:29:44 +0000] 1182 MonitorDaemon-Scheduler daemon INFO Monitor ready to report: ('HostMonitor',)
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Previously active parcels: {'CDH': '7.0.3-1.cdh7.0.3.p0.1635019'}
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Loading last saved hb response to complete initialization: /var/lib/cloudera-scm-agent/response.avro
[07/Jun/2020 09:29:44 +0000] 1182 Monitor-HostMonitor network_interfaces INFO NIC iface virbr0 doesn't support ETHTOOL (95)
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed.
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/agent.py", line 1428, in _send_heartbeat
self.cfg.master_port)
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.7/httplib.py", line 824, in connect
self.timeout, self.source_address)
File "/usr/lib64/python2.7/socket.py", line 571, in create_connection
raise err
error: [Errno 111] Connection refused
[07/Jun/2020 09:29:44 +0000] 1182 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.00 min:0.00 mean:0.00 max:0.00 LIFE_MAX:0.00
[07/Jun/2020 09:30:46 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed.
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/agent.py", line 1428, in _send_heartbeat
self.cfg.master_port)
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.7/httplib.py", line 824, in connect
self.timeout, self.source_address)
File "/usr/lib64/python2.7/socket.py", line 571, in create_connection
raise err
error: [Errno 111] Connection refused
[07/Jun/2020 09:31:16 +0000] 1182 MainThread agent INFO CM server guid: 69ed5c03-ba34-4036-bb2e-8bf1ba637574
[07/Jun/2020 09:31:16 +0000] 1182 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Agent does create users/groups and apply file permissions
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Loading parcel manifest for: CDH-7.0.3-1.cdh7.0.3.p0.1635019
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Ensuring users/groups exist for new parcel CDH-7.0.3-1.cdh7.0.3.p0.1635019.
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hadoop']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'httpfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'yarn']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hbase']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'knox']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hdfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'livy']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kms']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'atlas']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'flume']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hue']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zookeeper']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'accumulo']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'phoenix']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'mapred']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'druid']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'ranger']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zeppelin']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'oozie']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kudu']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'spark']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'superset']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'solr']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hive']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'impala']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'httpfs', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-httpfs', '--comment', 'Hadoop HTTPFS', '--shell', '/sbin/nologin', 'httpfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'sqoop', '-K', 'UMASK=022', '--home', '/var/lib/sqoop', '--comment', 'Sqoop', '--shell', '/sbin/nologin', 'sqoop']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kafka', '-K', 'UMASK=022', '--home', '/var/lib/kafka', '--comment', 'Kafka', '--shell', '/sbin/nologin', 'kafka']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'yarn', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-yarn', '--comment', 'Hadoop Yarn', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'yarn']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hbase', '-K', 'UMASK=022', '--home', '/var/lib/hbase', '--comment', 'HBase', '--shell', '/sbin/nologin', 'hbase']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'knox', '-K', 'UMASK=022', '--home', '/var/lib/knox', '--comment', 'Knox', '--shell', '/bin/bash', '--groups', 'hadoop', 'knox']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hdfs', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-hdfs', '--comment', 'Hadoop HDFS', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'hdfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'livy', '-K', 'UMASK=022', '--home', '/var/lib/livy', '--comment', 'Livy', '--shell', '/sbin/nologin', 'livy']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kms', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-kms', '--comment', 'Hadoop HDFS', '--shell', '/sbin/nologin', 'kms']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'atlas', '-K', 'UMASK=022', '--home', '/var/lib/atlas', '--comment', 'Atlas', '--shell', '/bin/bash', '--groups', 'hadoop', 'atlas']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'flume', '-K', 'UMASK=022', '--home', '/var/lib/flume-ng', '--comment', 'Flume', '--shell', '/sbin/nologin', 'flume']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hue', '-K', 'UMASK=022', '--home', '/usr/lib/hue', '--comment', 'Hue', '--shell', '/sbin/nologin', 'hue']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'zookeeper', '-K', 'UMASK=022', '--home', '/var/lib/zookeeper', '--comment', 'ZooKeeper', '--shell', '/sbin/nologin', 'zookeeper']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'accumulo', '-K', 'UMASK=022', '--home', '/var/lib/accumulo', '--comment', 'Accumulo', '--shell', '/bin/bash', 'accumulo']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'phoenix', '-K', 'UMASK=022', '--home', '/var/lib/phoenix', '--comment', 'Phoenix User', '--shell', '/sbin/nologin', 'phoenix']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'mapred', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-mapreduce', '--comment', 'Hadoop MapReduce', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'mapred']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'druid', '-K', 'UMASK=022', '--home', '/var/lib/druid', '--comment', 'Druid', '--shell', '/bin/bash', '--groups', 'hadoop', 'druid']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'ranger', '-K', 'UMASK=022', '--home', '/var/lib/ranger', '--comment', 'Ranger', '--shell', '/bin/bash', '--groups', 'hadoop', 'ranger']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'zeppelin', '-K', 'UMASK=022', '--home', '/var/lib/zeppelin', '--comment', 'Zeppelin', '--shell', '/bin/bash', 'zeppelin']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'oozie', '-K', 'UMASK=022', '--home', '/var/lib/oozie', '--comment', 'Oozie User', '--shell', '/sbin/nologin', 'oozie']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kudu', '-K', 'UMASK=022', '--home', '/var/lib/kudu', '--comment', 'Kudu', '--shell', '/sbin/nologin', 'kudu']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'spark', '-K', 'UMASK=022', '--home', '/var/lib/spark', '--comment', 'Spark', '--shell', '/sbin/nologin', 'spark']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'superset', '-K', 'UMASK=022', '--home', '/var/lib/superset', '--comment', 'Superset', '--shell', '/bin/bash', 'superset']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'solr', '-K', 'UMASK=022', '--home', '/var/lib/solr', '--comment', 'Solr', '--shell', '/sbin/nologin', 'solr']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hive', '-K', 'UMASK=022', '--home', '/var/lib/hive', '--comment', 'Hive', '--shell', '/sbin/nologin', 'hive']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'impala', '-K', 'UMASK=022', '--home', '/var/lib/impala', '--comment', 'Impala', '--shell', '/sbin/nologin', '--groups', 'hive', 'impala']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Ensuring correct file permissions for new parcel CDH-7.0.3-1.cdh7.0.3.p0.1635019.
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db hue hue
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db 0660
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '0660', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop hue hue
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop 0755
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '0755', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor root yarn
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'root:yarn', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor 6050
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '6050', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel ERROR Error while attempting to modify permissions of file '/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller'.
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel.py", line 520, in ensure_permissions
file = cmf.util.validate_and_open_fd(path, self.get_parcel_home(parcel))
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/__init__.py", line 358, in validate_and_open_fd
fd = os.open(path, flags)
OSError: [Errno 2] No such file or directory: '/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller'
[07/Jun/2020 09:31:18 +0000] 1182 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[07/Jun/2020 09:31:18 +0000] 1182 MainThread throttling_logger WARNING Failed parsing alternatives line: cli_mt string index out of range link currently points to /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/bin/cli_mt
[07/Jun/2020 09:31:21 +0000] 1182 MainThread agent INFO Flood daemon (re)start attempt
[07/Jun/2020 09:31:23 +0000] 1182 MainThread agent INFO Reloading status server config, sending SIGHUP
[07/Jun/2020 09:31:24 +0000] 1182 MainThread throttling_logger INFO Identified java component java8 with full version openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) for requested version .
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Instantiating process
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Updating process: False {}
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Deactivating process (skipped)
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] stopping monitors
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process ERROR [1546332019-host-inspector] Failed to write out saved config: [Errno 2] No such file or directory: '/var/run/cloudera-scm-agent/process/1546332019-host-inspector/proc.json'
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/process.py", line 481, in update_heartbeat
f = self.agent.os_ops.open_write_file(os.path.join(self.dir, self.PROC_JSON))
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/os_ops.py", line 342, in open_write_file
fd = os.open(path, os.O_RDWR | os.O_CREAT | write_mode, mode)
OSError: [Errno 2] No such file or directory: '/var/run/cloudera-scm-agent/process/1546332019-host-inspector/proc.json'
[07/Jun/2020 09:31:24 +0000] 1182 MainThread agent WARNING Long HB processing time: 8.12568593025
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Updating process (remove).
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Deactivating process (skipped)
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] stopping monitors
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Orphaning process
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process ERROR Error creating marker /var/run/cloudera-scm-agent/process/1546332019-host-inspector/process_timestamp
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/process.py", line 1050, in mark_orphan
f = open(marker, 'w')
IOError: [Errno 2] No such file or directory: u'/var/run/cloudera-scm-agent/process/1546332019-host-inspector/process_timestamp'
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Instantiating process
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Updating process: True {}
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO First time to activate the process [1546332040-host-inspector].
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Created /var/run/cloudera-scm-agent/process/1546332040-host-inspector
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chowning /var/run/cloudera-scm-agent/process/1546332040-host-inspector to root (0) root (0)
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1546332040-host-inspector to 0751
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Created /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chowning /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs to root (0) root (0)
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs to 0751
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Refreshing process files: None
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 parcel INFO prepare_environment begin: {}, [], []
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 parcel INFO No parcels activated for use
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 __init__ INFO Extracted 1 files and 0 dirs to /var/run/cloudera-scm-agent/process/1546332040-host-inspector.
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Launching process. one-off True, command mgmt/mgmt.sh, args [u'inspector', u'input.json', u'output.json', u'DEFAULT']
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 supervisor WARNING Failed while getting process info. Retrying. (<Fault 10: 'BAD_NAME: 1546332040-host-inspector'>)
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 supervisor INFO Triggering supervisord update.
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using generic audit plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Creating metadata plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using specific metadata plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using generic metadata plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Begin audit plugin refresh
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 throttling_logger INFO Scheduling a refresh for Audit Plugin for host-inspector with count 1 pipelines names [''].
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Begin metadata plugin refresh
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Not creating a monitor for 1546332040-host-inspector: should_monitor returns false
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Daemon refresh complete for process 1546332040-host-inspector.
[07/Jun/2020 09:37:15 +0000] 1182 Audit-Plugin navigator_plugin INFO Pipelines updated for Audit Plugin: []
[07/Jun/2020 09:37:15 +0000] 1182 Audit-Plugin throttling_logger INFO Refreshing Audit Plugin for host-inspector with count 0 pipelines names [].
[07/Jun/2020 09:37:15 +0000] 1182 Metadata-Plugin navigator_plugin INFO Pipelines updated for Metadata Plugin: []
[07/Jun/2020 09:37:20 +0000] 1182 MainThread process INFO [1546332040-host-inspector] Unregistered supervisor process EXITED
[07/Jun/2020 09:37:22 +0000] 1182 MainThread supervisor INFO Triggering supervisord update.
[07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)}
[07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] Deactivating process (skipped)
[07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] stopping monitors
[07/Jun/2020 09:37:40 +0000] 1182 Audit-Plugin navigator_plugin INFO stopping Audit Plugin for host-inspector with count 0 pipelines names [].
[07/Jun/2020 09:37:40 +0000] 1182 Metadata-Plugin navigator_plugin INFO stopping Metadata Plugin for host-inspector with count 0 pipelines names [].

avatar
Moderator


Hello @BSST  ,

 

thank you for sending the agent logs. Based on this because of some reason the agent cannot connect to the CM server.:

 

[07/Jun/2020 09:30:46 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed.
error: [Errno 111] Connection refused

 

You will need to troubleshoot the connectivity between the agent node and the CM Server node and if the port is listening on the CM node.

  • What does the CM Server log shows at this period of time, please? (/var/log/cloudera-scm-server/cloudera-scm-server.log [1]). Do you see any exception there?
  • Did you follow all the steps one-by-one in our documentation?
  • This issue can be caused by multiple reasons e.g. even if the agent is configured for TLS, but the CM Server is not:
    • Network problem, the CM Server is now on another node (check the IP address), certificate issues.
    • Check if the CM Server has enough heap dedicated. Too low heap will result JVM to turn into heavy GC activity, rendering it unresponsive causing timeouts.

 

Please let us know if you managed to overcome this issue.

 

Kind regards:

Ferenc

 

[1] https://docs.cloudera.com/cloudera-manager/7.1.0/monitoring-and-diagnostics/topics/cm-logs.html


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

avatar
New Contributor

I also encountered a similar problem

My firewall and selinux have been turned off

Try to modify the host name and several configuration files according to the original method, but it still doesn't work

Snipaste_2020-09-30_10-12-01.png

avatar
Rising Star

Translated text- Cluster installation
© Welcome
Cluster Basics
Install Agents
The installation has been successfully completed ,
A
Null value(s) passed to lookup by non-nullable natural-
id
Specify Hosts
© Select repository
3 of the 3 hosts have been successfully completed
Host name
IP address
Progress
Status
Select JDK
192. 168. 8.101
192. 168. 8.101
The installation was successfully completed .
Detailed information
© Provide SSH login credentials
192. 168. 8.102
192. 168. 8.102
The safety table has been successfully completed.
Detailed information
7) Install Agents
192. 168. 8.103
192. 168. 8.103
~ The installation has been successfully completed .
Detailed information port
8 Install Parcels
(9 Inspect Cluster


Kalyani Kundalia, Community Moderator

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

avatar
Moderator

Hello @5sdba ,

 

thank you for reporting the issue you hit. Can you please specify the CDP version you are using and if you are using CM HA (Cloudera Manager High Availability), please?

 

Thank you:
Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community: