Support Questions
Find answers, ask questions, and share your expertise

Found Error when install the CDP Trial Version

Explorer

Dear Cloudera Community,

 

Please help, I found the errors when install the CDP Trial Version,

The error messages like these :

 

https://cdn.redhat.com/content/eus/rhel/server/7/7Server/x86_64/sat-tools/6.6/os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found

Trying other mirror.

 


One of the configured repositories failed (Red Hat Satellite Tools 6.6 (for RHEL 7 Server - EUS) (RPMs)),

and yum doesn't have enough cached data to continue.

At this point the only safe thing yum can do is fail.

 

failure: repodata/repomd.xml from rhel-7-server-eus-satellite-tools-6.6-rpms: [Errno 256] No more mirrors to try.


https://cdn.redhat.com/content/eus/rhel/server/7/7Server/x86_64/sat-tools/6.6/os/repodata/repomd.xml: [Errno 14] HTTPS Error 404 - Not Found
END (1)
remote package openjdk8 could not be installed, giving up

 

Regards,

BSST

 

24 REPLIES 24

Moderator

Hello @BSST ,

 

thank you for letting us know that the RedHat repo cannot be accessed.

 

Please follow [1] and if it does not help to resolve the repository issue, kindly reach out to RedHat Support for further troubleshooting.

 

Please let us know if you managed to overcome this obstacle.

 

Kind regards:

Ferenc

 

[1] https://access.redhat.com/articles/1320623


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi Ferenc,

 

I have run the below command to clear the yum cache: 

$ rm -fr /var/cache/yum/*

$ yum clean all

 

But the errors still occur.

 

Regards,

BSST

Moderator

Hello @BSST ,

 

thank you for updating us that cleaning the local client cache for the yum repositories did not resolve your issue connecting to Red Hat CDN.

 

Did you go through the "Known Issues" section in the Red Hat KB [1], please?

Should the instructions in under "Known Issues" section did not help, please file a Support Ticket with Red Hat for further troubleshooting.

 

Please let us know once you overcome the 404 issue and you hit a problem again!

 

Best regards:

Ferenc

 

[1] https://access.redhat.com/articles/1320623


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi @Bender ,

 

I can install the agents successfully,

 

but the status show  “Waiting for newly installed agent to heartbeat “

 

When I click the button “Continue” It show message “Null value(s) passed to lookup by non-nullable natural-id”

 

 

Regards,

 

Bong Susanto

20200519.jpg

Moderator

Hello @BSST ,

 

thank you for raising the question regarding the “Null value(s) passed to lookup by non-nullable natural-id” exception shown once the CM Agents reported being installed successfully.

 

There is a known issue reported for the trial version for CM HA mode that the agent is being reported as installed pre-maturely. This issue is not present in a non-HA environment. My understanding is that the agent would be installed after all.

 

Can you please confirm that you managed to install the agents successfully despite the odd message and if you are running in CM HA mode, please?

 

We recommend to use the trial version in a non-HA mode.

 

Thank you:

Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi @Bender 

 

What is the CM HA mode means ?

 

I just install using the Trial Version CDP without supply any parameter till finish.

 

Then I go to the firefox browser and type  http://localhost:7180 to log in to Cloudera Manager.

Then  I choose the license " Try Cloudera Data Platform for 60 days ".

Then I install the Cloudera Manager Agent. I choose the Repository Location : "Public Cloudera Repository ", and let the others parameter by default.

Then I install the JDK using option " Install a system provided version of Open JDK "

 

 

Regards,

 

BSST

 

 

 

Moderator

Hello @BSST ,

 

can you please check if you get an Error 113 ('No route to host') in /var/log/cloudera-scm-agent/cloudera-scm-agent.log and follow instructions under [1] to resolve the issue?

 

Furthermore please make sure you follow the Network and Security Requirements under [2].

I have checked internally and the section under "CDH and Cloudera Manager Networking and Security Requirements" applies to CDP, however please ignore the "Users and Groups" table, as these will be taken care of the automated installation. Just make sure the created users and groups are not modified/removed by anyone or any automation. The doc that will cover this section for CDP is on it's way for publication (thanks to your input on this missing piece!).

 

To answer your enquiry what does CM HA means: Cloudera Manager High Availability.

 

Thank you:
Ferenc

 

[1] https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-troubleshooting-installation.html

[2] https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_network_and_security_re...


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi @Bender ,

I can add host and cluster after I updated the network files likes  /etc/hostname, /etc/hosts, and /etc/sysconfig/network .

 

I found message  "Error 404 command has no file attached"  when I run Inspect Network Performance.

IMG_20200524_205806-S.jpg

 

Regards,

BSST

Moderator

Hello @BSST ,

 

it is great to hear that you can add hosts on CDP now without issue and letting us know what did you do to overcome the problem. It will help other Community Members to follow your solution in a similar situation.

 

Regarding to the "Error 404 command has no file attached" message:

- first of all, thank you for reporting it

- can you please share the steps to reproduce this message, please?

 

Does it occur when you change the scope by any chance?

Do you get the expected results apart from the error message displayed, please?

 

Kind regards:

Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi @Bender 

 

Hi Ferenc,

 

1. To overcome the  Error “message “Null value(s) passed to lookup by non-nullable natural-id”

 

I add  the ip and hostname to these files  :

  /etc/hostname

xxx.xxx.xx.xx     test.testing.com

 

 /etc/hosts

127.0.0.1          localhost localhost.localdomain localhost4 localhost4.localdomain4

xxx.xxx.xx.xx  test.testing.com     test

 

 /etc/sysconfig/network :

NETWORKING=yes

NETWORKING_IPV6=no

HOSTNAME= test.testing.com

                                                      

2. For "Error 404 command has no file attached" message .

It occurs when I run Inspect Network Performance,

 

Does it occur when you change the scope by any chance? No

 

Do you get the expected results apart from the error message displayed, please?

It will show the message

 “Insufficient hosts in cluster Cluster 1.Cluster must have at least 2 hosts to run performance inspector.”

 

Regards,

BSST

Moderator

Hello @BSST ,

 

thank you for the more detailed report. Checking internally if we can re-produce.

 

Kind regards:

Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Moderator

Hello @BSST ,

 

thinking it through my impression is that the agents are not able to reach the server and vice versa.

 

The screenshot shows that CM is waiting for the CM agent to heartbeat in, which doesn’t happen.

 

Did you completed this step in [1], please?

"Firewalls (such as iptables and firewalld) must be disabled or configured to allow access to ports used by Cloudera Manager, CDH, and related services."

 

Another possibility is that SELinux is enabled. [1] points out that "Security-Enhanced Linux (SELinux) must not block Cloudera Manager or CDH operations"

 

Please check the CM agent logs that would assist to find the root cause. 

 

Thank you:

Ferenc

 

[1] https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_network_and_security_re...

 


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi @Bender 

 

I have disabled the firewall and selinux with these messages :

 

[root@localhost selinux]# systemctl status firewalld
● firewalld.service - firewalld - dynamic firewall daemon
Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled; vendor preset: enabled)
Active: inactive (dead)
Docs: man:firewalld(1)

 

[root@localhost selinux]# sestatus
SELinux status: disabled

 

But I don't know about how to configured to allow access to ports used by Cloudera Manager, CDH, and related services ?

 

Regards,

 

BSST

 

Moderator

Hello @BSST ,

 

thank you for letting us know that you need clarification on how to set the ports used by CM and related products.

 

Please see our "Ports Used by Cloudera Runtime Components" documentation [1] that hopefully covers your enquiry.

 

Kind regards:

Ferenc

 

[1] https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-ports-used-by-runtime.html


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Explorer

Hi @Bender 

 

These are the last  cloudera-scm-agent.log

 

[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO ================================================================================
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO SCM Agent Version: 7.0.3
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent Protocol Version: 4
[07/Jun/2020 09:29:38 +0000] 1182 MainThread __init__ INFO Agent UUID file was last modified at 2020-05-19 00:58:10.773525
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using Host ID: 8e7960ee-38e1-4aff-85fd-cf35fff80d6d
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using directory: /run/cloudera-scm-agent
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Using supervisor binary path: /opt/cloudera/cm-agent/bin/../bin/supervisord
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent Logging Level: INFO
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent config:
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.use_tls = 0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.minimum_tls_protocol = TLSv1.2
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.cipher_list = HIGH:!DSS:!DH:!ADH:!DES:!3DES:!SHA1:!aNULL:!eNULL:!EXPORT:!SSLv2:!SSLv3:!TLSv1
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Security.max_cert_depth = 9
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.orphan_process_dir_staleness_threshold = 5184000
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.dns_resolution_collection_timeout_seconds = 30
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.orphan_process_dir_refresh_interval = 3600
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.local_filesystem_whitelist = ext2,ext3,ext4,xfs
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.stacks_log_bundle_max_bytes = 1073741824
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.metrics_url_timeout_seconds = 30.0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.max_collection_wait_seconds = 10.0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.task_metrics_timeout_seconds = 5.0
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.stacks_log_max_uncompressed_file_size_bytes = 5242880
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.scm_debug = INFO
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.server_host = 192.168.1.8
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.monitored_nodev_filesystem_types = nfs,nfs4,tmpfs
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.server_port = 7182
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.dns_resolution_collection_interval_seconds = 60
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO General.impala_profile_bundle_max_bytes = 1073741824
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation.
[07/Jun/2020 09:29:38 +0000] 1182 MainThread agent INFO Agent starting as pid 1182 user root(0) group root(0).
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem memory at /sys/fs/cgroup/memory
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem devices at /sys/fs/cgroup/devices
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found existing subsystem blkio at /sys/fs/cgroup/blkio
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: cpu
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'writable_cgroup_dot_procs': True, 'default_cpu_shares': 1024, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: cpuacct
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_cpuacct': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: memory
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_memory_soft_limit_in_bytes': 8796093022207}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: devices
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_devices': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Found cgroups subsystem: blkio
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Adding more caps: {'has_blkio': True, 'default_blkio_weight': 1000}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_memory_limit_in_bytes
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_blkio_weight
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: writable_cgroup_dot_procs
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_cpu_rt_runtime_us
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_memory_soft_limit_in_bytes
[07/Jun/2020 09:29:40 +0000] 1182 MainThread cgroups INFO Ignoring cgroup avro_cap: default_cpu_shares
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': 8796093022207, 'default_blkio_weight': 1000, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_memory_soft_limit_in_bytes': 8796093022207, 'has_cpuacct': True, 'default_cpu_shares': 1024, 'has_devices': True, 'has_blkio': True}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using timeout of 2.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using join timeout of 0.100000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Using tolerance of 60.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread filesystem_map INFO Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs']
[07/Jun/2020 09:29:40 +0000] 1182 MainThread kt_renewer INFO Agent wide credential cache set to /var/run/cloudera-scm-agent/krb5cc_cm_agent_0
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Setting up supervisord event monitor.
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using metrics_url_timeout_seconds of 30.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using task_metrics_timeout_seconds of 5.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Using max_collection_wait_seconds of 10.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread metrics INFO Importing tasktracker metric schema from file /opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/tasktracker/schema.json
[07/Jun/2020 09:29:40 +0000] 1182 MainThread tcp_metrics WARNING File '/proc/net/tcp6' couldn't be opened for tcp statistic collection, error=2
[07/Jun/2020 09:29:40 +0000] 1182 MainThread ntp_monitor INFO Using timeout of 2.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread dns_names INFO Using timeout of 30.000000
[07/Jun/2020 09:29:40 +0000] 1182 MainThread __init__ INFO Created DNS monitor.
[07/Jun/2020 09:29:40 +0000] 1182 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
[07/Jun/2020 09:29:40 +0000] 1182 MainThread daemon INFO Importing metric schema from file /opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/monitor/schema.json
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CMF_PACKAGE_DIR': '/opt/cloudera/cm-agent/service', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HBASE_CONNECTORS_HOME': '/usr/lib/hbase-connectors', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_KNOX_HOME': '/usr/lib/knox', 'CDH_PARQUET_HOME': '/usr/lib/parquet', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cloudera/cm', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CMF_SERVER_ROOT': '/opt/cloudera/cm', 'CDH_KUDU_HOME': '/usr/lib/kudu', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'CDH_HBASE_FILESYSTEM_HOME': '/usr/lib/hbase-filesystem', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_HUE_HOME': '/usr/lib/hue', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_TEZ_HOME': '/usr/lib/tez', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[07/Jun/2020 09:29:40 +0000] 1182 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Trying to connect to supervisor (Attempt 1)
[07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Supervisor version: 3.2.0, pid: 1181
[07/Jun/2020 09:29:42 +0000] 1182 MainThread supervisor INFO Successfully connected to supervisor
[07/Jun/2020 09:29:42 +0000] 1182 MainThread agent INFO Supervisor version: 3.2.0, pid: 1181
[07/Jun/2020 09:29:42 +0000] 1182 MainThread agent INFO Connecting to previous supervisor: agent-1181-1591536577.
[07/Jun/2020 09:29:44 +0000] 1182 MainThread supervisor INFO Triggering supervisord update.
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Bus STARTING
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Started monitor thread '_TimeoutMonitor'.
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Serving on http://127.0.0.1:9001
[07/Jun/2020 09:29:44 +0000] 1182 MainThread _cplogging INFO [07/Jun/2020:09:29:44] ENGINE Bus STARTED
[07/Jun/2020 09:29:44 +0000] 1182 MainThread daemon INFO New monitor: (<cmf.monitor.host.HostMonitor object at 0x7fc839302cd0>,)
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Setting default socket timeout to 45
[07/Jun/2020 09:29:44 +0000] 1182 MonitorDaemon-Scheduler daemon INFO Monitor ready to report: ('HostMonitor',)
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Previously active parcels: {'CDH': '7.0.3-1.cdh7.0.3.p0.1635019'}
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent INFO Loading last saved hb response to complete initialization: /var/lib/cloudera-scm-agent/response.avro
[07/Jun/2020 09:29:44 +0000] 1182 Monitor-HostMonitor network_interfaces INFO NIC iface virbr0 doesn't support ETHTOOL (95)
[07/Jun/2020 09:29:44 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed.
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/agent.py", line 1428, in _send_heartbeat
self.cfg.master_port)
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.7/httplib.py", line 824, in connect
self.timeout, self.source_address)
File "/usr/lib64/python2.7/socket.py", line 571, in create_connection
raise err
error: [Errno 111] Connection refused
[07/Jun/2020 09:29:44 +0000] 1182 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.00 min:0.00 mean:0.00 max:0.00 LIFE_MAX:0.00
[07/Jun/2020 09:30:46 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed.
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/agent.py", line 1428, in _send_heartbeat
self.cfg.master_port)
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/avro/ipc.py", line 469, in __init__
self.conn.connect()
File "/usr/lib64/python2.7/httplib.py", line 824, in connect
self.timeout, self.source_address)
File "/usr/lib64/python2.7/socket.py", line 571, in create_connection
raise err
error: [Errno 111] Connection refused
[07/Jun/2020 09:31:16 +0000] 1182 MainThread agent INFO CM server guid: 69ed5c03-ba34-4036-bb2e-8bf1ba637574
[07/Jun/2020 09:31:16 +0000] 1182 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Agent does create users/groups and apply file permissions
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Loading parcel manifest for: CDH-7.0.3-1.cdh7.0.3.p0.1635019
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Ensuring users/groups exist for new parcel CDH-7.0.3-1.cdh7.0.3.p0.1635019.
[07/Jun/2020 09:31:16 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hadoop']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'httpfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'sqoop']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kafka']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'yarn']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hbase']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'knox']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hdfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'livy']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kms']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'atlas']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'flume']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hue']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zookeeper']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'accumulo']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'phoenix']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'mapred']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'druid']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'ranger']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'zeppelin']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'oozie']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'kudu']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'spark']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'superset']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'solr']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'hive']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/groupadd', '-r', 'impala']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'httpfs', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-httpfs', '--comment', 'Hadoop HTTPFS', '--shell', '/sbin/nologin', 'httpfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'sqoop', '-K', 'UMASK=022', '--home', '/var/lib/sqoop', '--comment', 'Sqoop', '--shell', '/sbin/nologin', 'sqoop']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kafka', '-K', 'UMASK=022', '--home', '/var/lib/kafka', '--comment', 'Kafka', '--shell', '/sbin/nologin', 'kafka']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'yarn', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-yarn', '--comment', 'Hadoop Yarn', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'yarn']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hbase', '-K', 'UMASK=022', '--home', '/var/lib/hbase', '--comment', 'HBase', '--shell', '/sbin/nologin', 'hbase']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'knox', '-K', 'UMASK=022', '--home', '/var/lib/knox', '--comment', 'Knox', '--shell', '/bin/bash', '--groups', 'hadoop', 'knox']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hdfs', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-hdfs', '--comment', 'Hadoop HDFS', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'hdfs']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'livy', '-K', 'UMASK=022', '--home', '/var/lib/livy', '--comment', 'Livy', '--shell', '/sbin/nologin', 'livy']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kms', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-kms', '--comment', 'Hadoop HDFS', '--shell', '/sbin/nologin', 'kms']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'atlas', '-K', 'UMASK=022', '--home', '/var/lib/atlas', '--comment', 'Atlas', '--shell', '/bin/bash', '--groups', 'hadoop', 'atlas']
[07/Jun/2020 09:31:17 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'flume', '-K', 'UMASK=022', '--home', '/var/lib/flume-ng', '--comment', 'Flume', '--shell', '/sbin/nologin', 'flume']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hue', '-K', 'UMASK=022', '--home', '/usr/lib/hue', '--comment', 'Hue', '--shell', '/sbin/nologin', 'hue']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'zookeeper', '-K', 'UMASK=022', '--home', '/var/lib/zookeeper', '--comment', 'ZooKeeper', '--shell', '/sbin/nologin', 'zookeeper']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'accumulo', '-K', 'UMASK=022', '--home', '/var/lib/accumulo', '--comment', 'Accumulo', '--shell', '/bin/bash', 'accumulo']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'phoenix', '-K', 'UMASK=022', '--home', '/var/lib/phoenix', '--comment', 'Phoenix User', '--shell', '/sbin/nologin', 'phoenix']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'mapred', '-K', 'UMASK=022', '--home', '/var/lib/hadoop-mapreduce', '--comment', 'Hadoop MapReduce', '--shell', '/sbin/nologin', '--groups', 'hadoop', 'mapred']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'druid', '-K', 'UMASK=022', '--home', '/var/lib/druid', '--comment', 'Druid', '--shell', '/bin/bash', '--groups', 'hadoop', 'druid']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'ranger', '-K', 'UMASK=022', '--home', '/var/lib/ranger', '--comment', 'Ranger', '--shell', '/bin/bash', '--groups', 'hadoop', 'ranger']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'zeppelin', '-K', 'UMASK=022', '--home', '/var/lib/zeppelin', '--comment', 'Zeppelin', '--shell', '/bin/bash', 'zeppelin']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'oozie', '-K', 'UMASK=022', '--home', '/var/lib/oozie', '--comment', 'Oozie User', '--shell', '/sbin/nologin', 'oozie']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'kudu', '-K', 'UMASK=022', '--home', '/var/lib/kudu', '--comment', 'Kudu', '--shell', '/sbin/nologin', 'kudu']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'spark', '-K', 'UMASK=022', '--home', '/var/lib/spark', '--comment', 'Spark', '--shell', '/sbin/nologin', 'spark']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'superset', '-K', 'UMASK=022', '--home', '/var/lib/superset', '--comment', 'Superset', '--shell', '/bin/bash', 'superset']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'solr', '-K', 'UMASK=022', '--home', '/var/lib/solr', '--comment', 'Solr', '--shell', '/sbin/nologin', 'solr']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'hive', '-K', 'UMASK=022', '--home', '/var/lib/hive', '--comment', 'Hive', '--shell', '/sbin/nologin', 'hive']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['/usr/sbin/useradd', '-r', '-m', '-g', 'impala', '-K', 'UMASK=022', '--home', '/var/lib/impala', '--comment', 'Impala', '--shell', '/sbin/nologin', '--groups', 'hive', 'impala']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Ensuring correct file permissions for new parcel CDH-7.0.3-1.cdh7.0.3.p0.1635019.
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db hue hue
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db 0660
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '0660', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop/desktop.db']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop hue hue
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'hue:hue', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop 0755
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '0755', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hue/desktop']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chown: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor root yarn
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chown', 'root:yarn', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO chmod: /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor 6050
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel INFO Executing command ['chmod', '6050', u'/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-yarn/bin/container-executor']
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel ERROR Error while attempting to modify permissions of file '/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller'.
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/parcel.py", line 520, in ensure_permissions
file = cmf.util.validate_and_open_fd(path, self.get_parcel_home(parcel))
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/__init__.py", line 358, in validate_and_open_fd
fd = os.open(path, flags)
OSError: [Errno 2] No such file or directory: '/opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/lib/hadoop-0.20-mapreduce/sbin/Linux/task-controller'
[07/Jun/2020 09:31:18 +0000] 1182 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[07/Jun/2020 09:31:18 +0000] 1182 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[07/Jun/2020 09:31:18 +0000] 1182 MainThread throttling_logger WARNING Failed parsing alternatives line: cli_mt string index out of range link currently points to /opt/cloudera/parcels/CDH-7.0.3-1.cdh7.0.3.p0.1635019/bin/cli_mt
[07/Jun/2020 09:31:21 +0000] 1182 MainThread agent INFO Flood daemon (re)start attempt
[07/Jun/2020 09:31:23 +0000] 1182 MainThread agent INFO Reloading status server config, sending SIGHUP
[07/Jun/2020 09:31:24 +0000] 1182 MainThread throttling_logger INFO Identified java component java8 with full version openjdk version "1.8.0_232" OpenJDK Runtime Environment (AdoptOpenJDK)(build 1.8.0_232-b09) OpenJDK 64-Bit Server VM (AdoptOpenJDK)(build 25.232-b09, mixed mode) for requested version .
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Instantiating process
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Updating process: False {}
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Deactivating process (skipped)
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] stopping monitors
[07/Jun/2020 09:31:24 +0000] 1182 Thread-17 process ERROR [1546332019-host-inspector] Failed to write out saved config: [Errno 2] No such file or directory: '/var/run/cloudera-scm-agent/process/1546332019-host-inspector/proc.json'
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/process.py", line 481, in update_heartbeat
f = self.agent.os_ops.open_write_file(os.path.join(self.dir, self.PROC_JSON))
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/util/os_ops.py", line 342, in open_write_file
fd = os.open(path, os.O_RDWR | os.O_CREAT | write_mode, mode)
OSError: [Errno 2] No such file or directory: '/var/run/cloudera-scm-agent/process/1546332019-host-inspector/proc.json'
[07/Jun/2020 09:31:24 +0000] 1182 MainThread agent WARNING Long HB processing time: 8.12568593025
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Updating process (remove).
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Deactivating process (skipped)
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] stopping monitors
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process INFO [1546332019-host-inspector] Orphaning process
[07/Jun/2020 09:37:09 +0000] 1182 Thread-17 process ERROR Error creating marker /var/run/cloudera-scm-agent/process/1546332019-host-inspector/process_timestamp
Traceback (most recent call last):
File "/opt/cloudera/cm-agent/lib/python2.7/site-packages/cmf/process.py", line 1050, in mark_orphan
f = open(marker, 'w')
IOError: [Errno 2] No such file or directory: u'/var/run/cloudera-scm-agent/process/1546332019-host-inspector/process_timestamp'
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Instantiating process
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Updating process: True {}
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO First time to activate the process [1546332040-host-inspector].
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Created /var/run/cloudera-scm-agent/process/1546332040-host-inspector
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chowning /var/run/cloudera-scm-agent/process/1546332040-host-inspector to root (0) root (0)
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1546332040-host-inspector to 0751
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Created /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chowning /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs to root (0) root (0)
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 agent INFO Chmod'ing /var/run/cloudera-scm-agent/process/1546332040-host-inspector/logs to 0751
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Refreshing process files: None
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 parcel INFO prepare_environment begin: {}, [], []
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 parcel INFO No parcels activated for use
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 __init__ INFO Extracted 1 files and 0 dirs to /var/run/cloudera-scm-agent/process/1546332040-host-inspector.
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 process INFO [1546332040-host-inspector] Launching process. one-off True, command mgmt/mgmt.sh, args [u'inspector', u'input.json', u'output.json', u'DEFAULT']
[07/Jun/2020 09:37:09 +0000] 1182 Thread-15 supervisor WARNING Failed while getting process info. Retrying. (<Fault 10: 'BAD_NAME: 1546332040-host-inspector'>)
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 supervisor INFO Triggering supervisord update.
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using generic audit plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Creating metadata plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using specific metadata plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 util INFO Using generic metadata plugin for process host-inspector
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Begin audit plugin refresh
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 throttling_logger INFO Scheduling a refresh for Audit Plugin for host-inspector with count 1 pipelines names [''].
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Begin metadata plugin refresh
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Not creating a monitor for 1546332040-host-inspector: should_monitor returns false
[07/Jun/2020 09:37:11 +0000] 1182 Thread-15 process INFO Daemon refresh complete for process 1546332040-host-inspector.
[07/Jun/2020 09:37:15 +0000] 1182 Audit-Plugin navigator_plugin INFO Pipelines updated for Audit Plugin: []
[07/Jun/2020 09:37:15 +0000] 1182 Audit-Plugin throttling_logger INFO Refreshing Audit Plugin for host-inspector with count 0 pipelines names [].
[07/Jun/2020 09:37:15 +0000] 1182 Metadata-Plugin navigator_plugin INFO Pipelines updated for Metadata Plugin: []
[07/Jun/2020 09:37:20 +0000] 1182 MainThread process INFO [1546332040-host-inspector] Unregistered supervisor process EXITED
[07/Jun/2020 09:37:22 +0000] 1182 MainThread supervisor INFO Triggering supervisord update.
[07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] Updating process: False {u'running': (True, False), u'run_generation': (1, 2)}
[07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] Deactivating process (skipped)
[07/Jun/2020 09:37:36 +0000] 1182 Thread-17 process INFO [1546332040-host-inspector] stopping monitors
[07/Jun/2020 09:37:40 +0000] 1182 Audit-Plugin navigator_plugin INFO stopping Audit Plugin for host-inspector with count 0 pipelines names [].
[07/Jun/2020 09:37:40 +0000] 1182 Metadata-Plugin navigator_plugin INFO stopping Metadata Plugin for host-inspector with count 0 pipelines names [].

Moderator


Hello @BSST  ,

 

thank you for sending the agent logs. Based on this because of some reason the agent cannot connect to the CM server.:

 

[07/Jun/2020 09:30:46 +0000] 1182 MainThread agent ERROR Heartbeating to 192.168.1.8:7182 failed.
error: [Errno 111] Connection refused

 

You will need to troubleshoot the connectivity between the agent node and the CM Server node and if the port is listening on the CM node.

  • What does the CM Server log shows at this period of time, please? (/var/log/cloudera-scm-server/cloudera-scm-server.log [1]). Do you see any exception there?
  • Did you follow all the steps one-by-one in our documentation?
  • This issue can be caused by multiple reasons e.g. even if the agent is configured for TLS, but the CM Server is not:
    • Network problem, the CM Server is now on another node (check the IP address), certificate issues.
    • Check if the CM Server has enough heap dedicated. Too low heap will result JVM to turn into heavy GC activity, rendering it unresponsive causing timeouts.

 

Please let us know if you managed to overcome this issue.

 

Kind regards:

Ferenc

 

[1] https://docs.cloudera.com/cloudera-manager/7.1.0/monitoring-and-diagnostics/topics/cm-logs.html


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

New Contributor

I also encountered a similar problem

My firewall and selinux have been turned off

Try to modify the host name and several configuration files according to the original method, but it still doesn't work

Snipaste_2020-09-30_10-12-01.png

Community Manager

Translated text- Cluster installation
© Welcome
Cluster Basics
Install Agents
The installation has been successfully completed ,
A
Null value(s) passed to lookup by non-nullable natural-
id
Specify Hosts
© Select repository
3 of the 3 hosts have been successfully completed
Host name
IP address
Progress
Status
Select JDK
192. 168. 8.101
192. 168. 8.101
The installation was successfully completed .
Detailed information
© Provide SSH login credentials
192. 168. 8.102
192. 168. 8.102
The safety table has been successfully completed.
Detailed information
7) Install Agents
192. 168. 8.103
192. 168. 8.103
~ The installation has been successfully completed .
Detailed information port
8 Install Parcels
(9 Inspect Cluster


Kalyani Kundalia, Community Moderator

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

Moderator

Hello @5sdba ,

 

thank you for reporting the issue you hit. Can you please specify the CDP version you are using and if you are using CM HA (Cloudera Manager High Availability), please?

 

Thank you:
Ferenc


Ferenc Erdelyi, Technical Solutions Manager

Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

Learn more about the Cloudera Community:

New Contributor

Hello @Bender ,

 

I am trying to install cloudera CDP trial 7.1.4 on a single machine cluster and I'm getting the error "Null value(s) passed to lookup by non-nullable natural-id" on browser after install the agents.

 

Can this be because I only have 1 machine ?

I already tryed the other workarounds mentionated here on previous commentaries...

 

Regards,

Cristóvão

Cristóvão

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.