As the other users have mentioned, all the other containers work fine. Just cloudera. @GangWar, assuming you have contacts in cloudera, do you know if this is supported? ... View more

@GangWar In which Oozie's service configuration item in Cloudera Manager this should be defined? ... View more

@joeyfrye1 Both looks fine for me. Can you check again. What issue you are facing?  ... View more

@selvaprabhu_k  The same issue has been answered in below thread, please have a look.  https://community.cloudera.com/t5/Support-Questions/ImportError-No-module-named-numpy/m-p/90427#M21658 https://community.cloudera.com/t5/Support-Questions/Jupyter-notebook-gt-ImportError-No-module-named-numpy/m-p/300687/highlight/false#M220357  ... View more

@Marek I tried my best to dug this issue for you. First of all I want to clear that this is not CDSW issue. This is the HDFS client configuration issue. I found some discrepancy: In the hdfs-site.xml file notice the dfs.ha.namenodes.[nameservice ID] section where you have declared the NN IDs as "namenode43,namenode57" which is causing the issue as indicated in the message.   <property> <name>dfs.ha.namenodes.namenodeHA</name> <value>namenode43,namenode57</value> </property> "Namenode for namenodeHA remains unresolved for ID namenode57. Check your hdfs-site.xml file to ensure namenodes are configured properly."   So you should declare the IP or FQDN here because the session is not resolving this short name as there is no entry in the "/etc/hosts" file. Your "/etc/hosts" file is consist only below format: ---- RUN cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 IP address blc-control-02.novalocal IP address blc-control-01.novalocal 👆 This format is not recommended the Network names should be configured as below: 1.1.1.1 foo-1.example.com foo-1 2.2.2.2 foo-2.example.com foo-2 3.3.3.3 foo-3.example.com foo-3 4.4.4.4 foo-4.example.com foo-4 In the Ideal condition you should met below condition: Your CDSW session should resolve the localhost as: ! nslookup localhost Server: IP address Address: IP address#53 Name: localhost Address: 127.0.0.1 Name: localhost Address: ::1   Your "/etc/hosts" file should be correct as per the Recommended Network names Configuration  Your hdfs-site.xml should use FQDN or IP.  NOTE: Having the short name entries of "namenode43,namenode57" in "/etc/hosts" file might work with your existing hdfs-site.xml but I would recommend to do that with FQDN way to avoid other issue.   Please modify and let me know how this goes, I am waiting for this issue to be resolved 🙂 🤞   ... View more

Currently, the way i'm going to take is mimic deploy client configuration  operation on single host:   Auto recreating links using script: /etc/stack/service-env/conf -> /etc/alternatives/service-env-conf  -> /etc/stack/service-env/conf.cloudera.service-env and updating or creating client config file /etc/stack/service-env/conf/conf.properties. ... View more

Hi @GangWar i'm doing it in manual way, because my cloudera software is the free version, so auto enable of TLS is not an option. I'm using Self sign sSL but after enabling it on the cloudera manager and I will start to enable cloudera management services, its not running and getting some errors. ... View more

@Mondi  You have to review the architecture first to understand how the Data at rest encryptions works.  Here are all the necessary docs which will give you a decent  start.    Data at Rest Encryption Reference Architecture Data at Rest Encryption Requirements Cloudera Navigator Key Trustee Server Configuring the Key Management Server (KMS)   Cheers! ... View more

@MarcinBNP The error seems for different issues. The below error means there is an issue with DB like might be tuning is required.  An error occurred in the current transaction. You can't execute queries until the end of the 'atomic' block. I am wondering if you can login with a local account, if yes then you can enable Hue debug logging[1] and see what exactly is the issue.     [1] https://docs.cloudera.com/documentation/enterprise/5-14-x/topics/hue_adm_logs.html#concept_jtf_jtg_jw ... View more

@IZ_AMD This seems the issue with DB it could be either the permission issue on DB or schema issue.  You have to check if  scm_prepare script ran successfully as well. I would suggest to configure the DB again if this is new install.  https://docs.cloudera.com/documentation/enterprise/latest/topics/cm_ig_installing_configuring_dbs.html ... View more

@raghu9raghavend For the new features and changes the best doc is the release document. There you can find pretty much all the info within sub pages.[1] For your 2nd question, Yes  CDH 6.2.X supports erasure coding[2].   [1] New features: https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_600_new_features.html In compatible Changes: https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_600_incompatible_changes.html [2] https://blog.cloudera.com/introduction-to-hdfs-erasure-coding-in-apache-hadoop/ ... View more

@prabhat The error seems misleading as per my experience but I would like to check the ownership and permission on the directory   /var/run/cloudera-scm-agent/process/ this should be like below:    ll /var/run/cloudera-scm-agent/process/ | grep -i hdfs drwxr-x--x. 3 hdfs hdfs 420 Jun 26 15:18 1805-hdfs-DATANODE drwxr-x--x. 4 httpfs httpfs 360 Jun 26 15:18 1806-hdfs-HTTPFS drwxr-x--x. 3 hdfs hdfs 420 Jun 26 15:30 1857-hdfs-DATANODE drwxr-x--x. 4 httpfs httpfs 360 Jun 26 15:30 1858-hdfs-HTTPFS drwxr-x--x. 3 hdfs hdfs 420 Jun 26 16:40 1902-hdfs-DATANODE drwxr-x--x. 4 httpfs httpfs 360 Jun 26 16:40 1903-hdfs-HTTPFS If the you there is permission issue then fix them else you can try to hard start agent once and see how this goes. ... View more

MLOps will eventually be available as part of Cloudera Data Science Workbench (CDSW) product. Keep an eye out for new releases coming soon.  ... View more

@RahulT007 That's not an issue as you might have installed CM/CDH with some method other than cloudera-manager-installer.bin file. You can skip that part and go ahead and follow below steps as suggested.  sudo service cloudera-scm-server stop sudo service cloudera-scm-server-db stop sudo yum remove cloudera-manager-server sudo yum remove cloudera-manager-server-db-2  Then you can follow other steps mentioned to remove CDH managed software and lingering service packages.  https://docs.cloudera.com/cloudera-manager/7.1.1/installation/topics/cdpdc-uninstallation.html ... View more

@nikolayburiak This may be due to encoding issue on HMS database. Can you try to change the format something like  alter table COLUMNS_V2 modify column COMMENT varchar(256) character set utf8;   ... View more

Hi @GangWar   This is what I was aiming at.   My current Dockerfile roughly looks as follows:   #Dockerfile FROM docker.repository.cloudera.com/cdsw/engine:10 WORKDIR /tmp ENV R_HOME=/usr/local/lib/R RUN wget http://cran.rstudio.com/src/base/R-3/R-3.6.3.tar.gz && \ tar xvf R-3.6.3.tar.gz && \ cd R-3.6.3 && \ ./configure --prefix=/usr/local --enable-R-shlib && \ make && \ make install && \ rm -rf /usr/local/bin/R && \ rm -rf /usr/local/bin/Rscript && \ ln -s /usr/local/lib/R/bin/R /usr/local/bin/R && \ ln -s /usr/local/lib/R/bin/Rscript /usr/local/bin/Rscript && \ echo -e "# make libR.so visible to ld.so\n/usr/local/lib/R/lib" > /etc/ld.so.conf.d/libR.conf && \ ldconfig && \ cd .. && \ rm -rf R-3.6.3.tar.gz && \ rm -rf R-3.6.3 # the java installation is mounted at CDSW session run time - copy it to the build context here COPY ./java /usr/lib/jvm/java-openjdk RUN export JAVA_HOME=/usr/lib/jvm/java-openjdk && \ R CMD javareconf RUN Rscript -e "update.packages(checkBuilt=TRUE, ask=FALSE, repos='https://cloud.r-project.org')" # remove java installation again since it is mounted at runtime RUN rm -rf /usr/lib/jvm   I am successfully able to launch CDSW sessions with this container with the following editors: Workbench - Python Workbench - Scala RStudio Jupyter Notebook (even with IRkernel) The issue remains though, that launching a session with the Workbench - R editor is not possible. The session is immediately exited and the following error visible in the log: ... PID of main R process is 205 PID of parser R process is 207 R has exited with code 2 and signal null Exiting with code 2 ...   Using the base image which works with the Workbench - R editor, I checked which processes CDSW tries to launch in this case. These are the following two: cdsw 197 51 0 08:29 ? 00:00:00 /usr/local/lib/R/bin/exec/R --sense --no-readline --args cdsw 198 51 0 08:29 ? 00:00:00 /usr/local/lib/R/bin/Rserve --RS-socket /tmp/cdsw-rserve-x0jbdet9dfe1428o.sock --RS-source /usr/local/lib/node_modules/r-engine/lib/parse.utils.r --slave   Using my own image and a Workbench - Python session, I was able to successfully execute these two processes.   Process 1: bash$ /usr/local/lib/R/bin/exec/R --sense --no-readline --args WARNING: unknown option '--sense' R version 3.6.3 (2020-02-29) -- "Holding the Windsock" Copyright (C) 2020 The R Foundation for Statistical Computing Platform: x86_64-pc-linux-gnu (64-bit) R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details. Natural language support but running in an English locale R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications. Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R. >   Process 2: bash$ /usr/local/lib/R/bin/Rserve --RS-socket /tmp/cdsw-rserve-x0jbdet9dfe1428o.sock --RS-source /usr/local/lib/node_modules/r-engine/lib/parse.utils.r --slave Rserve started in non-daemon mode.   To conclude: There seems to be something behind the scenes which CDSW does when launching the Workbench - R editor, which causes it to crash, but I cannot get to the bottom of what the issue is.   Any ideas? ... View more

i , did you find a solution for that , i have the same request by audit team. ... View more

Earlier I was commenting 1) This is an AWS instance, nothing else runs. Cloudera Manager is also on the same host - not sure why credentials is a potential problem in this respect. 2) I had no problem getting 6.x (Cloudera automatically applied to this cluster though downloaded 7.11 binary for installation) distributed.   cat -n /var/log/cloudera-scm-server/cloudera-scm-server.log 1 2020-07-01 23:20:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 2 2020-07-01 23:20:15,968 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (7 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 3 2020-07-01 23:20:36,310 INFO ParcelUpdateService:com.cloudera.parcel.components.LocalParcelManagerImpl: Found files CDH-7.1.1-1.cdh7.1.1.p0.3266817-el7.parcel under /opt/cloudera/parcel-repo 4 2020-07-01 23:20:36,313 INFO ParcelUpdateService:com.cloudera.cmf.paywall.PaywallHelper: (6 skipped) License incomplete; unable to use it for authentication UUID=72ef3466-2863-41bb-b89c-11126931ef69, name=Trial License 5 2020-07-01 23:20:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 6 2020-07-01 23:20:37,086 INFO agentServer-95:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=9ms, min=7ms, max=45ms. 7 2020-07-01 23:20:37,086 INFO agentServer-95:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=3ms. 8 2020-07-01 23:20:46,369 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands 9 2020-07-01 23:20:46,370 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2018-07-02T23:20:46.369Z to reap. 10 2020-07-01 23:20:46,370 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests. 11 2020-07-01 23:20:46,370 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests. 12 2020-07-01 23:21:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 13 2020-07-01 23:21:19,476 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (6 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 14 2020-07-01 23:21:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 15 2020-07-01 23:21:50,727 INFO ScmActive-0:com.cloudera.server.cmf.components.ScmActive: (119 skipped) ScmActive completed successfully. 16 2020-07-01 23:22:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 17 2020-07-01 23:22:23,218 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (4 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 18 2020-07-01 23:22:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 19 2020-07-01 23:23:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 20 2020-07-01 23:23:25,253 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (8 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 21 2020-07-01 23:23:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 22 2020-07-01 23:23:50,532 WARN EventStorePublisherWithRetry-0:com.cloudera.cmf.event.publish.EventStorePublisherWithRetry: Failed to publish event: SimpleEvent{attributes={CATEGORY=[AUDIT_EVENT], EVENTCODE=[EV_LOGIN_SUCCESS], SERVICE=[ClouderaManager], USER=[admin], SERVICE_TYPE=[ManagerServer], MESSAGE_CODES=[LOGIN_SUCCESS], SEVERITY=[INFORMATIONAL]}, content=User admin logged in successfully., timestamp=1593190812507} - 1 of 28 failure(s) in last 1827s 23 java.io.IOException: Error connecting to c711.afs.com/18.214.236.92:7184 24 at org.apache.avro.ipc.NettyTransceiver.getChannel(NettyTransceiver.java:292) 25 at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:206) 26 at org.apache.avro.ipc.NettyTransceiver.<init>(NettyTransceiver.java:141) 27 at com.cloudera.cmf.event.publish.AvroEventStorePublishProxy.checkSpecificRequestor(AvroEventStorePublishProxy.java:135) 28 at com.cloudera.cmf.event.publish.AvroEventStorePublishProxy.publishEvent(AvroEventStorePublishProxy.java:210) 29 at com.cloudera.cmf.event.publish.EventStorePublisherWithRetry$PublishEventTask.run(EventStorePublisherWithRetry.java:242) 30 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 31 at java.util.concurrent.FutureTask.run(FutureTask.java:266) 32 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 33 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 34 at java.lang.Thread.run(Thread.java:748) 35 2020-07-01 23:24:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 36 2020-07-01 23:24:25,344 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (4 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 37 2020-07-01 23:24:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 38 2020-07-01 23:25:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 39 2020-07-01 23:25:25,674 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (5 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 40 2020-07-01 23:25:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 41 2020-07-01 23:26:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 42 2020-07-01 23:26:26,612 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (9 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 43 2020-07-01 23:26:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 44 2020-07-01 23:27:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 45 2020-07-01 23:27:32,659 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (4 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 46 2020-07-01 23:27:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 47 2020-07-01 23:28:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 48 2020-07-01 23:28:32,944 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (7 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 49 2020-07-01 23:28:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 50 2020-07-01 23:29:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 51 2020-07-01 23:29:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 52 2020-07-01 23:29:43,861 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (7 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 53 2020-07-01 23:30:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 54 2020-07-01 23:30:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 55 2020-07-01 23:30:46,227 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (4 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 56 2020-07-01 23:30:46,227 INFO agentServer-95:com.cloudera.server.common.MonitoringThreadPool: agentServer: execution stats: average=9ms, min=7ms, max=45ms. 57 2020-07-01 23:30:46,227 INFO agentServer-95:com.cloudera.server.common.MonitoringThreadPool: agentServer: waiting in queue stats: average=0ms, min=0ms, max=3ms. 58 2020-07-01 23:30:46,373 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands 59 2020-07-01 23:30:46,374 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2018-07-02T23:30:46.373Z to reap. 60 2020-07-01 23:30:46,374 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests. 61 2020-07-01 23:30:46,374 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests. 62 2020-07-01 23:31:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 63 2020-07-01 23:31:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 64 2020-07-01 23:31:48,895 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (8 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 65 2020-07-01 23:32:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 66 2020-07-01 23:32:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 67 2020-07-01 23:32:48,994 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (4 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 68 2020-07-01 23:33:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 69 2020-07-01 23:33:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 70 2020-07-01 23:33:55,581 INFO avro-servlet-hb-processor-0:com.cloudera.server.common.AgentAvroServlet: (5 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 71 2020-07-01 23:34:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 72 2020-07-01 23:34:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 73 2020-07-01 23:35:06,057 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (8 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 74 2020-07-01 23:35:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 75 2020-07-01 23:35:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 76 2020-07-01 23:36:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 77 2020-07-01 23:36:12,160 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (5 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 78 2020-07-01 23:36:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 79 2020-07-01 23:37:06,416 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Cleanup is started. 80 2020-07-01 23:37:21,721 INFO avro-servlet-hb-processor-1:com.cloudera.server.common.AgentAvroServlet: (9 skipped) AgentAvroServlet: heartbeat processing stats: average=9ms, min=7ms, max=44ms. 81 2020-07-01 23:37:36,415 INFO pool-201-thread-1:com.cloudera.server.cmf.components.CmServerStateSynchronizer: Syncup is started. 82 2020-07-01 23:37:36,730 INFO CMMetricsForwarder-0:com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder: (19 skipped) Failed to send metrics. 83 java.lang.reflect.UndeclaredThrowableException 84 at com.sun.proxy.$Proxy240.writeMetrics(Unknown Source) 85 at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.sendWithAvro(ClouderaManagerMetricsForwarder.java:434) 86 at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.sendMetrics(ClouderaManagerMetricsForwarder.java:400) 87 at com.cloudera.server.cmf.components.ClouderaManagerMetricsForwarder.run(ClouderaManagerMetricsForwarder.java:181) 88 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 89 at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) 90 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) 91 at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) 92 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 93 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 94 at java.lang.Thread.run(Thread.java:748) 95 Caused by: org.apache.avro.AvroRemoteException: java.net.SocketTimeoutException: connect timed out 96 at org.apache.avro.ipc.specific.SpecificRequestor.invoke(SpecificRequestor.java:104) 97 ... 11 more 98 Caused by: java.net.SocketTimeoutException: connect timed out 99 at java.net.PlainSocketImpl.socketConnect(Native Method) 100 at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) 101 at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) 102 at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) 103 at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) 104 at java.net.Socket.connect(Socket.java:607) 105 at sun.net.NetworkClient.doConnect(NetworkClient.java:175) 106 at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) 107 at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) 108 at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) 109 at sun.net.www.http.HttpClient.New(HttpClient.java:339) 110 at sun.net.www.http.HttpClient.New(HttpClient.java:357) 111 at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1226) 112 at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162) 113 at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056) 114 at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990) 115 at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1340) 116 at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1315) 117 at org.apache.avro.ipc.HttpTransceiver.writeBuffers(HttpTransceiver.java:77) 118 at org.apache.avro.ipc.Transceiver.transceive(Transceiver.java:58) 119 at org.apache.avro.ipc.Transceiver.transceive(Transceiver.java:72) 120 at org.apache.avro.ipc.Requestor.request(Requestor.java:147) 121 at org.apache.avro.ipc.Requestor.request(Requestor.java:101) 122 at org.apache.avro.ipc.specific.SpecificRequestor.invoke(SpecificRequestor.java:88) 123 ... 11 more ... View more

Actually, I haven’t tried anything as of now. We are in talks for a project and couldn’t find anything over web regarding this requirement. ... View more

@AlfonsoUS  The agent packages seems to be available on the host already.  Can you please run the below command on this faulty host and check if it's true.  #rpm -qa | grep -i cloudera #ls -lrth /usr/java Also check form CM > Hosts > All Hosts > Configuration > Java dir for agent.  ... View more

@RamAtirajyam There could be an issue with LD_LIBRARY_PATH. Please check once and see if that resolves the issue.  Correct: echo $LD_LIBRARY_PATH /lib:/usr/lib Incorrect: echo $LD_LIBRARY_PATH /opt/teradata/client/14.10/tbuild/lib:/opt/oracle/product/11.2.0.4_client/lib:/lib:/usr/lib:/usr/lib   ... View more