Re: Failure: Upgrade agents in CM v6.3.3

Tak567 · ‎10-09-2020

Hello @Bender , So sorry my case was fixed. I checked the living process and I killed oozie(before upgrade remaining process) then upgrade successfully worked. [root@bsuhdpsv00 oozie]# ps aux | grep oozie oozie 3255 0.7 5.2 7885064 848088 ? Sl 15:46 1:13 /usr/java/jdk1.8.0_212/bin/java -Doozie.home.dir=/usr/lib/oozie -Doozie.config.dir=/etc/oozie/conf -Doozie.log.dir=/var/log/oozie -Doozi .data.dir=/var/lib/oozie -Doozie.instance.id=bsuhdpsv00 -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Djava.library.path=:/usr/lib/hadoop/lib/native:/usr/lib/hadoop/lib/native -cp /usr/lib/oozie/embedded-oozie-server/*:/usr/lib/oozie/embedded-oozie-server/dependency/*:/usr/lib/oozie/lib/*:/usr/lib/oozie/libtools/*:/usr/lib/oozie/embedded-oozie-server org.apache.oozie.server.EmbeddedOozieServer root 22580 0.0 0.0 112832 968 pts/0 S+ 18:40 0:00 grep --color=auto oozie [root@bsuhdpsv00 oozie]# kill 3255 [root@bsuhdpsv00 oozie]# ps aux | grep oozie root 22644 0.0 0.0 112828 968 pts/0 S+ 18:40 0:00 grep --color=auto oozie Best regards, Tak567

Tak567 · ‎10-09-2020

Hello @Bender , I got the same latter issue in my on-premise environment. Here's the oozie-cmf-oozie-OOZIE_SERVER-bsuhdpsv00.log.out: 2020-10-09 17:59:28,353 WARN org.eclipse.jetty.webapp.StandardDescriptorProcessor: SERVER[bsuhdpsv00] Duplicate mapping from / to default 2020-10-09 17:59:28,354 WARN org.eclipse.jetty.webapp.StandardDescriptorProcessor: SERVER[bsuhdpsv00] Duplicate mapping from *.jsp to jsp 2020-10-09 17:59:28,580 INFO org.eclipse.jetty.server.handler.ContextHandler: SERVER[bsuhdpsv00] Started o.e.j.w.WebAppContext@7645f03e{/oozie,file:///opt/cloudera/parcels/CDH-6.3.3-1.cdh6.3.3.p0.1796617/lib/oozie/embedded-oozie-server/webapp/,AVAILABLE} 2020-10-09 17:59:28,582 ERROR org.apache.oozie.server.EmbeddedOozieServer: SERVER[bsuhdpsv00] Could not start EmbeddedOozieServer! Error message: アドレスは既に使用中です 2020-10-09 17:59:28,587 INFO org.apache.oozie.server.EmbeddedOozieServer: SERVER[bsuhdpsv00] Shutting down. 2020-10-09 17:59:28,618 INFO org.apache.oozie.service.Services: SERVER[bsuhdpsv00] Shutdown The "アドレスは既に使用中です" in Japanese probably means that Cannot assign requested address. My opinion it looks like "The address has already been in use" literally. But as view of the context, it must be translated from "Cannot assign requested address". I confirmed I've set the /etc/hosts the correct configuration. I tested hard restart you mentioned but I cannot start oozie service. I'm upgrading CDH to v6.3.3 from v5.16.1. While I upgrade with rolling restart, this is last 3rd task of 24 and I think most part of the upgrade seems to succeed. (The remaining 2 tasks are Execute command Start on service Hue and Execute command Validate Hive Metastore schema on service Hive) Best regards, Tak567

Tak567 · ‎10-07-2020

@GangWar Thank you for your reply. I confirmed I can manually upgrade the agent in each host , which is also written in installation manual as option 2. Upgrade the Agents using the Command Line. Just a little bit I have a curiosity of the reason not working with CM distributed method, but anyway I'm going forward steps. Best regards, Tak568

Tak567 · ‎10-05-2020

I'm testing the CDH upgrade from v5.16.1 to v6.3.3. Cloudera manager server v6.3.3 upgrade was done successfully. But I have a trouble in Upgrading the Cloudera Manager Agents section. https://docs.cloudera.com/cdp-private-cloud/latest/upgrade-cdh/topics/ug_cm_upgrade_agent.html I can see The Upgrade Cloudera Manager Agent Packages page. But the Install agents fails due to Failed to copy installation files. I tried both repository location of Cloudera repository and custom repository but the both was failed. I think inter hosts ssh communications are no problem because I tested ssh login b/w them and I confirmed the /tmp/scm_prepare_node.XXXXXXXX was made on target agent host. I suspects key handling is the cause but I'm not sure how to confirm it. Here's the cloudera-scm-server.log. (modified URL because it's raw username and password) 2020-10-06 14:54:10,500 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfigurator: Executing mktemp -d /tmp/scm_prepare_node.XXXXXXXX on bsuhdpsv01 2020-10-06 14:54:10,528 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: bsuhdpsv01: Transitioning from MAKE_TEMP_DIR (PT0.045S) to COPY_FILES 2020-10-06 14:54:10,736 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfigurator: Using key bundle from URL: https://****usernameXXX:****password@archive.cloudera.com/p/cm6/6.3.3/allkeys.asc 2020-10-06 14:54:10,745 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: bsuhdpsv01: Setting COPY_FILES as failed and done state 2020-10-06 14:54:10,745 INFO NodeConfiguratorThread-12-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION 2020-10-06 14:54:15,244 INFO scm-web-2446:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json 2020-10-06 14:54:15,246 INFO scm-web-2446:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json, Status:200 2020-10-06 14:54:15,427 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 1634 Failed to complete installation on host bsuhdpsv01. 2020-10-06 14:54:15,427 ERROR CommandPusher:com.cloudera.cmf.model.DbCommand: Command 1634(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation. Best regards, Tak567

Tak567 · ‎09-24-2020

Hi GangWar, Thank you for your detailed reply. I'll check them. Best regards,

Tak567 · ‎09-22-2020

Hi Community, I'm looking for the training materials for CDH. I think there's no public materials about CDH. They seems to be for CDP, new products.(https://www.cloudera.com/about/training.html ) I also tried to check the partner portal but it's 404 link. https://www.cloudera.com/partner-portal/training.html I have to upgrade CDH v5.16 to v6.3.3 and I'd like to learn the whole functions about CDH. (the ones written in Japanese are better if possible but I'm OK with them in English) Best regards, Takuya Kohama

Online	Offline
Last Visited	‎10-26-2020 08:46 PM

Date Registered	‎09-16-2020 09:41 PM
Last Visited	‎10-26-2020 08:46 PM
Total Messages Posted	6

Re: Failure: Upgrade agents in CM v6.3.3

Re: Oozie doesnt install in the cloudera manager c...

Re: Oozie doesnt install in the cloudera manager c...

Re: Failure: Upgrade agents in CM v6.3.3

Failure: Upgrade agents in CM v6.3.3

Re: Training materials for CDH

Training materials for CDH