Member since
09-16-2020
6
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1209 | 10-07-2020 12:11 AM |
10-09-2020
02:44 AM
Hello @Bender , So sorry my case was fixed. I checked the living process and I killed oozie(before upgrade remaining process) then upgrade successfully worked. [root@bsuhdpsv00 oozie]# ps aux | grep oozie oozie 3255 0.7 5.2 7885064 848088 ? Sl 15:46 1:13 /usr/java/jdk1.8.0_212/bin/java -Doozie.home.dir=/usr/lib/oozie -Doozie.config.dir=/etc/oozie/conf -Doozie.log.dir=/var/log/oozie -Doozi .data.dir=/var/lib/oozie -Doozie.instance.id=bsuhdpsv00 -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Djava.library.path=:/usr/lib/hadoop/lib/native:/usr/lib/hadoop/lib/native -cp /usr/lib/oozie/embedded-oozie-server/*:/usr/lib/oozie/embedded-oozie-server/dependency/*:/usr/lib/oozie/lib/*:/usr/lib/oozie/libtools/*:/usr/lib/oozie/embedded-oozie-server org.apache.oozie.server.EmbeddedOozieServer root 22580 0.0 0.0 112832 968 pts/0 S+ 18:40 0:00 grep --color=auto oozie [root@bsuhdpsv00 oozie]# kill 3255 [root@bsuhdpsv00 oozie]# ps aux | grep oozie root 22644 0.0 0.0 112828 968 pts/0 S+ 18:40 0:00 grep --color=auto oozie Best regards, Tak567
... View more
10-09-2020
02:15 AM
Hello @Bender , I got the same latter issue in my on-premise environment. Here's the oozie-cmf-oozie-OOZIE_SERVER-bsuhdpsv00.log.out: 2020-10-09 17:59:28,353 WARN org.eclipse.jetty.webapp.StandardDescriptorProcessor: SERVER[bsuhdpsv00] Duplicate mapping from / to default 2020-10-09 17:59:28,354 WARN org.eclipse.jetty.webapp.StandardDescriptorProcessor: SERVER[bsuhdpsv00] Duplicate mapping from *.jsp to jsp 2020-10-09 17:59:28,580 INFO org.eclipse.jetty.server.handler.ContextHandler: SERVER[bsuhdpsv00] Started o.e.j.w.WebAppContext@7645f03e{/oozie,file:///opt/cloudera/parcels/CDH-6.3.3-1.cdh6.3.3.p0.1796617/lib/oozie/embedded-oozie-server/webapp/,AVAILABLE} 2020-10-09 17:59:28,582 ERROR org.apache.oozie.server.EmbeddedOozieServer: SERVER[bsuhdpsv00] Could not start EmbeddedOozieServer! Error message: アドレスは既に使用中です 2020-10-09 17:59:28,587 INFO org.apache.oozie.server.EmbeddedOozieServer: SERVER[bsuhdpsv00] Shutting down. 2020-10-09 17:59:28,618 INFO org.apache.oozie.service.Services: SERVER[bsuhdpsv00] Shutdown The "アドレスは既に使用中です" in Japanese probably means that Cannot assign requested address. My opinion it looks like "The address has already been in use" literally. But as view of the context, it must be translated from "Cannot assign requested address". I confirmed I've set the /etc/hosts the correct configuration. I tested hard restart you mentioned but I cannot start oozie service. I'm upgrading CDH to v6.3.3 from v5.16.1. While I upgrade with rolling restart, this is last 3rd task of 24 and I think most part of the upgrade seems to succeed. (The remaining 2 tasks are Execute command Start on service Hue and Execute command Validate Hive Metastore schema on service Hive) Best regards, Tak567
... View more
10-07-2020
12:11 AM
@GangWar Thank you for your reply. I confirmed I can manually upgrade the agent in each host , which is also written in installation manual as option 2. Upgrade the Agents using the Command Line. Just a little bit I have a curiosity of the reason not working with CM distributed method, but anyway I'm going forward steps. Best regards, Tak568
... View more
10-05-2020
11:26 PM
I'm testing the CDH upgrade from v5.16.1 to v6.3.3.
Cloudera manager server v6.3.3 upgrade was done successfully.
But I have a trouble in Upgrading the Cloudera Manager Agents section.
https://docs.cloudera.com/cdp-private-cloud/latest/upgrade-cdh/topics/ug_cm_upgrade_agent.html
I can see The Upgrade Cloudera Manager Agent Packages page.
But the Install agents fails due to Failed to copy installation files.
I tried both repository location of Cloudera repository and custom repository but the both was failed.
I think inter hosts ssh communications are no problem because I tested ssh login b/w them and I confirmed the /tmp/scm_prepare_node.XXXXXXXX was made on target agent host.
I suspects key handling is the cause but I'm not sure how to confirm it.
Here's the cloudera-scm-server.log. (modified URL because it's raw username and password)
2020-10-06 14:54:10,500 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfigurator: Executing mktemp -d /tmp/scm_prepare_node.XXXXXXXX on bsuhdpsv01
2020-10-06 14:54:10,528 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: bsuhdpsv01: Transitioning from MAKE_TEMP_DIR (PT0.045S) to COPY_FILES
2020-10-06 14:54:10,736 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfigurator: Using key bundle from URL: https://****usernameXXX:****password@archive.cloudera.com/p/cm6/6.3.3/allkeys.asc
2020-10-06 14:54:10,745 INFO NodeConfiguratorThread-12-0:com.cloudera.server.cmf.node.NodeConfiguratorProgress: bsuhdpsv01: Setting COPY_FILES as failed and done state
2020-10-06 14:54:10,745 INFO NodeConfiguratorThread-12-0:net.schmizz.sshj.transport.TransportImpl: Disconnected - BY_APPLICATION
2020-10-06 14:54:15,244 INFO scm-web-2446:com.cloudera.enterprise.JavaMelodyFacade: Entering HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json
2020-10-06 14:54:15,246 INFO scm-web-2446:com.cloudera.enterprise.JavaMelodyFacade: Exiting HTTP Operation: Method:POST, Path:/add-hosts-wizard/installprogressdata.json, Status:200
2020-10-06 14:54:15,427 ERROR CommandPusher:com.cloudera.cmf.command.flow.WorkOutputs: CMD id: 1634 Failed to complete installation on host bsuhdpsv01.
2020-10-06 14:54:15,427 ERROR CommandPusher:com.cloudera.cmf.model.DbCommand: Command 1634(GlobalHostInstall) has completed. finalstate:FINISHED, success:false, msg:Failed to complete installation.
Best regards,
Tak567
... View more
Labels:
09-24-2020
03:50 AM
Hi GangWar, Thank you for your detailed reply. I'll check them. Best regards,
... View more
09-22-2020
08:44 PM
Hi Community, I'm looking for the training materials for CDH. I think there's no public materials about CDH. They seems to be for CDP, new products.(https://www.cloudera.com/about/training.html ) I also tried to check the partner portal but it's 404 link. https://www.cloudera.com/partner-portal/training.html I have to upgrade CDH v5.16 to v6.3.3 and I'd like to learn the whole functions about CDH. (the ones written in Japanese are better if possible but I'm OK with them in English) Best regards, Takuya Kohama
... View more
Labels: