Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Cloudera 5.7 Manager failing to install Oozie ShareLib on service Oozie (AWS Redhat 7.2)

Cloudera 5.7 Manager failing to install Oozie ShareLib on service Oozie (AWS Redhat 7.2)

Explorer

We are trying to install the hadoop components using  cloudera 5.7 manager, but we can't seem to get past the oozie sharelib installation.

 

Upload Oozie ShareLib
Command aborted because of exception: Command timed-out after 270 seconds

 

 

oozie/oozie.sh ["install-sharelib","oozie-sharelib-yarn","hdfs://ip-10-0-30-250.ec2.internal:8020"]

 

Any tips on where to start the investigation of this issue. The stderr logs don't seem to have much in it.

 

 

3 REPLIES 3

Re: Cloudera 5.7 Manager failing to install Oozie ShareLib on service Oozie (AWS Redhat 7.2)

Explorer

Here is part of the cloudera-scm-server.log.

 

2016-05-11 09:08:08,627 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Reaped total of 0 deleted commands
2016-05-11 09:08:08,628 INFO StaleEntityEviction:com.cloudera.server.cmf.StaleEntityEvictionThread: Found no commands older than 2014-05-12T13:08:08.627Z to reap.
2016-05-11 09:08:08,629 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeScannerService: Reaped 0 requests.
2016-05-11 09:08:08,629 INFO StaleEntityEviction:com.cloudera.server.cmf.node.NodeConfiguratorService: Reaped 0 requests.
2016-05-11 09:12:31,723 INFO CommandPusher:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing service command InstallOozieShareLib SvcCmdArgs{targetRoles=[DbRole{id=49, name=oozie-OOZIE_SERVER-2b4e23420f78b4b85e02237294494e9f, hostName=ip-10-0-30-249.ec2.internal}], args=[]}. Service: DbService{id=13, name=oozie}
2016-05-11 09:12:31,731 INFO CommandPusher:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing service command CreateOozieUserDir SvcCmdArgs{targetRoles=[DbRole{id=49, name=oozie-OOZIE_SERVER-2b4e23420f78b4b85e02237294494e9f, hostName=ip-10-0-30-249.ec2.internal}], args=[]}. Service: DbService{id=13, name=oozie}
2016-05-11 09:12:31,834 WARN 2030217474@agentServer-231:com.cloudera.server.cmf.AgentProtocolImpl: Received Process Heartbeat for unknown (or duplicate) process. Ignoring. This is expected to happen once after old process eviction or process deletion (as happens in restarts). id=58 name=null host=6caec87d-6074-40b2-8ebc-f7cd7c713f8a/ip-10-0-30-250.ec2.internal
2016-05-11 09:12:46,892 INFO CommandPusher:com.cloudera.cmf.service.ServiceHandlerRegistry: Executing role command UploadOozieShareLib BasicCmdArgs{args=[]}. Service: DbService{id=13, name=oozie} Role: DbRole{id=49, name=oozie-OOZIE_SERVER-2b4e23420f78b4b85e02237294494e9f, hostName=ip-10-0-30-249.ec2.internal}
2016-05-11 09:12:47,036 WARN 2030217474@agentServer-231:com.cloudera.server.cmf.AgentProtocolImpl: Received Process Heartbeat for unknown (or duplicate) process. Ignoring. This is expected to happen once after old process eviction or process deletion (as happens in restarts). id=59 name=null host=3b8f987a-14ab-48f6-b28e-c2f1a06b0d17/ip-10-0-30-249.ec2.internal
2016-05-11 09:17:18,258 INFO CommandPusher:com.cloudera.cmf.service.AbstractOneOffRoleCommand: Aborting 'UploadOozieShareLib' command (118) on service DbService{id=13, name=oozie} role DbRole{id=49, name=oozie-OOZIE_SERVER-2b4e23420f78b4b85e02237294494e9f, hostName=ip-10-0-30-249.ec2.internal}.
2016-05-11 09:17:18,258 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 118(UploadOozieShareLib) has completed. finalstate:CANCELLED, success:false, msg:Aborted command
2016-05-11 09:17:18,264 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 116(InstallOozieShareLib) has completed. finalstate:FINISHED, success:false, msg:Failed to install Oozie ShareLib.
2016-05-11 09:17:18,265 INFO CommandPusher:com.cloudera.cmf.model.DbCommand: Command 37(First Run) has completed. finalstate:FINISHED, success:false, msg:Completed only 1/2 steps. First failure: Failed to execute command Install Oozie ShareLib on service Oozie

Re: Cloudera 5.7 Manager failing to install Oozie ShareLib on service Oozie (AWS Redhat 7.2)

Explorer

open another browser tab, go to console, oozie, configuration, search for oozie_upload_sharelib_cmd_timeout parameter and change it to something bigger then 270. I entered 600, then hit retry in installation tab and it passed.

Re: Cloudera 5.7 Manager failing to install Oozie ShareLib on service Oozie (AWS Redhat 7.2)

Explorer

Actually my issue was with the security groups in the private subnet in AWS that didn't allow for communication.