Hi Community,   I am trying to run a YARN script to test tune my cluster using teraGen and TeraSort. I have modified the script and got the teraGen part Running with no problems. However I keep getting an error when the teraSort begins:   Below is the error:   18/04/04 21:29:47 INFO terasort.TeraSort: starting java.net.URISyntaxException: Illegal character in path at index 0: /_partition.lst#_partition.lst at java.net.URI$Parser.fail(URI.java:2829) at java.net.URI$Parser.checkChars(URI.java:3002) at java.net.URI$Parser.parseHierarchical(URI.java:3086) at java.net.URI$Parser.parse(URI.java:3044) at java.net.URI.<init>(URI.java:595) at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:300) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:325) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71) at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) And below is the Script   #!/bin/sh # Confirm the path values given below correspond to your installation MR=/opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce HADOOP=/opt/cloudera/parcels/CDH/bin # Mark start of the loop echo Testing loop started on `date` # Mapper containers for i in 8 do # Reducer containers for j in 1 do # Container memory for k in 512 1024 do # Set mapper JVM heap MAP_MB=`echo "($k*0.8)/1" | bc` # Set reducer JVM heap RED_MB=`echo "($k*0.8)/1" | bc` time ${HADOOP}/hadoop jar ${MR}/hadoop-examples.jar teragen \ -Dmapreduce.job.maps=$i \ -Dmapreduce.map.memory.mb=$k \ -Dmapreduce.map.java.opts.max.heap=$MAP_MB \ 100000000 /user/devops/results/tg-10GB-${i}-${j}-${k} 1>teragen_${i}_${j}_${k}.out 2>teragen_${i}_${j}_${k}.err time ${HADOOP}/hadoop jar ${MR}/hadoop-examples.jar terasort \ -Dmapreduce.job.maps=$i \ -Dmapreduce.job.reduces=$j \ -Dmapreduce.map.memory.mb=$k \ -Dmapreduce.map.java.opts.max.heap=$MAP_MB \ -Dmapreduce.reduce.memory.mb=$k \ -Dmapreduce.reduce.java.opts.max.heap=$RED_MB \ /user/devops/results/tg-10GB-${i}-${j}-${k} \ /user/devops/results/ts-10GB-${i}-${j}-${k} 1>>tera_${i}_${j}_${k}.out 2>>tera_${i}_${j}_${k}.err $HADOOP/hadoop fs -rm -r -skipTrash /user/devops/results/tg-10GB-${i}-${j}-${k} $HADOOP/hadoop fs -rm -r -skipTrash /user/devops/results/ts-10GB-${i}-${j}-${k} done done done echo Testing loop ended on `date` Been at this for a couple of days so any help is more than welcome!   thanks ... View more

Hi Community,   I currently have the  cluster up and running however I have tried everything to fix the below error.   When clicking inside the CM on hosts->roles error : cluster not found.     Everything else is working fine.   any ideas?   thanks,           ... View more

   Hello!   I am new to Cloudera and I am trying to install Cloudera Director, Manager and CDH5 on AWS. I have the director running, I can log in using the SOCK5 proxy but with some errors:   1. I SSH into the instance. 2. I then run    ssh -i   mykey.pem   -CND 8157 ec2-user@PUBLIC-INSTANCE-IP & 3. I then use SwitchyOmega on Chrome (replacing 172.31 for my VPC subnet prefix, this is a private prefix). I use my browser to access the following IP: http://PRIVATE-INSTANCE-IP:7189/   I can connect to the Cloudera Director and Set up my environment however,   I keep seing the below messages in my Bash CLI:   $ channel 2: open failed: connect failed: Connection refused channel 3: open failed: connect failed: Connection refused channel 4: open failed: connect failed: Connection refused channel 5: open failed: connect failed: Connection refused channel 6: open failed: connect failed: Connection refused channel 7: open failed: connect failed: Connection refused Have I misconfigured anything?   Cloudera Manager:   As soon as I try and Add the Clouder Manager I get the Bootstrap Fail:   I am using AMI: 64-bit RHEL-7.3_HVM-20170424-x86_64-1-Hourly2-GP2  - ami-5f39a149   For both the Director and Manager. For the director I configured an AWS Role with the policy provided by Cloudera.   After Configuring the Manager and trying to run the  instance it says the bootstrap failed. When I Collect Diagnostics Data: Status: 412, Reason: Deployment is not available for /RicohTestCluster/Manager   Below are the Logs: Cloudera log https://we.tl/x4J3H5bJEm   Suppressed: com.cloudera.launchpad.pluggable.common.ExceptionConditions$DetailHolderException: Exception details: Caused by: com.cloudera.director.spi.v1.model.exception.UnrecoverableProviderException: Unexpected problem during instance allocation at com.cloudera.director.aws.ec2.EC2Provider.allocateOnDemandInstances(EC2Provider.java:1237) at com.cloudera.director.aws.ec2.EC2Provider.allocate(EC2Provider.java:661) at com.cloudera.director.aws.ec2.EC2Provider.allocate(EC2Provider.java:1) at com.cloudera.launchpad.pluggable.compute.PluggableComputeProvider.allocate(PluggableComputeProvider.java:572) ... 36 common frames omitted Caused by: com.cloudera.director.spi.v1.model.exception.UnrecoverableProviderException: Allocated 0 instances when the minimum count is 1. at com.cloudera.director.aws.ec2.EC2Provider.allocateOnDemandInstances(EC2Provider.java:1196) ... 39 common frames omitted [2017-09-15 17:09:54.182 -0400] ERROR [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: Insufficient number of instances available after allocation at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:239) at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:191) at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31) at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:721) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:85) at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:629) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:618) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:656) at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun$$EnhancerBySpringCGLIB$$fcfc6faf.runUnchecked(<generated>) at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:197) at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:168) at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78) at com.github.rholder.retry.Retryer.call(Retryer.java:160) at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:133) at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:164) at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [2017-09-15 17:09:54.185 -0400] ERROR [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.p.DatabasePipelineRunner: Encountered an unrecoverable error ErrorInfo{code=INSTANCE_ALLOCATION_FAILURE, properties={minRequiredCount=1, numberOfInstancesAllocated=0, virtualInstanceGroup=CM}, causes=[]} in job com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: Insufficient number of instances available after allocation at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:239) at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:191) at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31) at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:721) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:85) at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:629) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:618) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:656) at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun$$EnhancerBySpringCGLIB$$fcfc6faf.runUnchecked(<generated>) at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:197) at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:168) at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78) at com.github.rholder.retry.Retryer.call(Retryer.java:160) at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:133) at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:164) at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [2017-09-15 17:09:54.186 -0400] ERROR [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.p.DatabasePipelineRunner: Pipeline '4ddcf904-0d85-4019-a28f-53adcbaa5e08' failed at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun$$EnhancerBySpringCGLIB$$fcfc6faf at com.cloudera.launchpad.bootstrap.AllocateInstances:0 [2017-09-15 17:09:54.199 -0400] INFO [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.p.s.PipelineRepositoryService: Pipeline '4ddcf904-0d85-4019-a28f-53adcbaa5e08': RUNNING -> ERROR [2017-09-15 17:09:54.220 -0400] INFO [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': BOOTSTRAPPING -> BOOTSTRAP_FAILED [2017-09-15 17:11:13.533 -0400] INFO [task-thread-4] - - - - - c.c.launchpad.task.RefreshClusters: Refreshing Cluster models [2017-09-15 17:11:13.534 -0400] INFO [task-thread-4] - - - - - c.c.launchpad.task.RefreshClusters: Finished refreshing all pre-existing Cluster models [2017-09-15 17:11:13.985 -0400] INFO [task-thread-6] - - - - - c.c.l.task.RefreshDeployments: Refreshing pre-existing Deployments [2017-09-15 17:11:13.985 -0400] INFO [task-thread-6] - - - - - c.c.l.task.RefreshDeployments: Skipping refresh of deployment RicohTestCluster:RicohManager as it is in transition or terminated. (Stage: BOOTSTRAP_FAILED, deploymentIsNull: true) [2017-09-15 17:11:13.986 -0400] INFO [task-thread-6] - - - - - c.c.l.task.RefreshDeployments: Finished refreshing all pre-existing Deployment models [2017-09-15 17:11:22.445 -0400] DEBUG [qtp1541942595-14] 4c02c291-b86c-4c7d-9a6c-78f6808d892e POST /api/v9/environments/RicohTestCluster/deployments/RicohManager/diagnosticData - - o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver: Resolving exception from handler [public void com.cloudera.launchpad.api.v9.DeploymentsResourceV9.collectDiagnosticData(java.lang.String,java.lang.String) throws java.lang.InterruptedException]: com.cloudera.launchpad.api.common.DeploymentsResource$DeploymentUpdatePreconditionFailedException: Deployment is not available for /RicohTestCluster/RicohManager [2017-09-15 17:11:22.447 -0400] DEBUG [qtp1541942595-14] 4c02c291-b86c-4c7d-9a6c-78f6808d892e POST /api/v9/environments/RicohTestCluster/deployments/RicohManager/diagnosticData - - o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver: Invoking @ExceptionHandler method: public com.cloudera.launchpad.api.common.DeploymentsResource$DeploymentUpdatePreconditionFailedException com.cloudera.launchpad.api.common.DeploymentsResource$ExceptionAdvice.handleDeploymentUpdatePreconditionFailedException(com.cloudera.launchpad.api.common.DeploymentsResource$DeploymentUpdatePreconditionFailedException) [2017-09-15 17:11:56.025 -0400] INFO [qtp1541942595-18] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': BOOTSTRAP_FAILED -> TERMINATING [2017-09-15 17:11:56.033 -0400] INFO [qtp1541942595-18] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.p.DatabasePipelineService: Starting pipeline '35571387-e847-462d-b1f5-c85e0bfbbddb' with root job com.cloudera.launchpad.api.jobs.DefaultTerminateDeploymentJob and listener com.cloudera.launchpad.api.listeners.pipeline.TerminateDeploymentListener [2017-09-15 17:11:56.058 -0400] INFO [qtp1541942595-18] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.p.DatabasePipelineService: Create new runner thread for pipeline '35571387-e847-462d-b1f5-c85e0bfbbddb' [2017-09-15 17:11:56.081 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': TERMINATING -> TERMINATING [2017-09-15 17:11:56.161 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.DefaultTerminateDeploymentJob - c.c.l.pipeline.util.PipelineRunner: >> DefaultTerminateDeploymentJob/6 [Environment{name='RicohTestCluster', provider=InstanceProviderConfig{type='aws'}, credentials=SshCr ... [2017-09-15 17:11:56.195 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.DefaultTerminateDeploymentJob - c.c.l.pipeline.util.PipelineRunner: << None{} [2017-09-15 17:11:56.243 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.CancelPipelineAndWaitJob - c.c.l.pipeline.util.PipelineRunner: >> CancelPipelineAndWaitJob/1 [Optional.absent()] [2017-09-15 17:11:56.243 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.CancelPipelineAndWaitJob - c.c.l.pipeline.util.PipelineRunner: << None{} [2017-09-15 17:11:56.255 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: >> SetStatusJob/1 [Terminating Cloudera Manager instance] [2017-09-15 17:11:56.258 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.launchpad.pipeline.AbstractJob: Terminating Cloudera Manager instance [2017-09-15 17:11:56.258 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: << None{} [2017-09-15 17:11:56.314 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.l.pipeline.util.PipelineRunner: >> TerminateInstances/2 [Environment{name='RicohTestCluster', provider=InstanceProviderConfig{type='aws'}, credentials=SshCr ... [2017-09-15 17:11:56.384 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.director.aws.ec2.EC2Provider: Found EC2 key name ClouderaEDH for fingerprint [2017-09-15 17:11:56.399 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.director.aws.ec2.EC2Provider: Unable to terminate instances, all unknown [f21dcce3-41ee-4178-8d00-15a5350d77de] [2017-09-15 17:11:56.399 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.l.pipeline.util.PipelineRunner: << None{} [2017-09-15 17:11:56.409 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: >> SetStatusJob/1 [Waiting for instance to be terminated] [2017-09-15 17:11:56.412 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.launchpad.pipeline.AbstractJob: Waiting for instance to be terminated [2017-09-15 17:11:56.412 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: << None{} [2017-09-15 17:11:56.468 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.pipeline.util.PipelineRunner: >> WaitForInstancesTermination/2 [Environment{name='RicohTestCluster', provider=InstanceProviderConfig{type='aws'}, credentials=SshCr ... [2017-09-15 17:11:56.468 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.p.c.PluggableComputeProvider: Waiting for instances to be terminated. [2017-09-15 17:11:56.527 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.director.aws.ec2.EC2Provider: Found EC2 key name ClouderaEDH for fingerprint [2017-09-15 17:11:56.550 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.director.aws.ec2.EC2Provider: >> Fetching page 0 [2017-09-15 17:11:56.551 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.p.c.PluggableComputeProvider: Instance: f21dcce3-41ee-4178-8d00-15a5350d77de has desired status: UNKNOWN [2017-09-15 17:11:56.551 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.p.c.PluggableComputeProvider: Instance: f21dcce3-41ee-4178-8d00-15a5350d77de has status: UNKNOWN [2017-09-15 17:11:56.551 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.pipeline.util.PipelineRunner: << None{} [2017-09-15 17:11:56.559 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.p.s.PipelineRepositoryService: Pipeline '35571387-e847-462d-b1f5-c85e0bfbbddb': RUNNING -> COMPLETED [2017-09-15 17:11:56.570 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': TERMINATING -> TERMINATED [2017-09-15 17:11:59.081 -0400] INFO [qtp1541942595-17] 32dec189-5de7-41ef-9da6-51519ad67c2a DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.api.common.DeploymentsResource: Nothing to do on deployment. Current deployment status is: Status{stage=TERMINATED, description='Done', descriptionDetails=[], errorInfo=Optional.absent(), remainingSteps=0, completedSteps=6, health=Health{status=NOT_AVAILABLE}, diagnosticDataSummaries=[]} [2017-09-15 17:12:13.392 -0400] INFO [task-thread-10] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing all deployments for usage reporting [2017-09-15 17:12:13.394 -0400] INFO [task-thread-10] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing 0 deployments for usage reporting [2017-09-15 17:16:13.535 -0400] INFO [task-thread-10] - - - - - c.c.launchpad.task.RefreshClusters: Refreshing Cluster models [2017-09-15 17:16:13.535 -0400] INFO [task-thread-10] - - - - - c.c.launchpad.task.RefreshClusters: Finished refreshing all pre-existing Cluster models [2017-09-15 17:16:13.988 -0400] INFO [task-thread-1] - - - - - c.c.l.task.RefreshDeployments: Refreshing pre-existing Deployments [2017-09-15 17:16:13.989 -0400] INFO [task-thread-1] - - - - - c.c.l.task.RefreshDeployments: Skipping refresh of deployment RicohTestCluster:RicohManager as it is in transition or terminated. (Stage: TERMINATED, deploymentIsNull: true) [2017-09-15 17:16:13.989 -0400] INFO [task-thread-1] - - - - - c.c.l.task.RefreshDeployments: Finished refreshing all pre-existing Deployment models [2017-09-15 17:17:13.394 -0400] INFO [task-thread-8] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing all deployments for usage reporting [2017-09-15 17:17:13.396 -0400] INFO [task-thread-8] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing 0 deployments for usage reporting   Please help! I´d like to get my cluster up and running! thanks  ... View more