Member since
09-12-2017
13
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2437 | 05-07-2018 09:42 AM |
05-07-2018
09:42 AM
Ok so I finally found an answer. It seems copying from notepad to vi adds hidden characters had to code everything on vi and I had no issue.
... View more
04-04-2018
02:42 PM
Hi Community, I am trying to run a YARN script to test tune my cluster using teraGen and TeraSort. I have modified the script and got the teraGen part Running with no problems. However I keep getting an error when the teraSort begins: Below is the error: 18/04/04 21:29:47 INFO terasort.TeraSort: starting
java.net.URISyntaxException: Illegal character in path at index 0: /_partition.lst#_partition.lst
at java.net.URI$Parser.fail(URI.java:2829)
at java.net.URI$Parser.checkChars(URI.java:3002)
at java.net.URI$Parser.parseHierarchical(URI.java:3086)
at java.net.URI$Parser.parse(URI.java:3044)
at java.net.URI.<init>(URI.java:595)
at org.apache.hadoop.examples.terasort.TeraSort.run(TeraSort.java:300)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.examples.terasort.TeraSort.main(TeraSort.java:325)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136) And below is the Script #!/bin/sh
# Confirm the path values given below correspond to your installation
MR=/opt/cloudera/parcels/CDH/lib/hadoop-0.20-mapreduce
HADOOP=/opt/cloudera/parcels/CDH/bin
# Mark start of the loop
echo Testing loop started on `date`
# Mapper containers
for i in 8
do
# Reducer containers
for j in 1
do
# Container memory
for k in 512 1024
do
# Set mapper JVM heap
MAP_MB=`echo "($k*0.8)/1" | bc`
# Set reducer JVM heap
RED_MB=`echo "($k*0.8)/1" | bc`
time ${HADOOP}/hadoop jar ${MR}/hadoop-examples.jar teragen \
-Dmapreduce.job.maps=$i \
-Dmapreduce.map.memory.mb=$k \
-Dmapreduce.map.java.opts.max.heap=$MAP_MB \
100000000 /user/devops/results/tg-10GB-${i}-${j}-${k} 1>teragen_${i}_${j}_${k}.out 2>teragen_${i}_${j}_${k}.err
time ${HADOOP}/hadoop jar ${MR}/hadoop-examples.jar terasort \
-Dmapreduce.job.maps=$i \
-Dmapreduce.job.reduces=$j \
-Dmapreduce.map.memory.mb=$k \
-Dmapreduce.map.java.opts.max.heap=$MAP_MB \
-Dmapreduce.reduce.memory.mb=$k \
-Dmapreduce.reduce.java.opts.max.heap=$RED_MB \
/user/devops/results/tg-10GB-${i}-${j}-${k} \
/user/devops/results/ts-10GB-${i}-${j}-${k} 1>>tera_${i}_${j}_${k}.out 2>>tera_${i}_${j}_${k}.err
$HADOOP/hadoop fs -rm -r -skipTrash /user/devops/results/tg-10GB-${i}-${j}-${k}
$HADOOP/hadoop fs -rm -r -skipTrash /user/devops/results/ts-10GB-${i}-${j}-${k}
done
done
done
echo Testing loop ended on `date` Been at this for a couple of days so any help is more than welcome! thanks
... View more
Labels:
- Labels:
-
Apache YARN
-
Manual Installation
-
MapReduce
03-26-2018
01:36 PM
No no files at all. Just one cluster running.
... View more
03-23-2018
08:23 AM
Hi I decided to reinstall both CM and CDH. Could not find a work around. thanks!
... View more
03-23-2018
08:20 AM
Hi, Any solution to this issue? thanks
... View more
11-30-2017
07:06 AM
Hi Community, I currently have the cluster up and running however I have tried everything to fix the below error. When clicking inside the CM on hosts->roles error : cluster not found. Everything else is working fine. any ideas? thanks,
... View more
Labels:
- Labels:
-
Cloudera Manager
-
Manual Installation
10-04-2017
04:23 PM
Yes I was. I deleted the Name Tag and the bootstrap kept failing, the log showed CD was trying to connect constantly to the Manager so I checked Security Group config and allowed all trafic from within the Security group. They are both configured in the same VPC, Subnet and under the same SG. Thanks for your help!
... View more
10-04-2017
02:23 PM
Thanks Jadair for your help.I found the below exception: The only thing I see is the tag key ¨Name¨ being duplicated, could that be it? [2017-10-04 16:55:45.707 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances - c.c.l.pipeline.util.PipelineRunner: >> AllocateInstances/2 [VirtualInstanceGroup{name='CM', virtualInstances=[VirtualInstance{id='7e44695f-c37c-49b0-a132-3b6b7 ... [2017-10-04 16:55:45.812 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances - c.c.l.pipeline.util.PipelineRunner: << DatabaseValue{delegate=PersistentValueEntity{id=526, pipeline=00720bdb-c415-4354-a272-532ade9d861a, ... [2017-10-04 16:55:45.915 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.pipeline.util.PipelineRunner: >> AllocateInstances$AllocateAndWaitForInstancesToRun/2 [VirtualInstanceGroup{name='CM', virtualInstances=[VirtualInstance{id='7e44695f-c37c-49b0-a132-3b6b7 ... [2017-10-04 16:55:45.915 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.bootstrap.AllocateInstances: Allocating 1 instances (min count 1) in group CM [2017-10-04 16:55:45.977 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: Found EC2 key name ClouderaEDH for fingerprint [2017-10-04 16:55:45.977 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Requesting 1 instances for com.cloudera.director.aws.ec2.EC2InstanceTemplate@2d46916d [2017-10-04 16:55:46.022 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Building 1 instance requests [2017-10-04 16:55:46.025 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Network interface specification: {DeviceIndex: 0,SubnetId: subnet-6712fd2c,Groups: [sg-b18d4cc2],DeleteOnTermination: true,PrivateIpAddresses: [],AssociatePublicIpAddress: true,Ipv6Addresses: [],} [2017-10-04 16:55:46.048 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Original image block device mappings: [{DeviceName: /dev/sda1,Ebs: {SnapshotId: snap-02a781e1733af35eb,VolumeSize: 10,DeleteOnTermination: true,VolumeType: gp2,Encrypted: false},}] [2017-10-04 16:55:46.054 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Block device mappings: [{DeviceName: /dev/sda1,Ebs: {SnapshotId: snap-02a781e1733af35eb,VolumeSize: 100,DeleteOnTermination: true,VolumeType: gp2,},}] [2017-10-04 16:55:46.054 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Instance request type: m4.xlarge, image: ami-5f39a149 [2017-10-04 16:55:46.061 -0400] INFO [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: >> Submitted 1 run instance requests. [2017-10-04 16:55:46.289 -0400] ERROR [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.director.aws.ec2.EC2Provider: Exception while trying to allocate instance. java.util.concurrent.ExecutionException: com.cloudera.director.aws.shaded.com.amazonaws.services.ec2.model.AmazonEC2Exception: Duplicate tag key 'Name' specified. (Service: AmazonEC2; Status Code: 400; Error Code: InvalidParameterValue; Request ID: 849a90ee-d9e0-4ded-b2e6-95ae95694bd2) at java.lang.Thread.run(Thread.java:748)
Suppressed: com.cloudera.launchpad.pluggable.common.ExceptionConditions$DetailHolderException: Exception details:
Caused by: com.cloudera.director.spi.v1.model.exception.UnrecoverableProviderException: Unexpected problem during instance allocation
at com.cloudera.director.aws.ec2.EC2Provider.allocateOnDemandInstances(EC2Provider.java:1237)
at com.cloudera.director.aws.ec2.EC2Provider.allocate(EC2Provider.java:661)
at com.cloudera.director.aws.ec2.EC2Provider.allocate(EC2Provider.java:1)
at com.cloudera.launchpad.pluggable.compute.PluggableComputeProvider.allocate(PluggableComputeProvider.java:572)
... 36 common frames omitted
Caused by: com.cloudera.director.spi.v1.model.exception.UnrecoverableProviderException: Allocated 0 instances when the minimum count is 1.
at com.cloudera.director.aws.ec2.EC2Provider.allocateOnDemandInstances(EC2Provider.java:1196)
... 39 common frames omitted
[2017-10-04 16:55:46.338 -0400] ERROR [p-532ade9d861a-DefaultBootstrapDeploymentJob] 5f36dff1-458a-4aa3-b77d-81093a318f3f POST /api/v9/environments/QA-DevEnvironment/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: Insufficient number of instances available after allocation
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:239)
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:191)
at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
... View more
09-18-2017
08:34 AM
Hi Tomas, Did the bootstarp for the Cloudera Manager Work for you? I can´t get past that step. Any tips are more than welcome. best
... View more
09-15-2017
03:10 PM
Hello! I am new to Cloudera and I am trying to install Cloudera Director, Manager and CDH5 on AWS. I have the director running, I can log in using the SOCK5 proxy but with some errors: 1. I SSH into the instance. 2. I then run ssh -i mykey.pem -CND 8157 ec2-user@PUBLIC-INSTANCE-IP & 3. I then use SwitchyOmega on Chrome (replacing 172.31 for my VPC subnet prefix, this is a private prefix). I use my browser to access the following IP: http://PRIVATE-INSTANCE-IP:7189/ I can connect to the Cloudera Director and Set up my environment however, I keep seing the below messages in my Bash CLI: $ channel 2: open failed: connect failed: Connection refused channel 3: open failed: connect failed: Connection refused channel 4: open failed: connect failed: Connection refused channel 5: open failed: connect failed: Connection refused channel 6: open failed: connect failed: Connection refused channel 7: open failed: connect failed: Connection refused Have I misconfigured anything? Cloudera Manager: As soon as I try and Add the Clouder Manager I get the Bootstrap Fail: I am using AMI: 64-bit RHEL-7.3_HVM-20170424-x86_64-1-Hourly2-GP2 - ami-5f39a149 For both the Director and Manager. For the director I configured an AWS Role with the policy provided by Cloudera. After Configuring the Manager and trying to run the instance it says the bootstrap failed. When I Collect Diagnostics Data: Status: 412, Reason: Deployment is not available for /RicohTestCluster/Manager Below are the Logs: Cloudera log https://we.tl/x4J3H5bJEm Suppressed: com.cloudera.launchpad.pluggable.common.ExceptionConditions$DetailHolderException: Exception details:
Caused by: com.cloudera.director.spi.v1.model.exception.UnrecoverableProviderException: Unexpected problem during instance allocation
at com.cloudera.director.aws.ec2.EC2Provider.allocateOnDemandInstances(EC2Provider.java:1237)
at com.cloudera.director.aws.ec2.EC2Provider.allocate(EC2Provider.java:661)
at com.cloudera.director.aws.ec2.EC2Provider.allocate(EC2Provider.java:1)
at com.cloudera.launchpad.pluggable.compute.PluggableComputeProvider.allocate(PluggableComputeProvider.java:572)
... 36 common frames omitted
Caused by: com.cloudera.director.spi.v1.model.exception.UnrecoverableProviderException: Allocated 0 instances when the minimum count is 1.
at com.cloudera.director.aws.ec2.EC2Provider.allocateOnDemandInstances(EC2Provider.java:1196)
... 39 common frames omitted
[2017-09-15 17:09:54.182 -0400] ERROR [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: Insufficient number of instances available after allocation
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:239)
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:191)
at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:721)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:85)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:629)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:618)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:656)
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun$$EnhancerBySpringCGLIB$$fcfc6faf.runUnchecked(<generated>)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:197)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:168)
at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78)
at com.github.rholder.retry.Retryer.call(Retryer.java:160)
at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:133)
at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:164)
at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2017-09-15 17:09:54.185 -0400] ERROR [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.p.DatabasePipelineRunner: Encountered an unrecoverable error ErrorInfo{code=INSTANCE_ALLOCATION_FAILURE, properties={minRequiredCount=1, numberOfInstancesAllocated=0, virtualInstanceGroup=CM}, causes=[]} in job com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: Insufficient number of instances available after allocation
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:239)
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun.run(AllocateInstances.java:191)
at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:721)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:85)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:629)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:618)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:656)
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun$$EnhancerBySpringCGLIB$$fcfc6faf.runUnchecked(<generated>)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:197)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:168)
at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78)
at com.github.rholder.retry.Retryer.call(Retryer.java:160)
at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:133)
at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:164)
at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[2017-09-15 17:09:54.186 -0400] ERROR [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.p.DatabasePipelineRunner: Pipeline '4ddcf904-0d85-4019-a28f-53adcbaa5e08' failed
at com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun$$EnhancerBySpringCGLIB$$fcfc6faf
at com.cloudera.launchpad.bootstrap.AllocateInstances:0
[2017-09-15 17:09:54.199 -0400] INFO [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.p.s.PipelineRepositoryService: Pipeline '4ddcf904-0d85-4019-a28f-53adcbaa5e08': RUNNING -> ERROR
[2017-09-15 17:09:54.220 -0400] INFO [p-53adcbaa5e08-DefaultBootstrapDeploymentJob] 3b0e9189-6e4b-46be-a711-fcddd719e486 POST /api/v9/environments/RicohTestCluster/deployments com.cloudera.launchpad.bootstrap.AllocateInstances$AllocateAndWaitForInstancesToRun - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': BOOTSTRAPPING -> BOOTSTRAP_FAILED
[2017-09-15 17:11:13.533 -0400] INFO [task-thread-4] - - - - - c.c.launchpad.task.RefreshClusters: Refreshing Cluster models
[2017-09-15 17:11:13.534 -0400] INFO [task-thread-4] - - - - - c.c.launchpad.task.RefreshClusters: Finished refreshing all pre-existing Cluster models
[2017-09-15 17:11:13.985 -0400] INFO [task-thread-6] - - - - - c.c.l.task.RefreshDeployments: Refreshing pre-existing Deployments
[2017-09-15 17:11:13.985 -0400] INFO [task-thread-6] - - - - - c.c.l.task.RefreshDeployments: Skipping refresh of deployment RicohTestCluster:RicohManager as it is in transition or terminated. (Stage: BOOTSTRAP_FAILED, deploymentIsNull: true)
[2017-09-15 17:11:13.986 -0400] INFO [task-thread-6] - - - - - c.c.l.task.RefreshDeployments: Finished refreshing all pre-existing Deployment models
[2017-09-15 17:11:22.445 -0400] DEBUG [qtp1541942595-14] 4c02c291-b86c-4c7d-9a6c-78f6808d892e POST /api/v9/environments/RicohTestCluster/deployments/RicohManager/diagnosticData - - o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver: Resolving exception from handler [public void com.cloudera.launchpad.api.v9.DeploymentsResourceV9.collectDiagnosticData(java.lang.String,java.lang.String) throws java.lang.InterruptedException]: com.cloudera.launchpad.api.common.DeploymentsResource$DeploymentUpdatePreconditionFailedException: Deployment is not available for /RicohTestCluster/RicohManager
[2017-09-15 17:11:22.447 -0400] DEBUG [qtp1541942595-14] 4c02c291-b86c-4c7d-9a6c-78f6808d892e POST /api/v9/environments/RicohTestCluster/deployments/RicohManager/diagnosticData - - o.s.w.s.m.m.a.ExceptionHandlerExceptionResolver: Invoking @ExceptionHandler method: public com.cloudera.launchpad.api.common.DeploymentsResource$DeploymentUpdatePreconditionFailedException com.cloudera.launchpad.api.common.DeploymentsResource$ExceptionAdvice.handleDeploymentUpdatePreconditionFailedException(com.cloudera.launchpad.api.common.DeploymentsResource$DeploymentUpdatePreconditionFailedException)
[2017-09-15 17:11:56.025 -0400] INFO [qtp1541942595-18] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': BOOTSTRAP_FAILED -> TERMINATING
[2017-09-15 17:11:56.033 -0400] INFO [qtp1541942595-18] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.p.DatabasePipelineService: Starting pipeline '35571387-e847-462d-b1f5-c85e0bfbbddb' with root job com.cloudera.launchpad.api.jobs.DefaultTerminateDeploymentJob and listener com.cloudera.launchpad.api.listeners.pipeline.TerminateDeploymentListener
[2017-09-15 17:11:56.058 -0400] INFO [qtp1541942595-18] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.p.DatabasePipelineService: Create new runner thread for pipeline '35571387-e847-462d-b1f5-c85e0bfbbddb'
[2017-09-15 17:11:56.081 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': TERMINATING -> TERMINATING
[2017-09-15 17:11:56.161 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.DefaultTerminateDeploymentJob - c.c.l.pipeline.util.PipelineRunner: >> DefaultTerminateDeploymentJob/6 [Environment{name='RicohTestCluster', provider=InstanceProviderConfig{type='aws'}, credentials=SshCr ...
[2017-09-15 17:11:56.195 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.DefaultTerminateDeploymentJob - c.c.l.pipeline.util.PipelineRunner: << None{}
[2017-09-15 17:11:56.243 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.CancelPipelineAndWaitJob - c.c.l.pipeline.util.PipelineRunner: >> CancelPipelineAndWaitJob/1 [Optional.absent()]
[2017-09-15 17:11:56.243 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.api.jobs.CancelPipelineAndWaitJob - c.c.l.pipeline.util.PipelineRunner: << None{}
[2017-09-15 17:11:56.255 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: >> SetStatusJob/1 [Terminating Cloudera Manager instance]
[2017-09-15 17:11:56.258 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.launchpad.pipeline.AbstractJob: Terminating Cloudera Manager instance
[2017-09-15 17:11:56.258 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: << None{}
[2017-09-15 17:11:56.314 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.l.pipeline.util.PipelineRunner: >> TerminateInstances/2 [Environment{name='RicohTestCluster', provider=InstanceProviderConfig{type='aws'}, credentials=SshCr ...
[2017-09-15 17:11:56.384 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.director.aws.ec2.EC2Provider: Found EC2 key name ClouderaEDH for fingerprint
[2017-09-15 17:11:56.399 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.director.aws.ec2.EC2Provider: Unable to terminate instances, all unknown [f21dcce3-41ee-4178-8d00-15a5350d77de]
[2017-09-15 17:11:56.399 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.TerminateInstances - c.c.l.pipeline.util.PipelineRunner: << None{}
[2017-09-15 17:11:56.409 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: >> SetStatusJob/1 [Waiting for instance to be terminated]
[2017-09-15 17:11:56.412 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.launchpad.pipeline.AbstractJob: Waiting for instance to be terminated
[2017-09-15 17:11:56.412 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.pipeline.SetStatusJob - c.c.l.pipeline.util.PipelineRunner: << None{}
[2017-09-15 17:11:56.468 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.pipeline.util.PipelineRunner: >> WaitForInstancesTermination/2 [Environment{name='RicohTestCluster', provider=InstanceProviderConfig{type='aws'}, credentials=SshCr ...
[2017-09-15 17:11:56.468 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.p.c.PluggableComputeProvider: Waiting for instances to be terminated.
[2017-09-15 17:11:56.527 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.director.aws.ec2.EC2Provider: Found EC2 key name ClouderaEDH for fingerprint
[2017-09-15 17:11:56.550 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.director.aws.ec2.EC2Provider: >> Fetching page 0
[2017-09-15 17:11:56.551 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.p.c.PluggableComputeProvider: Instance: f21dcce3-41ee-4178-8d00-15a5350d77de has desired status: UNKNOWN
[2017-09-15 17:11:56.551 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.p.c.PluggableComputeProvider: Instance: f21dcce3-41ee-4178-8d00-15a5350d77de has status: UNKNOWN
[2017-09-15 17:11:56.551 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager com.cloudera.launchpad.cleanup.WaitForInstancesTermination - c.c.l.pipeline.util.PipelineRunner: << None{}
[2017-09-15 17:11:56.559 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.p.s.PipelineRepositoryService: Pipeline '35571387-e847-462d-b1f5-c85e0bfbbddb': RUNNING -> COMPLETED
[2017-09-15 17:11:56.570 -0400] INFO [p-c85e0bfbbddb-DefaultTerminateDeploymentJob] 74a94fea-3335-4990-9731-061e8c5c1d10 DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.d.DeploymentRepositoryService: Deployment 'RicohManager': TERMINATING -> TERMINATED
[2017-09-15 17:11:59.081 -0400] INFO [qtp1541942595-17] 32dec189-5de7-41ef-9da6-51519ad67c2a DELETE /api/v9/environments/RicohTestCluster/deployments/RicohManager - - c.c.l.api.common.DeploymentsResource: Nothing to do on deployment. Current deployment status is: Status{stage=TERMINATED, description='Done', descriptionDetails=[], errorInfo=Optional.absent(), remainingSteps=0, completedSteps=6, health=Health{status=NOT_AVAILABLE}, diagnosticDataSummaries=[]}
[2017-09-15 17:12:13.392 -0400] INFO [task-thread-10] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing all deployments for usage reporting
[2017-09-15 17:12:13.394 -0400] INFO [task-thread-10] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing 0 deployments for usage reporting
[2017-09-15 17:16:13.535 -0400] INFO [task-thread-10] - - - - - c.c.launchpad.task.RefreshClusters: Refreshing Cluster models
[2017-09-15 17:16:13.535 -0400] INFO [task-thread-10] - - - - - c.c.launchpad.task.RefreshClusters: Finished refreshing all pre-existing Cluster models
[2017-09-15 17:16:13.988 -0400] INFO [task-thread-1] - - - - - c.c.l.task.RefreshDeployments: Refreshing pre-existing Deployments
[2017-09-15 17:16:13.989 -0400] INFO [task-thread-1] - - - - - c.c.l.task.RefreshDeployments: Skipping refresh of deployment RicohTestCluster:RicohManager as it is in transition or terminated. (Stage: TERMINATED, deploymentIsNull: true)
[2017-09-15 17:16:13.989 -0400] INFO [task-thread-1] - - - - - c.c.l.task.RefreshDeployments: Finished refreshing all pre-existing Deployment models
[2017-09-15 17:17:13.394 -0400] INFO [task-thread-8] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing all deployments for usage reporting
[2017-09-15 17:17:13.396 -0400] INFO [task-thread-8] - - - - - c.c.l.m.r.DeploymentsReporter: Enqueueing 0 deployments for usage reporting Please help! I´d like to get my cluster up and running! thanks
... View more
Labels:
- Labels:
-
Cloudera Manager