Reply
Explorer
Posts: 14
Registered: ‎05-21-2018

6.1 Bootstrap Failed using OpenJDK

[ Edited ]

I am trying to bootstrap a CDH6.1 cluster using Director 6.1.  I have set Director's application.properties like so:

 

lp.bootstrap.packages.defaultCmJavaPackage:java-1.8.0-openjdk-devel
lp.bootstrap.packages.cmJavaPackages[0]: "6\\..*=java-1.8.0-openjdk-devel"
lp.bootstrap.packages.cmJavaPackages[1]: "5\\..*=java-1.7.0-openjdk-devel"

The cluster fails with the following error in Director's application.log:

 

 

[2019-01-30 14:21:34.311 +0000] INFO  [io-thread-7] - - - - - ssh:10.41.1.10: /usr/lib/jvm/java-openjdk
[2019-01-30 14:21:34.311 +0000] INFO  [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.inspector.util.JdkInspector: Found JAVA_HOME: /usr/lib/jvm/java-openjdk
[2019-01-30 14:21:34.453 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: openjdk version "1.8.0_191"
[2019-01-30 14:21:34.453 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: OpenJDK Runtime Environment (build 1.8.0_191-b12)
[2019-01-30 14:21:34.453 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode)
[2019-01-30 14:21:34.585 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: javac 1.8.0_191
[2019-01-30 14:21:34.643 +0000] INFO  [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.b.EnableUnlimitedStrengthJce: Detected Java version: null
[2019-01-30 14:21:34.716 +0000] INFO  [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.b.EnableUnlimitedStrengthJce: Version null of Java is not supported for unlimited strength policy files
[2019-01-30 14:21:34.722 +0000] ERROR [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: null
        at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce.run(EnableUnlimitedStrengthJce.java:153)
        at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce.run(EnableUnlimitedStrengthJce.java:48)
        at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
        at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>)
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88)
        at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60)
        at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644)
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633)
        at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
        at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce$$EnhancerBySpringCGLIB$$1504d726.runUnchecked(<generated>)
        at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:202)
        at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:173)
        at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78)
        at com.github.rholder.retry.Retryer.call(Retryer.java:160)
        at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:136)
        at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.doRun(DatabasePipelineRunner.java:201)
        at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:141)
        at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
[2019-01-30 14:21:34.727 +0000] ERROR [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.p.DatabasePipelineRunner: Encountered an unrecoverable error: JobError{jobClassName=com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce, jobContext=JobContext{callCountAtThisStackLevel=0, pipelineHandle='553dab04-9a81-4ae3-af11-2814a062ee12', callStack=CallStack{items=[Item{className='com.cloudera.launchpad.api.jobs.DefaultBootstrapDeploymentJob', callCount=7}, Item{className='com.cloudera.launchpad.bootstrap.deployment.BootstrapClouderaManager', callCount=5}], size=2, parent=Optional.absent()}, stackLevel=2}, errorInfo=ErrorInfo{code=POLICY_FILE_INSTALLATION_FAIL, properties={instance=e5755692-0d3a-4769-add0-6a28cf355314, javaHome=/usr/lib/jvm/java-openjdk, javaMajorVersion=unsupported}, causes=[]}}
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: null
Cloudera Employee
Posts: 61
Registered: ‎10-14-2014

Re: 6.1 Bootstrap Failed using OpenJDK

What OS are you using for your CDH cluster? Do you have an image ID so that we could try using it ourselves? This could very well be a bug on our end.

 

You can skip around EnableUnlimitedStrengthJce by adding:

 

lp.bootstrap.unlimited-jce: false

To your server's application.properties. I believe the unlimited strength JCE is bundled into Java after 8u162, so this step may be unnecessary.

Explorer
Posts: 14
Registered: ‎05-21-2018

Re: 6.1 Bootstrap Failed using OpenJDK

I am using CentOS 7 on AWS.   The image is ami-e1496384 in the us-east-2 region.

 

I will try setting unlimited-jce to false.