6.1 Bootstrap Failed using OpenJDK

[#1]

I am trying to bootstrap a CDH6.1 cluster using Director 6.1.  I have set Director's application.properties like so:

lp.bootstrap.packages.defaultCmJavaPackage:java-1.8.0-openjdk-devel
lp.bootstrap.packages.cmJavaPackages[0]: "6\\..*=java-1.8.0-openjdk-devel"
lp.bootstrap.packages.cmJavaPackages[1]: "5\\..*=java-1.7.0-openjdk-devel"

The cluster fails with the following error in Director's application.log:

[2019-01-30 14:21:34.311 +0000] INFO  [io-thread-7] - - - - - ssh:10.41.1.10: /usr/lib/jvm/java-openjdk
[2019-01-30 14:21:34.311 +0000] INFO  [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.inspector.util.JdkInspector: Found JAVA_HOME: /usr/lib/jvm/java-openjdk
[2019-01-30 14:21:34.453 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: openjdk version "1.8.0_191"
[2019-01-30 14:21:34.453 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: OpenJDK Runtime Environment (build 1.8.0_191-b12)
[2019-01-30 14:21:34.453 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode)
[2019-01-30 14:21:34.585 +0000] INFO  [io-thread-6] - - - - - ssh:10.41.1.10: javac 1.8.0_191
[2019-01-30 14:21:34.643 +0000] INFO  [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.b.EnableUnlimitedStrengthJce: Detected Java version: null
[2019-01-30 14:21:34.716 +0000] INFO  [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.b.EnableUnlimitedStrengthJce: Version null of Java is not supported for unlimited strength policy files
[2019-01-30 14:21:34.722 +0000] ERROR [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: null
        at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce.run(EnableUnlimitedStrengthJce.java:153)
        at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce.run(EnableUnlimitedStrengthJce.java:48)
        at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
        at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>)
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
        at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88)
        at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60)
        at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644)
        at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633)
        at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
        at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce$$EnhancerBySpringCGLIB$$1504d726.runUnchecked(<generated>)
        at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:202)
        at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:173)
        at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78)
        at com.github.rholder.retry.Retryer.call(Retryer.java:160)
        at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:136)
        at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.doRun(DatabasePipelineRunner.java:201)
        at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:141)
        at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
[2019-01-30 14:21:34.727 +0000] ERROR [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.p.DatabasePipelineRunner: Encountered an unrecoverable error: JobError{jobClassName=com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce, jobContext=JobContext{callCountAtThisStackLevel=0, pipelineHandle='553dab04-9a81-4ae3-af11-2814a062ee12', callStack=CallStack{items=[Item{className='com.cloudera.launchpad.api.jobs.DefaultBootstrapDeploymentJob', callCount=7}, Item{className='com.cloudera.launchpad.bootstrap.deployment.BootstrapClouderaManager', callCount=5}], size=2, parent=Optional.absent()}, stackLevel=2}, errorInfo=ErrorInfo{code=POLICY_FILE_INSTALLATION_FAIL, properties={instance=e5755692-0d3a-4769-add0-6a28cf355314, javaHome=/usr/lib/jvm/java-openjdk, javaMajorVersion=unsupported}, causes=[]}}
com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: null

[#2]

What OS are you using for your CDH cluster? Do you have an image ID so that we could try using it ourselves? This could very well be a bug on our end.

You can skip around EnableUnlimitedStrengthJce by adding:

lp.bootstrap.unlimited-jce: false

To your server's application.properties. I believe the unlimited strength JCE is bundled into Java after 8u162, so this step may be unnecessary.

[#3]

I am using CentOS 7 on AWS.   The image is ami-e1496384 in the us-east-2 region.

I will try setting unlimited-jce to false.

[#4]

How did you resolve this issue? Thanks

[#5]

This issue is fixed in the Altus 6.2+.

Director unable to install unlimited strength JCE with OpenJDK
Director is unable to properly detect the version of OpenJDK being used and thus is unable to install the unlimited strength JCE when bootstrapping a deployment if it is requested.
Cloudera Issue: DIR-8957

[#6]

Try to use: lp.bootstrap.packages.cmJavaPackages: "6\\..*=java-1.8.0-openjdk" without "[]". Keep in mind take into consideration property "javaInstallationStrategy" when You create deployment.

Regards,

Bart.