01-30-2019
07:34 AM
- last edited on
01-30-2019
01:07 PM
by
cjervis
I am trying to bootstrap a CDH6.1 cluster using Director 6.1. I have set Director's application.properties like so:
lp.bootstrap.packages.defaultCmJavaPackage:java-1.8.0-openjdk-devel lp.bootstrap.packages.cmJavaPackages[0]: "6\\..*=java-1.8.0-openjdk-devel" lp.bootstrap.packages.cmJavaPackages[1]: "5\\..*=java-1.7.0-openjdk-devel"
The cluster fails with the following error in Director's application.log:
[2019-01-30 14:21:34.311 +0000] INFO [io-thread-7] - - - - - ssh:10.41.1.10: /usr/lib/jvm/java-openjdk [2019-01-30 14:21:34.311 +0000] INFO [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.inspector.util.JdkInspector: Found JAVA_HOME: /usr/lib/jvm/java-openjdk [2019-01-30 14:21:34.453 +0000] INFO [io-thread-6] - - - - - ssh:10.41.1.10: openjdk version "1.8.0_191" [2019-01-30 14:21:34.453 +0000] INFO [io-thread-6] - - - - - ssh:10.41.1.10: OpenJDK Runtime Environment (build 1.8.0_191-b12) [2019-01-30 14:21:34.453 +0000] INFO [io-thread-6] - - - - - ssh:10.41.1.10: OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode) [2019-01-30 14:21:34.585 +0000] INFO [io-thread-6] - - - - - ssh:10.41.1.10: javac 1.8.0_191 [2019-01-30 14:21:34.643 +0000] INFO [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.b.EnableUnlimitedStrengthJce: Detected Java version: null [2019-01-30 14:21:34.716 +0000] INFO [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.b.EnableUnlimitedStrengthJce: Version null of Java is not supported for unlimited strength policy files [2019-01-30 14:21:34.722 +0000] ERROR [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: null at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce.run(EnableUnlimitedStrengthJce.java:153) at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce.run(EnableUnlimitedStrengthJce.java:48) at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31) at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generated>) at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88) at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java:60) at sun.reflect.GeneratedMethodAccessor154.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644) at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633) at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688) at com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce$$EnhancerBySpringCGLIB$$1504d726.runUnchecked(<generated>) at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:202) at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:173) at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78) at com.github.rholder.retry.Retryer.call(Retryer.java:160) at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetries(PipelineRunner.java:136) at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.doRun(DatabasePipelineRunner.java:201) at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:141) at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [2019-01-30 14:21:34.727 +0000] ERROR [p-2814a062ee12-DefaultBootstrapDeploymentJob] 2125503a-9188-4da6-b8df-22f83aebe3fe POST /api/d6.1/environments/HDFS-Kudu-Cluster-DEV-2%20Environment/deployments com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce - c.c.l.p.DatabasePipelineRunner: Encountered an unrecoverable error: JobError{jobClassName=com.cloudera.launchpad.bootstrap.EnableUnlimitedStrengthJce, jobContext=JobContext{callCountAtThisStackLevel=0, pipelineHandle='553dab04-9a81-4ae3-af11-2814a062ee12', callStack=CallStack{items=[Item{className='com.cloudera.launchpad.api.jobs.DefaultBootstrapDeploymentJob', callCount=7}, Item{className='com.cloudera.launchpad.bootstrap.deployment.BootstrapClouderaManager', callCount=5}], size=2, parent=Optional.absent()}, stackLevel=2}, errorInfo=ErrorInfo{code=POLICY_FILE_INSTALLATION_FAIL, properties={instance=e5755692-0d3a-4769-add0-6a28cf355314, javaHome=/usr/lib/jvm/java-openjdk, javaMajorVersion=unsupported}, causes=[]}} com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: null
01-30-2019 07:46 AM
What OS are you using for your CDH cluster? Do you have an image ID so that we could try using it ourselves? This could very well be a bug on our end.
You can skip around EnableUnlimitedStrengthJce by adding:
lp.bootstrap.unlimited-jce: false
To your server's application.properties. I believe the unlimited strength JCE is bundled into Java after 8u162, so this step may be unnecessary.
01-30-2019 07:51 AM
I am using CentOS 7 on AWS. The image is ami-e1496384 in the us-east-2 region.
I will try setting unlimited-jce to false.