Created 06-26-2017 11:34 PM
Hello,
For Director (2.4) CDH 5.11.1 fail to create the external database.
same template works very well for 5.10.1, I didnt see any changes in templates for 5.11, also 2.4 director template able to create a external RDS for 5.10
Please let me know where is the issue
Thanks
Created 06-27-2017 06:41 AM
Hi ranjithKA,
Please post error information from logs or other Director output that describes the exact error Director encountered. If you are using the CLI with the "bootstrap" command, locate the client application.log; if you are using "bootstrap-remote", locate the server application.log. Details on finding those file are here:
https://www.cloudera.com/documentation/director/latest/topics/director_troubleshoot.html
You can also post the relevant portion of your configuration file. For all of these files, be sure to redact any sensitive internal information for your organization.
Also, if you happen to have a support contract with Cloudera, you can file a ticket with them to get dedicated attention to resolving the problem. If not, we'll see what we can do here.
Thanks!
Created on 06-28-2017 03:44 AM - edited 06-28-2017 03:52 AM
Here the errors:
Looks like m3.medium is not availble for RDS, looking further issues.
ERROR [p-ed850004463d-DefaultBootstrapExternalDatabaseServersJob] POS
T /api/v8/environments/rk-test1%20Environment/databaseServers com.cloudera.launchpad.bootstrap.databa
se.AllocateExternalDatabaseServers - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job faile
d
com.cloudera.director.aws.shaded.com.amazonaws.services.rds.model.AmazonRDSException: Invalid DB Inst
ance class:db.m3.medium (Service: AmazonRDS; Status Code: 400; Error Code: InvalidParameterValue; Req
uest ID: 744783de-5bed-11e7-80db-d9eb9bde1e0b)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.handl
eErrorResponse(AmazonHttpClient.java:1545)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teOneRequest(AmazonHttpClient.java:1183)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teHelper(AmazonHttpClient.java:964)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExe
cute(AmazonHttpClient.java:676)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teWithTimer(AmazonHttpClient.java:650)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
te(AmazonHttpClient.java:633)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.acces
s$300(AmazonHttpClient.java:601)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutionBuild
erImpl.execute(AmazonHttpClient.java:583)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpCli
ent.java:447)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.doInvoke(Amazo
nRDSClient.java:5060)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.invoke(AmazonR
DSClient.java:5036)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.createDBInstan
ce(AmazonRDSClient.java:1131)
at com.cloudera.director.aws.rds.RDSProvider.allocate(RDSProvider.java:332)
at com.cloudera.director.aws.rds.RDSProvider.allocate(RDSProvider.java:65)
at com.cloudera.launchpad.pluggable.database.PluggableDatabaseServerProvider.allocate(Pluggab
leDatabaseServerProvider.java:325)
at com.cloudera.launchpad.pluggable.database.PluggableDatabaseServerProvider.create(Pluggable
DatabaseServerProvider.java:159)
at com.cloudera.launchpad.model.database.AbstractExternalDatabaseServerProvider.create(Abstra
ctExternalDatabaseServerProvider.java:26)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers.run(AllocateExte
rnalDatabaseServers.java:95)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers.run(AllocateExte
rnalDatabaseServers.java:36)
at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generat
ed>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(Cgli
bAopProxy.java:721)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:157)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocati
onProceedingJoinPoint.java:97)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler$1.call(PipelineJobProfiler.java:67)
at com.codahale.metrics.Timer.time(Timer.java:101)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java
:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(Abst
ractAspectJAdvice.java:629)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAd
vice.java:618)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:179)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInt
erceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:179)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibA
opProxy.java:656)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers$$EnhancerBySprin
gCGLIB$$e0e41ce.runUnchecked(<generated>)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:1
97)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:1
68)
at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.j
ava:78)
at com.github.rholder.retry.Retryer.call(Retryer.java:160)
at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetrie
s(PipelineRunner.java:133)
at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:157
)
at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Created 06-28-2017 06:17 AM
The set of available RDS instance classes depends on the region. For example, db.m3.medium is available in us-east-1 but not in ap-south-1.
Created 06-28-2017 08:39 AM
Got the issue, there was a problem to rerun the below command,
cloudera-director bootstrap-remote /tmp/small_cdh_cd_bootstrap.conf --lp.remote.username=admin --lp.remote.password=admin --lp.remote.hostAndPort=localhost:7189
Since the external DB template was accepted, its still there in the same environment, else i have to modify the cluster, i have deleted the old environment and redeployed the same.
Thanks