Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Director on RDS AWS external database creation

Director on RDS AWS external database creation

New Contributor

Hello,

 

For Director (2.4) CDH 5.11.1 fail to create the external database. 

 

same template works very well for 5.10.1,  I didnt see any changes in templates for 5.11, also 2.4 director template able to create a external RDS for 5.10

 

Please let me know where is the issue

 

Thanks 

4 REPLIES 4

Re: Director on RDS AWS external database creation

Expert Contributor

Hi ranjithKA,

 

Please post error information from logs or other Director output that describes the exact error Director encountered. If you are using the CLI with the "bootstrap" command, locate the client application.log; if you are using "bootstrap-remote", locate the server application.log. Details on finding those file are here:

 

https://www.cloudera.com/documentation/director/latest/topics/director_troubleshoot.html

 

You can also post the relevant portion of your configuration file. For all of these files, be sure to redact any sensitive internal information for your organization.

 

Also, if you happen to have a support contract with Cloudera, you can file a ticket with them to get dedicated attention to resolving the problem. If not, we'll see what we can do here.

 

Thanks!

Re: Director on RDS AWS external database creation

New Contributor

Here the errors: 

 

Looks like m3.medium is not availble for RDS, looking further issues. 

 

ERROR [p-ed850004463d-DefaultBootstrapExternalDatabaseServersJob] POS
T /api/v8/environments/rk-test1%20Environment/databaseServers com.cloudera.launchpad.bootstrap.databa
se.AllocateExternalDatabaseServers - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job faile
d
com.cloudera.director.aws.shaded.com.amazonaws.services.rds.model.AmazonRDSException: Invalid DB Inst
ance class:db.m3.medium (Service: AmazonRDS; Status Code: 400; Error Code: InvalidParameterValue; Req
uest ID: 744783de-5bed-11e7-80db-d9eb9bde1e0b)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.handl
eErrorResponse(AmazonHttpClient.java:1545)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teOneRequest(AmazonHttpClient.java:1183)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teHelper(AmazonHttpClient.java:964)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExe
cute(AmazonHttpClient.java:676)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teWithTimer(AmazonHttpClient.java:650)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
te(AmazonHttpClient.java:633)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.acces
s$300(AmazonHttpClient.java:601)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutionBuild
erImpl.execute(AmazonHttpClient.java:583)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpCli
ent.java:447)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.doInvoke(Amazo
nRDSClient.java:5060)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.invoke(AmazonR
DSClient.java:5036)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.createDBInstan
ce(AmazonRDSClient.java:1131)
at com.cloudera.director.aws.rds.RDSProvider.allocate(RDSProvider.java:332)
at com.cloudera.director.aws.rds.RDSProvider.allocate(RDSProvider.java:65)
at com.cloudera.launchpad.pluggable.database.PluggableDatabaseServerProvider.allocate(Pluggab
leDatabaseServerProvider.java:325)
at com.cloudera.launchpad.pluggable.database.PluggableDatabaseServerProvider.create(Pluggable
DatabaseServerProvider.java:159)
at com.cloudera.launchpad.model.database.AbstractExternalDatabaseServerProvider.create(Abstra
ctExternalDatabaseServerProvider.java:26)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers.run(AllocateExte
rnalDatabaseServers.java:95)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers.run(AllocateExte
rnalDatabaseServers.java:36)
at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generat
ed>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(Cgli
bAopProxy.java:721)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:157)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocati
onProceedingJoinPoint.java:97)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler$1.call(PipelineJobProfiler.java:67)
at com.codahale.metrics.Timer.time(Timer.java:101)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java
:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(Abst
ractAspectJAdvice.java:629)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAd
vice.java:618)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:179)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInt
erceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:179)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibA
opProxy.java:656)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers$$EnhancerBySprin
gCGLIB$$e0e41ce.runUnchecked(<generated>)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:1
97)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:1
68)
at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.j
ava:78)
at com.github.rholder.retry.Retryer.call(Retryer.java:160)
at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetrie
s(PipelineRunner.java:133)
at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:157
)
at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

Re: Director on RDS AWS external database creation

Expert Contributor

The set of available RDS instance classes depends on the region. For example, db.m3.medium is available in us-east-1 but not in ap-south-1.

Highlighted

Re: Director on RDS AWS external database creation

New Contributor

Got the issue, there was a problem to rerun the below command,

 

cloudera-director bootstrap-remote /tmp/small_cdh_cd_bootstrap.conf --lp.remote.username=admin --lp.remote.password=admin --lp.remote.hostAndPort=localhost:7189

 

Since the external DB template was accepted, its still there in the same environment, else i have to modify the cluster, i have deleted the old environment and redeployed the same. 

 

Thanks