Reply
New Contributor
Posts: 3
Registered: ‎07-08-2016

Director on RDS AWS external database creation

Hello,

 

For Director (2.4) CDH 5.11.1 fail to create the external database. 

 

same template works very well for 5.10.1,  I didnt see any changes in templates for 5.11, also 2.4 director template able to create a external RDS for 5.10

 

Please let me know where is the issue

 

Thanks 

Cloudera Employee
Posts: 40
Registered: ‎02-18-2014

Re: Director on RDS AWS external database creation

Hi ranjithKA,

 

Please post error information from logs or other Director output that describes the exact error Director encountered. If you are using the CLI with the "bootstrap" command, locate the client application.log; if you are using "bootstrap-remote", locate the server application.log. Details on finding those file are here:

 

https://www.cloudera.com/documentation/director/latest/topics/director_troubleshoot.html

 

You can also post the relevant portion of your configuration file. For all of these files, be sure to redact any sensitive internal information for your organization.

 

Also, if you happen to have a support contract with Cloudera, you can file a ticket with them to get dedicated attention to resolving the problem. If not, we'll see what we can do here.

 

Thanks!

New Contributor
Posts: 3
Registered: ‎07-08-2016

Re: Director on RDS AWS external database creation

[ Edited ]

Here the errors: 

 

Looks like m3.medium is not availble for RDS, looking further issues. 

 

ERROR [p-ed850004463d-DefaultBootstrapExternalDatabaseServersJob] POS
T /api/v8/environments/rk-test1%20Environment/databaseServers com.cloudera.launchpad.bootstrap.databa
se.AllocateExternalDatabaseServers - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job faile
d
com.cloudera.director.aws.shaded.com.amazonaws.services.rds.model.AmazonRDSException: Invalid DB Inst
ance class:db.m3.medium (Service: AmazonRDS; Status Code: 400; Error Code: InvalidParameterValue; Req
uest ID: 744783de-5bed-11e7-80db-d9eb9bde1e0b)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.handl
eErrorResponse(AmazonHttpClient.java:1545)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teOneRequest(AmazonHttpClient.java:1183)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teHelper(AmazonHttpClient.java:964)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExe
cute(AmazonHttpClient.java:676)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
teWithTimer(AmazonHttpClient.java:650)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.execu
te(AmazonHttpClient.java:633)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutor.acces
s$300(AmazonHttpClient.java:601)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient$RequestExecutionBuild
erImpl.execute(AmazonHttpClient.java:583)
at com.cloudera.director.aws.shaded.com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpCli
ent.java:447)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.doInvoke(Amazo
nRDSClient.java:5060)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.invoke(AmazonR
DSClient.java:5036)
at com.cloudera.director.aws.shaded.com.amazonaws.services.rds.AmazonRDSClient.createDBInstan
ce(AmazonRDSClient.java:1131)
at com.cloudera.director.aws.rds.RDSProvider.allocate(RDSProvider.java:332)
at com.cloudera.director.aws.rds.RDSProvider.allocate(RDSProvider.java:65)
at com.cloudera.launchpad.pluggable.database.PluggableDatabaseServerProvider.allocate(Pluggab
leDatabaseServerProvider.java:325)
at com.cloudera.launchpad.pluggable.database.PluggableDatabaseServerProvider.create(Pluggable
DatabaseServerProvider.java:159)
at com.cloudera.launchpad.model.database.AbstractExternalDatabaseServerProvider.create(Abstra
ctExternalDatabaseServerProvider.java:26)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers.run(AllocateExte
rnalDatabaseServers.java:95)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers.run(AllocateExte
rnalDatabaseServers.java:36)
at com.cloudera.launchpad.pipeline.job.Job2.runUnchecked(Job2.java:31)
at com.cloudera.launchpad.pipeline.job.Job2$$FastClassBySpringCGLIB$$54178502.invoke(<generat
ed>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(Cgli
bAopProxy.java:721)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:157)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocati
onProceedingJoinPoint.java:97)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler$1.call(PipelineJobProfiler.java:67)
at com.codahale.metrics.Timer.time(Timer.java:101)
at com.cloudera.launchpad.pipeline.PipelineJobProfiler.profileJobRun(PipelineJobProfiler.java
:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(Abst
ractAspectJAdvice.java:629)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAd
vice.java:618)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:179)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInt
erceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvoc
ation.java:179)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibA
opProxy.java:656)
at com.cloudera.launchpad.bootstrap.database.AllocateExternalDatabaseServers$$EnhancerBySprin
gCGLIB$$e0e41ce.runUnchecked(<generated>)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:1
97)
at com.cloudera.launchpad.pipeline.util.PipelineRunner$JobCallable.call(PipelineRunner.java:1
68)
at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.j
ava:78)
at com.github.rholder.retry.Retryer.call(Retryer.java:160)
at com.cloudera.launchpad.pipeline.util.PipelineRunner.attemptMultipleJobExecutionsWithRetrie
s(PipelineRunner.java:133)
at com.cloudera.launchpad.pipeline.DatabasePipelineRunner.run(DatabasePipelineRunner.java:157
)
at com.cloudera.launchpad.ExceptionHandlingRunnable.run(ExceptionHandlingRunnable.java:57)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

Cloudera Employee
Posts: 40
Registered: ‎02-18-2014

Re: Director on RDS AWS external database creation

The set of available RDS instance classes depends on the region. For example, db.m3.medium is available in us-east-1 but not in ap-south-1.

New Contributor
Posts: 3
Registered: ‎07-08-2016

Re: Director on RDS AWS external database creation

Got the issue, there was a problem to rerun the below command,

 

cloudera-director bootstrap-remote /tmp/small_cdh_cd_bootstrap.conf --lp.remote.username=admin --lp.remote.password=admin --lp.remote.hostAndPort=localhost:7189

 

Since the external DB template was accepted, its still there in the same environment, else i have to modify the cluster, i have deleted the old environment and redeployed the same. 

 

Thanks 

Announcements