Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Getting issue with cloudbreak and openstack configuration

Highlighted

Getting issue with cloudbreak and openstack configuration

Getting issue with cloudbreak and openstack configuration, followed the hortonworks document but still getting the issue. Need help and guidance on how to launch cluster through cloudbreak using OpenStack? @khorvath @mmolnar @bbihari @Mathieu Perochon @Janos Matyas @rdoktorics

9 REPLIES 9
Highlighted

Re: Getting issue with cloudbreak and openstack configuration

We can provide you some suggestions if you have a specific issue or error that you document here in the question with logs. Otherwise it is pretty difficult to provide any guidance in addition to the docs.

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

Expert Contributor

Could you please explain what is your issue? Otherwise really hard to tell what went wrong.

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

Hi,

I already installed Openstack queen version on single node VM (RHEL 7.4) and cloudbreak 2.7.1 on another VM. I created the credentials in cloudbreak but still not able to spin up the cluster through cloudbreak as getting an error: image copy failed

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

I installed Openstack (queen) on single node (RHEL7.4) and cloudbreak on another node. Also created the credentials in cloudbreak but still not able to spin up the cluster through cloudbreak as getting an error: image copy failed. @rkovacs

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

Expert Contributor

What is the result of the following command on your Cloudbreak machine?

curl -I http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-31-1807111345.img
Highlighted

Re: Getting issue with cloudbreak and openstack configuration

Hi @rkovacs,

Thanks.

Please find the output:

HTTP/1.1 200 OK Content-Type: binary/octet-stream Content-Length: 12026642432 Connection: keep-alive Date: Wed, 12 Sep 2018 14:32:10 GMT Last-Modified: Wed, 11 Jul 2018 12:15:23 GMT ETag: "d863b6fd5098be37a55b2597d76fef20-1434" Accept-Ranges: bytes Server: AmazonS3 X-Cache: Miss from cloudfront Via: 1.1 4a55d86b7263f73c6817c7c25d4b3643.cloudfront.net (CloudFront) X-Amz-Cf-Id: RIjSH7neV7s5aVhEkETsg4QCzkDubjg-V7WZzR521gkCO2dk4nyUoQ==

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

Expert Contributor

Hi,

Do you see any Cloudbreak related image in your Openstack deployment?

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

I'm getting the same issue. I know Openstack Queen is not in the supported list of supported OS releases but I have no other choices for now.

Cluster deployment fails with :

cloudbreak_1   | 2018-10-04 14:05:26,663 [reactorDispatcher-76] handleImageNotFound:64 INFO  c.s.c.c.o.c.OpenStackImageVerifier - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Available images: Cirros-0.3.5, entry: GlanceImage{id=a22da222-76d2-421a-b5e4-bdf36007bfd9, name=Cirros-0.3.5, tags=[], imageStatus=ACTIVE, containerFormat=BARE, diskFormat=QCOW2, createdAt=Wed Sep 13 12:18:49 UTC 2017, updatedAt=Tue Mar 27 12:41:21 UTC 2018, minDisk=1, minRam=0, isProtected=true, checksum=f8ab98ff5e73ebab884d80c9dc9c7290, owner=17ed6d01ebee40ae89fa35f462bdd027, visibility=PUBLIC, size=13267968, locations=null, directUrl=file:///var/lib/glance/images/a22da222-76d2-421a-b5e4-bdf36007bfd9, self=/v2/images/a22da222-76d2-421a-b5e4-bdf36007bfd9, file=/v2/images/a22da222-76d2-421a-b5e4-bdf36007bfd9/file, schema=/v2/schemas/image, architecture=x86_64, instanceUuid=null, kernelId=null, osVersion=null, osDistro=null, ramdiskId=null, virtualSize=null}
cloudbreak_1   | 2018-10-04 14:05:26,664 [reactorDispatcher-76] handleImageNotFound:67 WARN  c.s.c.c.o.c.OpenStackImageVerifier - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] OpenStack image: cb-hdp-26-1807091850 not found
cloudbreak_1   | 2018-10-04 14:05:26,665 [reactorDispatcher-76] importImage:35 INFO  c.s.c.c.o.c.OpenStackImageImporter - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Import OpenStack image from: http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-26-1807091850.img
cloudbreak_1   | 2018-10-04 14:05:26,665 [reactorDispatcher-76] isAccessible:33 INFO  c.s.c.c.s.u.UrlAccessValidationService - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Validation of url access: http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-26-1807091850.img
cloudbreak_1   | 2018-10-04 14:05:26,737 [reactorDispatcher-76] importImage:42 INFO  c.s.c.c.o.c.OpenStackImageImporter - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Executing of the following import Task: {image_properties={name=cb-hdp-26-1807091850, disk_format=qcow2, container_format=bare}, import_from=http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-26-1807091850.img, import_from_format=qcow2}
cloudbreak_1   | 2018-10-04 14:05:26,920 [reactorDispatcher-76] buildLogContextForReactorHandler:69 INFO  c.s.c.l.LogContextAspects - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] A Reactor event handler's 'accept' method has been intercepted: execution(Flow2Handler.accept(..)), MDC logger context is built.
cloudbreak_1   | 2018-10-04 14:05:26,937 [reactorDispatcher-76] execute:87 INFO  c.s.c.c.f.AbstractAction - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACKVIEW] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Stack: 3, flow state: IMAGESETUP_STATE, phase: service, execution time 1 sec
cloudbreak_1   | 2018-10-04 14:05:26,938 [reactorDispatcher-76] handleStackCreationFailure:213 ERROR c.s.c.c.f.s.p.a.StackCreationService - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACKVIEW] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Error during stack creation flow:
cloudbreak_1   | org.openstack4j.api.exceptions.ClientResponseException: Status: 403, Reason: Forbidden
cloudbreak_1   | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:38)
cloudbreak_1   | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:23)
cloudbreak_1   | at org.openstack4j.core.transport.HttpEntityHandler.handleLessThan500(HttpEntityHandler.java:101)
cloudbreak_1   | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:47)
cloudbreak_1   | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:24)
cloudbreak_1   | at org.openstack4j.connectors.jersey2.HttpResponseImpl.getEntity(HttpResponseImpl.java:63)
cloudbreak_1   | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:220)
cloudbreak_1   | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:202)
cloudbreak_1   | at org.openstack4j.openstack.image.v2.internal.TaskServiceImpl.create(TaskServiceImpl.java:45)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.openstack.common.OpenStackImageImporter.importImage(OpenStackImageImporter.java:43)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.openstack.common.OpenStackSetup.prepareImage(OpenStackSetup.java:51)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler.accept(PrepareImageHandler.java:47)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler.accept(PrepareImageHandler.java:21)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler$FastClassBySpringCGLIB$aaf961cd.invoke(<generated>)
cloudbreak_1   | at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
cloudbreak_1   | at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
cloudbreak_1   | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
cloudbreak_1   | at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
cloudbreak_1   | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
cloudbreak_1   | at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
cloudbreak_1   | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
cloudbreak_1   | at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler$EnhancerBySpringCGLIB$cd32b61.accept(<generated>)
cloudbreak_1   | at reactor.bus.EventBus$3.accept(EventBus.java:317)
cloudbreak_1   | at reactor.bus.EventBus$3.accept(EventBus.java:310)
cloudbreak_1   | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
cloudbreak_1   | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
cloudbreak_1   | at reactor.bus.EventBus.accept(EventBus.java:591)
cloudbreak_1   | at reactor.bus.EventBus.accept(EventBus.java:63)
cloudbreak_1   | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
cloudbreak_1   | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
cloudbreak_1   | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
cloudbreak_1   | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
cloudbreak_1   | at java.lang.Thread.run(Thread.java:748)
cloudbreak_1   | 2018-10-04 14:05:26,994 [reactorDispatcher-76] fireCloudbreakEvent:58 INFO  c.s.c.s.e.DefaultCloudbreakEventService - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACKVIEW] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Firing Cloudbreak event: entityId: 3, type: CREATE_FAILED, message: Infrastructure creation failed. Reason: Status: 403, Reason: Forbidden

I will try to import cb-hdp-26-1807091850.img manually in Glance as I'm able to download it via curl.

Highlighted

Re: Getting issue with cloudbreak and openstack configuration

Importing the image manually into Glance resolves the issue

Don't have an account?
Coming from Hortonworks? Activate your account here