Getting issue with cloudbreak and openstack configuration

[#1]

Getting issue with cloudbreak and openstack configuration, followed the hortonworks document but still getting the issue. Need help and guidance on how to launch cluster through cloudbreak using OpenStack? @khorvath @mmolnar @bbihari @Mathieu Perochon @Janos Matyas @rdoktorics

[#2]

We can provide you some suggestions if you have a specific issue or error that you document here in the question with logs. Otherwise it is pretty difficult to provide any guidance in addition to the docs.

[#3]

Could you please explain what is your issue? Otherwise really hard to tell what went wrong.

[#4]

Hi,

I already installed Openstack queen version on single node VM (RHEL 7.4) and cloudbreak 2.7.1 on another VM. I created the credentials in cloudbreak but still not able to spin up the cluster through cloudbreak as getting an error: image copy failed

[#5]

I installed Openstack (queen) on single node (RHEL7.4) and cloudbreak on another node. Also created the credentials in cloudbreak but still not able to spin up the cluster through cloudbreak as getting an error: image copy failed. @rkovacs

[#6]

What is the result of the following command on your Cloudbreak machine?

curl -I http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-31-1807111345.img

[#7]

Hi @rkovacs,

Thanks.

Please find the output:

HTTP/1.1 200 OK Content-Type: binary/octet-stream Content-Length: 12026642432 Connection: keep-alive Date: Wed, 12 Sep 2018 14:32:10 GMT Last-Modified: Wed, 11 Jul 2018 12:15:23 GMT ETag: "d863b6fd5098be37a55b2597d76fef20-1434" Accept-Ranges: bytes Server: AmazonS3 X-Cache: Miss from cloudfront Via: 1.1 4a55d86b7263f73c6817c7c25d4b3643.cloudfront.net (CloudFront) X-Amz-Cf-Id: RIjSH7neV7s5aVhEkETsg4QCzkDubjg-V7WZzR521gkCO2dk4nyUoQ==

[#8]

Hi,

Do you see any Cloudbreak related image in your Openstack deployment?

[#9]

I'm getting the same issue. I know Openstack Queen is not in the supported list of supported OS releases but I have no other choices for now.

Cluster deployment fails with :

cloudbreak_1   | 2018-10-04 14:05:26,663 [reactorDispatcher-76] handleImageNotFound:64 INFO  c.s.c.c.o.c.OpenStackImageVerifier - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Available images: Cirros-0.3.5, entry: GlanceImage{id=a22da222-76d2-421a-b5e4-bdf36007bfd9, name=Cirros-0.3.5, tags=[], imageStatus=ACTIVE, containerFormat=BARE, diskFormat=QCOW2, createdAt=Wed Sep 13 12:18:49 UTC 2017, updatedAt=Tue Mar 27 12:41:21 UTC 2018, minDisk=1, minRam=0, isProtected=true, checksum=f8ab98ff5e73ebab884d80c9dc9c7290, owner=17ed6d01ebee40ae89fa35f462bdd027, visibility=PUBLIC, size=13267968, locations=null, directUrl=file:///var/lib/glance/images/a22da222-76d2-421a-b5e4-bdf36007bfd9, self=/v2/images/a22da222-76d2-421a-b5e4-bdf36007bfd9, file=/v2/images/a22da222-76d2-421a-b5e4-bdf36007bfd9/file, schema=/v2/schemas/image, architecture=x86_64, instanceUuid=null, kernelId=null, osVersion=null, osDistro=null, ramdiskId=null, virtualSize=null}
cloudbreak_1   | 2018-10-04 14:05:26,664 [reactorDispatcher-76] handleImageNotFound:67 WARN  c.s.c.c.o.c.OpenStackImageVerifier - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] OpenStack image: cb-hdp-26-1807091850 not found
cloudbreak_1   | 2018-10-04 14:05:26,665 [reactorDispatcher-76] importImage:35 INFO  c.s.c.c.o.c.OpenStackImageImporter - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Import OpenStack image from: http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-26-1807091850.img
cloudbreak_1   | 2018-10-04 14:05:26,665 [reactorDispatcher-76] isAccessible:33 INFO  c.s.c.c.s.u.UrlAccessValidationService - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Validation of url access: http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-26-1807091850.img
cloudbreak_1   | 2018-10-04 14:05:26,737 [reactorDispatcher-76] importImage:42 INFO  c.s.c.c.o.c.OpenStackImageImporter - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Executing of the following import Task: {image_properties={name=cb-hdp-26-1807091850, disk_format=qcow2, container_format=bare}, import_from=http://public-repo-1.hortonworks.com/HDP/cloudbreak/cb-hdp-26-1807091850.img, import_from_format=qcow2}
cloudbreak_1   | 2018-10-04 14:05:26,920 [reactorDispatcher-76] buildLogContextForReactorHandler:69 INFO  c.s.c.l.LogContextAspects - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACK] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] A Reactor event handler's 'accept' method has been intercepted: execution(Flow2Handler.accept(..)), MDC logger context is built.
cloudbreak_1   | 2018-10-04 14:05:26,937 [reactorDispatcher-76] execute:87 INFO  c.s.c.c.f.AbstractAction - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACKVIEW] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Stack: 3, flow state: IMAGESETUP_STATE, phase: service, execution time 1 sec
cloudbreak_1   | 2018-10-04 14:05:26,938 [reactorDispatcher-76] handleStackCreationFailure:213 ERROR c.s.c.c.f.s.p.a.StackCreationService - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACKVIEW] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Error during stack creation flow:
cloudbreak_1   | org.openstack4j.api.exceptions.ClientResponseException: Status: 403, Reason: Forbidden
cloudbreak_1   | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:38)
cloudbreak_1   | at org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:23)
cloudbreak_1   | at org.openstack4j.core.transport.HttpEntityHandler.handleLessThan500(HttpEntityHandler.java:101)
cloudbreak_1   | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:47)
cloudbreak_1   | at org.openstack4j.core.transport.HttpEntityHandler.handle(HttpEntityHandler.java:24)
cloudbreak_1   | at org.openstack4j.connectors.jersey2.HttpResponseImpl.getEntity(HttpResponseImpl.java:63)
cloudbreak_1   | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:220)
cloudbreak_1   | at org.openstack4j.openstack.internal.BaseOpenStackService$Invocation.execute(BaseOpenStackService.java:202)
cloudbreak_1   | at org.openstack4j.openstack.image.v2.internal.TaskServiceImpl.create(TaskServiceImpl.java:45)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.openstack.common.OpenStackImageImporter.importImage(OpenStackImageImporter.java:43)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.openstack.common.OpenStackSetup.prepareImage(OpenStackSetup.java:51)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler.accept(PrepareImageHandler.java:47)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler.accept(PrepareImageHandler.java:21)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler$FastClassBySpringCGLIB$aaf961cd.invoke(<generated>)
cloudbreak_1   | at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
cloudbreak_1   | at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
cloudbreak_1   | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
cloudbreak_1   | at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
cloudbreak_1   | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
cloudbreak_1   | at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
cloudbreak_1   | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
cloudbreak_1   | at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
cloudbreak_1   | at com.sequenceiq.cloudbreak.cloud.handler.PrepareImageHandler$EnhancerBySpringCGLIB$cd32b61.accept(<generated>)
cloudbreak_1   | at reactor.bus.EventBus$3.accept(EventBus.java:317)
cloudbreak_1   | at reactor.bus.EventBus$3.accept(EventBus.java:310)
cloudbreak_1   | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
cloudbreak_1   | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
cloudbreak_1   | at reactor.bus.EventBus.accept(EventBus.java:591)
cloudbreak_1   | at reactor.bus.EventBus.accept(EventBus.java:63)
cloudbreak_1   | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
cloudbreak_1   | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
cloudbreak_1   | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
cloudbreak_1   | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
cloudbreak_1   | at java.lang.Thread.run(Thread.java:748)
cloudbreak_1   | 2018-10-04 14:05:26,994 [reactorDispatcher-76] fireCloudbreakEvent:58 INFO  c.s.c.s.e.DefaultCloudbreakEventService - [owner:2ec305f7-89aa-4f5b-b13b-e9afca6af487] [type:STACKVIEW] [id:3] [name:hdp-test] [flow:5c475919-a4e1-4e02-bd5e-932e336e93c6] [tracking:] Firing Cloudbreak event: entityId: 3, type: CREATE_FAILED, message: Infrastructure creation failed. Reason: Status: 403, Reason: Forbidden

I will try to import cb-hdp-26-1807091850.img manually in Glance as I'm able to download it via curl.

[#10]

Importing the image manually into Glance resolves the issue