Member since
08-02-2018
9
Posts
1
Kudos Received
0
Solutions
05-15-2019
04:16 PM
2019-05-08 01:24:04,992 [reactorDispatcher-7] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] x-amzn-RequestId: f7f264b9-712f-11e9-a979-d169bddc2a3f
2019-05-08 01:24:04,999 [reactorDispatcher-7] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Sending Request: POST https://ec2.us-gov-west-1.amazonaws.com / Parameters: ({"Action":["DescribeRegions"],"Version":["2016-11-15"]}Headers: (User-Agent: aws-sdk-java/1.11.273 Linux/3.10.0-862.11.6.el7.x86_64 OpenJDK_64-Bit_Server_VM/10.0.2+13-Debian-1 java/10.0.2 groovy/2.4.15, amz-sdk-invocation-id: 85a3c12e-1b73-ce84-094c-ddda8d68e5eb, )
2019-05-08 01:24:05,020 [reactorDispatcher-8] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Received successful response: 200, AWS Request ID: f7f5bfcf-712f-11e9-b63c-0faea1f3556c
2019-05-08 01:24:05,020 [reactorDispatcher-8] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] x-amzn-RequestId: f7f5bfcf-712f-11e9-b63c-0faea1f3556c
2019-05-08 01:24:05,023 [reactorDispatcher-8] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Sending Request: POST https://ec2.us-gov-west-1.amazonaws.com / Parameters: ({"Action":["DescribeRegions"],"Version":["2016-11-15"]}Headers: (User-Agent: aws-sdk-java/1.11.273 Linux/3.10.0-862.11.6.el7.x86_64 OpenJDK_64-Bit_Server_VM/10.0.2+13-Debian-1 java/10.0.2 groovy/2.4.15, amz-sdk-invocation-id: 56d1ec4a-eec2-80bd-cdb8-68e71d906e97, )
2019-05-08 01:24:06,296 [reactorDispatcher-7] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Received error response: com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 28c61c7c-2c9a-4b7a-be6c-7047bdedf19b)
2019-05-08 01:24:06,296 [reactorDispatcher-8] log:87 DEBUG c.a.request - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Received error response: com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 79d916f3-0be6-435d-a1df-62592105d3de)
2019-05-08 01:24:06,303 [reactorDispatcher-7] accept:46 WARN c.s.c.c.h.GetRegionsV2Handler - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Could not get regions from the cloud provider due to:
com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 28c61c7c-2c9a-4b7a-be6c-7047bdedf19b)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1639)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1304)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1056)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
at com.amazonaws.services.ec2.AmazonEC2Client.doInvoke(AmazonEC2Client.java:15928)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:15904)
at com.amazonaws.services.ec2.AmazonEC2Client.executeDescribeRegions(AmazonEC2Client.java:8467)
at com.amazonaws.services.ec2.AmazonEC2Client.describeRegions(AmazonEC2Client.java:8442)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources.regions(AwsPlatformResources.java:335)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$FastClassBySpringCGLIB$$e7d1374b.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.cache.interceptor.CacheInterceptor.lambda$invoke$0(CacheInterceptor.java:53)
at org.springframework.cache.interceptor.CacheAspectSupport.invokeOperation(CacheAspectSupport.java:337)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:392)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:317)
at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$EnhancerBySpringCGLIB$$9aaa5987.regions(<generated>)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:41)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:20)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$FastClassBySpringCGLIB$$8867751c.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$EnhancerBySpringCGLIB$$c4a0c015.accept(<generated>)
at reactor.bus.EventBus$3.accept(EventBus.java:317)
at reactor.bus.EventBus$3.accept(EventBus.java:310)
at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
at reactor.bus.EventBus.accept(EventBus.java:591)
at reactor.bus.EventBus.accept(EventBus.java:63)
at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:844)
2019-05-08 01:24:06,303 [reactorDispatcher-8] accept:46 WARN c.s.c.c.h.GetRegionsV2Handler - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:springLog] [id:] [name:] [tracking:] Could not get regions from the cloud provider due to:
com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 79d916f3-0be6-435d-a1df-62592105d3de)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1639)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1304)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1056)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
at com.amazonaws.services.ec2.AmazonEC2Client.doInvoke(AmazonEC2Client.java:15928)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:15904)
at com.amazonaws.services.ec2.AmazonEC2Client.executeDescribeRegions(AmazonEC2Client.java:8467)
at com.amazonaws.services.ec2.AmazonEC2Client.describeRegions(AmazonEC2Client.java:8442)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources.regions(AwsPlatformResources.java:335)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$FastClassBySpringCGLIB$$e7d1374b.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.cache.interceptor.CacheInterceptor.lambda$invoke$0(CacheInterceptor.java:53)
at org.springframework.cache.interceptor.CacheAspectSupport.invokeOperation(CacheAspectSupport.java:337)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:392)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:317)
at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$EnhancerBySpringCGLIB$$9aaa5987.regions(<generated>)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:41)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:20)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$FastClassBySpringCGLIB$$8867751c.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$EnhancerBySpringCGLIB$$c4a0c015.accept(<generated>)
at reactor.bus.EventBus$3.accept(EventBus.java:317)
at reactor.bus.EventBus$3.accept(EventBus.java:310)
at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
at reactor.bus.EventBus.accept(EventBus.java:591)
at reactor.bus.EventBus.accept(EventBus.java:63)
at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:844)
2019-05-08 01:24:06,321 [http-nio-8080-exec-1] getRegionsV2:319 INFO c.s.c.s.s.CloudParameterService - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:PlatformParameterV3] [id:1] [name:undefined] [tracking:fcb3d396-49a9-4ba2-a4ca-04ad97a9c2cb] Platform regions result: CloudPlatformResult{status=FAILED, statusReason='You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 28c61c7c-2c9a-4b7a-be6c-7047bdedf19b)', errorDetails=com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 28c61c7c-2c9a-4b7a-be6c-7047bdedf19b), request=GetPlatformRegionsRequestV2{}}
2019-05-08 01:24:06,327 [http-nio-8080-exec-1] getRegionsV2:321 WARN c.s.c.s.s.CloudParameterService - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:PlatformParameterV3] [id:1] [name:undefined] [tracking:fcb3d396-49a9-4ba2-a4ca-04ad97a9c2cb] Failed to get platform regions
com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 28c61c7c-2c9a-4b7a-be6c-7047bdedf19b)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1639)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1304)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1056)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
at com.amazonaws.services.ec2.AmazonEC2Client.doInvoke(AmazonEC2Client.java:15928)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:15904)
at com.amazonaws.services.ec2.AmazonEC2Client.executeDescribeRegions(AmazonEC2Client.java:8467)
at com.amazonaws.services.ec2.AmazonEC2Client.describeRegions(AmazonEC2Client.java:8442)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources.regions(AwsPlatformResources.java:335)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$FastClassBySpringCGLIB$$e7d1374b.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.cache.interceptor.CacheInterceptor.lambda$invoke$0(CacheInterceptor.java:53)
at org.springframework.cache.interceptor.CacheAspectSupport.invokeOperation(CacheAspectSupport.java:337)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:392)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:317)
at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$EnhancerBySpringCGLIB$$9aaa5987.regions(<generated>)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:41)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:20)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$FastClassBySpringCGLIB$$8867751c.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$EnhancerBySpringCGLIB$$c4a0c015.accept(<generated>)
at reactor.bus.EventBus$3.accept(EventBus.java:317)
at reactor.bus.EventBus$3.accept(EventBus.java:310)
at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
at reactor.bus.EventBus.accept(EventBus.java:591)
at reactor.bus.EventBus.accept(EventBus.java:63)
at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:844)
2019-05-08 01:24:06,337 [http-nio-8080-exec-7] getRegionsV2:319 INFO c.s.c.s.s.CloudParameterService - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:PlatformParameterV3] [id:1] [name:undefined] [tracking:0c2476ac-1c26-4cbb-a32f-81d00d403ed5] Platform regions result: CloudPlatformResult{status=FAILED, statusReason='You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 79d916f3-0be6-435d-a1df-62592105d3de)', errorDetails=com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 79d916f3-0be6-435d-a1df-62592105d3de), request=GetPlatformRegionsRequestV2{}}
2019-05-08 01:24:06,347 [http-nio-8080-exec-7] getRegionsV2:321 WARN c.s.c.s.s.CloudParameterService - [instance:07773199-45d0-4d69-9a67-f542f7e8ab4d] [type:PlatformParameterV3] [id:1] [name:undefined] [tracking:0c2476ac-1c26-4cbb-a32f-81d00d403ed5] Failed to get platform regions
com.amazonaws.services.ec2.model.AmazonEC2Exception: You are not authorized to perform this operation. (Service: AmazonEC2; Status Code: 403; Error Code: UnauthorizedOperation; Request ID: 79d916f3-0be6-435d-a1df-62592105d3de)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1639)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1304)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1056)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:743)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:717)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:699)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:667)
at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:649)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:513)
at com.amazonaws.services.ec2.AmazonEC2Client.doInvoke(AmazonEC2Client.java:15928)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:15904)
at com.amazonaws.services.ec2.AmazonEC2Client.executeDescribeRegions(AmazonEC2Client.java:8467)
at com.amazonaws.services.ec2.AmazonEC2Client.describeRegions(AmazonEC2Client.java:8442)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources.regions(AwsPlatformResources.java:335)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$FastClassBySpringCGLIB$$e7d1374b.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.cache.interceptor.CacheInterceptor.lambda$invoke$0(CacheInterceptor.java:53)
at org.springframework.cache.interceptor.CacheAspectSupport.invokeOperation(CacheAspectSupport.java:337)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:392)
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:317)
at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.aws.AwsPlatformResources$$EnhancerBySpringCGLIB$$9aaa5987.regions(<generated>)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:41)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler.accept(GetRegionsV2Handler.java:20)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$FastClassBySpringCGLIB$$8867751c.invoke(<generated>)
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:746)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.adapter.MethodBeforeAdviceInterceptor.invoke(MethodBeforeAdviceInterceptor.java:52)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.sequenceiq.cloudbreak.cloud.handler.GetRegionsV2Handler$$EnhancerBySpringCGLIB$$c4a0c015.accept(<generated>)
at reactor.bus.EventBus$3.accept(EventBus.java:317)
at reactor.bus.EventBus$3.accept(EventBus.java:310)
at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72)
at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51)
at reactor.bus.EventBus.accept(EventBus.java:591)
at reactor.bus.EventBus.accept(EventBus.java:63)
at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160)
at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1135)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
at java.base/java.lang.Thread.run(Thread.java:844)
... View more
05-08-2019
12:43 PM
Hi, We are trying to use Cloudbreak 2.9.0 in AWS Gov Cloud and have set up the Roles as per the documentation. How ever when we tried to create a Cluster we are getting the following Errors. cloudbreak/v3/1/connectors/encryptionkeys 400 Failed to get encryption keys for the cloud provider
cloudbreak/v3/1/connectors/recommendation 400 Failed to get VM types for the cloud provider Not sure why only these two calls are failing. Rest of the REST EndPoints are working as expected ( /networks , /ippols, /disktypes etc). Thanks Sateesh
... View more
Labels:
05-01-2019
08:30 PM
I have enabled the DEBUG logging for http headers and http wire and i am seeing the contents of the payload (Request Body -> Form) in the logs. 2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "HTTP/1.1 200 OK[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "Cache-Control: no-cache, no-store, must-revalidate, max-age=0[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "Pragma: no-cache[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "Expires: Thu, 01 Jan 1970 00:00:00 GMT[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "Content-Type: text/html;charset=UTF-8[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "Transfer-Encoding: chunked[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "Date: Tue, 30 Apr 2019 17:20:37 GMT[\r][\n]"
2019-04-30 17:20:37,137 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "f4[\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9][0x9]<div>form is defined with 0 variable(s)</div>[\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9][0x9][\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9][0x9]<div>url is defined with 0 variable(s)</div>[\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9][0x9][\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[\r][\n]"
2019-04-30 17:20:37,138 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9]<form action="#" method="post">[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9][0x9]<input type="text" value="value" name="value1" id="value1"/>[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9][0x9]<button>Submit</button>[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[0x9]</form>[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "0[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.wire (Wire.java:wire(73)) - http-outgoing-585 << "[\r][\n]"
2019-04-30 17:20:37,139 DEBUG http.headers (LoggingManagedHttpClientConnection.java:onResponseReceived(122)) - http-outgoing-585 << HTTP/1.1 200 OK
2019-04-30 17:20:37,139 DEBUG http.headers (LoggingManagedHttpClientConnection.java:onResponseReceived(125)) - http-outgoing-585 << Cache-Control: no-cache, no-store, must-revalidate, max-age=0
2019-04-30 17:20:37,140 DEBUG http.headers (LoggingManagedHttpClientConnection.java:onResponseReceived(125)) - http-outgoing-585 << Pragma: no-cache
2019-04-30 17:20:37,140 DEBUG http.headers (LoggingManagedHttpClientConnection.java:onResponseReceived(125)) - http-outgoing-585 << Expires: Thu, 01 Jan 1970 00:00:00 GMT
2019-04-30 17:20:37,140 DEBUG http.headers (LoggingManagedHttpClientConnection.java:onResponseReceived(125)) - http-outgoing-585 << Content-Type: text/html;charset=UTF-8
2019-04-30 17:20:37,140 DEBUG http.headers (LoggingManagedHttpClientConnection.java:onResponseReceived(125)) - http-outgoing-585 << Transfer-Encoding: chunked Not sure whether i need an explicit rewrite rule to send the Request body to the target Service. At least from this log it is clear that Knox is getting the Request Body. I am pretty sure the Target Service is not getting the request body. Appreciate any help. Thanks Sateesh
... View more
05-01-2019
08:30 PM
Hi All, I have a custom service configured behind Knox Gateway and when i issue POST Requests the target Service is not getting any Request Body Params. Here is the config i have used for setting up a Custom Service behind Knox. My Topology is : <topology>
<gateway>
<provider>
<role>webappsec</role>
<name>WebAppSec</name>
<enabled>true</enabled>
<param>
<name>cors.enabled</name>
<value>true</value>
</param>
<param>
<name>cors.supportedMethods</name>
<value>GET,HEAD,POST,OPTIONS,PUT</value>
</param>
<param>
<name>xframe.options.enabled</name>
<value>true</value>
</param>
<param>
<name>xframe.options</name>
<value>SAMEORIGIN</value>
</param>
</provider>
<provider>
<role>identity-assertion</role>
<name>Default</name>
<enabled>true</enabled>
</provider>
<service>
<role>MYSERVICE</role>
<url>http://localhost:9090</url>
</service>
</topology> and the Service it self is described as <service role="MYSERVICE" name="myservice" version="0.0.1">
<policies>
<policy role="webappsec"/>
<policy role="authentication" name="Anonymous"/>
<policy role="rewrite"/>
<policy role="authorization"/>
</policies>
<routes>
<route path="/myservice"/>
<route path="/myservice/**"/>
</routes>
<dispatch classname="org.apache.hadoop.gateway.dispatch.PassAllHeadersDispatch"/>
</service> and here are the rewrite Rules. <rules>
<rule dir="IN" name="MYSERVICE/ myservice/inbound" pattern="*://*:*/**/ myservice/{path=**}?{**}">
<rewrite template="{$serviceUrl[MYSERVICE]}/{path=**}?{**}"/>
</rule>
<rule dir="IN" name="MYSERVICE/myservice/inbound/root" pattern="*://*:*/**/myservice/">
<rewrite template="{$serviceUrl[MYSERVICE]}/"/>
</rule>
<rule dir="IN" name="MYSERVICE/myservice/inbound/path" pattern="*://*:*/**/myservice/{**}">
<rewrite template="{$serviceUrl[MYSERVICE]}/{**}"/>
</rule>
</rules> When i tried access the Service GET Requests are working as expected. POST requests are also routed to the service how ever the POST Body is not getting sent to the target service. Not sure what's the issue is.
... View more
Labels:
12-31-2018
08:05 PM
Hi, We would like to deploy lot of web applications on the Edge Node(s) in our HDP Cluster (2.6.5) and enabled JWT Token in knox. All these app will be proxied through the knox gateway. When we inspected the JWT Token all we are getting is the subject (username) and expiration time and issuer (KNOXSSO in our case) info. How ever we would like to enforce Auth Rules with in these web apps/ services we are planning to deploy on Edge Node. As the Policies are already defined in Ranger is there a way we can get the policies that apply to currently logged in user ? Or do we need to create a Ranger Plugin (If so can it be used for all the different services deployed on edge nodes). For ex the in built Hive View, Files View are interacting with Ranger using plugins. Does this mean we need to have a separate plugin for each service ? Also even if a single plugin can be applied to all these services isn't it a requirement that these services be managed by Ambari ? ( In our case there are different services some nodejs based ui apps and spring boot based services etc). Also how trivial is making these nodejs and spring boot services to convert to ambari manageable services ? Appreciate any pointers to documentation w.r.to this use case. Thanks Sateesh
... View more
Labels:
08-20-2018
12:17 PM
Never mind i am able to query and get the response back. The date being referenced has some avro files which are are conforming to the schema.
... View more
08-16-2018
05:59 PM
1 Kudo
Hi, Thanks for quick response. Yes i changed the processor to SelectHiveQL and it is still throwing the NullPointerException. Yes i selected the wrong processor. But how ever the error was due to not able to connect to Hive Server. 2018-08-16 13:53:48,941 ERROR [Timer-Driven Process Thread-9] o.a.nifi.processors.hive.SelectHiveQL SelectHiveQL[id=43dbea09-0165-1000-b3c3-ee2edf7cd302] org.apache.nifi.processors.hive.SelectHiveQL$$Lambda$534/1002654252@5d81e50c failed to process due to java.lang.NullPointerException; rolling back session: {}
java.lang.NullPointerException: null
at org.apache.thrift.transport.TSocket.open(TSocket.java:170)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
... View more
08-16-2018
04:11 PM
Hi, I am trying to use PutHiveQL in my Nifi (1.5.0) in HDP 2.6.5.0 and getting a NullPointerException. Here is what i have configured. 2018-08-16 11:53:08,370 INFO [Timer-Driven Process Thread-8] o.a.c.f.imps.CuratorFrameworkImpl Starting
2018-08-16 11:53:08,372 INFO [Timer-Driven Process Thread-8-EventThread] o.a.c.f.state.ConnectionStateManager State change: CONNECTED
2018-08-16 11:53:08,372 INFO [Timer-Driven Process Thread-8] o.a.hive.jdbc.ZooKeeperHiveClientHelper Selected HiveServer2 instance with uri: hive.server2.authentication=NONE;hive.server2.transport.mode=binary;hive.server2.thrift.sasl.qop=auth;hive.server2.thrift.bind.host=ip-10-0-11-XXX.us-west-1.compute.internal;hive.server2.thrift.port=10000;hive.server2.use.SSL=false
2018-08-16 11:53:08,372 INFO [Curator-Framework-0] o.a.c.f.imps.CuratorFrameworkImpl backgroundOperationsLoop exiting
2018-08-16 11:53:08,373 INFO [Timer-Driven Process Thread-8] org.apache.hive.jdbc.Utils Resolved authority: hive.server2.authentication=NONE;hive.server2.transport.mode=binary;hive.server2.thrift.sasl.qop=auth;hive.server2.thrift.bind.host=ip-10-0-11-XXX.us-west-1.compute.internal;hive.server2.thrift.port=10000;hive.server2.use.SSL=false
2018-08-16 11:53:08,374 INFO [Timer-Driven Process Thread-8] org.apache.hive.jdbc.HiveConnection Will try to open client transport with JDBC Uri: jdbc:hive2://hive.server2.authentication=NONE;hive.server2.transport.mode=binary;hive.server2.thrift.sasl.qop=auth;hive.server2.thrift.bind.host=ip-10-0-11-XXX.us-west-1.compute.internal;hive.server2.thrift.port=10000;hive.server2.use.SSL=false/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
2018-08-16 11:53:08,374 ERROR [Timer-Driven Process Thread-8] o.apache.nifi.processors.hive.PutHiveQL PutHiveQL[id=4360aed5-0165-1000-0194-15362e7113fe] Failed to execute due to java.lang.NullPointerException: java.lang.NullPointerException
java.lang.NullPointerException: null
at org.apache.thrift.transport.TSocket.open(TSocket.java:170)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:266)
at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37)
at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204)
at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176)
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at org.apache.commons.dbcp.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:38)
at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:582)
at org.apache.commons.dbcp.BasicDataSource.validateConnectionFactory(BasicDataSource.java:1556)
at org.apache.commons.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1545)
at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1388)
at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044)
at org.apache.nifi.dbcp.hive.HiveConnectionPool.getConnection(HiveConnectionPool.java:312)
at sun.reflect.GeneratedMethodAccessor425.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.controller.service.StandardControllerServiceInvocationHandler.invoke(StandardControllerServiceInvocationHandler.java:89)
at com.sun.proxy.$Proxy151.getConnection(Unknown Source)
at org.apache.nifi.processors.hive.PutHiveQL.lambda$new$1(PutHiveQL.java:191)
at org.apache.nifi.processor.util.pattern.Put.onTrigger(Put.java:96)
at org.apache.nifi.processors.hive.PutHiveQL.lambda$onTrigger$6(PutHiveQL.java:274)
at org.apache.nifi.processor.util.pattern.PartialFunctions.onTrigger(PartialFunctions.java:114)
at org.apache.nifi.processor.util.pattern.RollbackOnFailure.onTrigger(RollbackOnFailure.java:184)
at org.apache.nifi.processors.hive.PutHiveQL.onTrigger(PutHiveQL.java:274)
at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1122)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:147)
at org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
at org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:128)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Here is the test Nifi Workflow i am using to test hive connection My Generate flow file has a simple "Select count(*) from Table_1" Statement. Here is the Configuration i have used for HiveConnectionPool Database Connection URL = jdbc:hive2://10.0.1.XXX:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2 Hive Configuration Resources: /etc/hadoop/conf/core-site.xml,/etc/hadoop/conf/hdfs-site.xml,/etc/hive2/conf/hive-site.xml Database User: No Value set Password : No Value Set Thanks Sateesh
... View more
Labels:
08-02-2018
02:44 PM
Hi All, I am storing AVRO Data into HDFS whose schemas are complex ( With lots of nested Complex Types). I am able to create the Hive Table without any Issues and when i run the Hive Query to describe the tables the Column data types (Struct) is getting displayed as expected. How ever when i query for the column of a record type i am getting null as response even though there is data. We are using HDP3.1 Thanks Sateesh
... View more
Labels:
