Member since
03-30-2018
7
Posts
3
Kudos Received
0
Solutions
04-05-2018
01:06 PM
Updating the Cloudbreak installation fixed the issue.
... View more
04-05-2018
01:05 PM
Yes, I have successfully upgraded my Cloudbreak installation and the problem is gone.
... View more
03-31-2018
03:05 PM
That's what I thought, just needed a confirmation. Thank you.
... View more
03-31-2018
08:07 AM
Hello, is it possible to add a a new instance group to a Cloudbreak-managed cluster? I have an HDP cluster set up and running (with more or less standard set of services - HDFS, Spark etc.). Now, I would like to extend it by adding a new instance group running Storm services. Is this possible, or do I have to recreate the whole cluster? thx, Leszek
... View more
Labels:
- Labels:
-
Hortonworks Cloudbreak
03-31-2018
08:04 AM
Thank you for your answers. @rdoktorics I am actually using Cloudbreak to manage two HDP clusters, and I was just checking the possibility of managing a Storm cluster with this tool. Is it possible to upgrade the current installation? I assume that the answer is "yes, follow the procedure from the webpage", but since it means moving between major versions there might be some hurdles.
... View more
03-30-2018
12:21 PM
3 Kudos
Hello,
Probably a bug: I have a Storm cluster set up using Cloudbreak. The cluster includes only the minimum set of services needed to run Storm (Nimbus, Supervisors, Zookeeper + Ambari Metrics) - blueprint attached. One of the instance groups includes only the Storm supervisors, and I want this group to be able to scale. Scaling up works properly. Scaling down is impossible, an error is thrown. Looking at the logs, I can see that (probably) Cloudbreak is trying to find Datanodes to decommission - but since the cluster doesn't include any, an error is thrown:
cloudbreak_1 | 2018-03-30 10:07:30,986 [reactorDispatcher-6] pollWithTimeout:30 INFO c.s.c.s.PollingService - [owner:990ffe52-4eb1-4fc6-a0ac-eb8c50db8751] [type:STACK] [id:12] [name:storm-min-4] Polling attempt 1.
cloudbreak_1 | 2018-03-30 10:07:30,986 [reactorDispatcher-6] getRawResource:79 INFO c.s.a.c.AmbariClientUtils - [owner:990ffe52-4eb1-4fc6-a0ac-eb8c50db8751] [type:STACK] [id:12] [name:storm-min-4] AmbariClient getRawResource, resourceRequestMap: {path=https://172.31.38.186:9443/api/v1/clusters/storm-min-4/services/HDFS/components/NAMENODE, query={fields=metrics/dfs/namenode/DecomNodes}}
cloudbreak_1 | 2018-03-30 10:07:31,006 [reactorDispatcher-6] getRawResource:86 ERROR c.s.a.c.AmbariClientUtils - [owner:990ffe52-4eb1-4fc6-a0ac-eb8c50db8751] [type:STACK] [id:12] [name:storm-min-4] Error occurred during GET request to {}, exception:
cloudbreak_1 | groovyx.net.http.HttpResponseException: Not Found
cloudbreak_1 | at groovyx.net.http.RESTClient.defaultFailureHandler(RESTClient.java:263)
//...
cloudbreak_1 | 2018-03-30 10:07:31,006 [reactorDispatcher-6] pollWithTimeout:34 WARN c.s.c.s.PollingService - [owner:990ffe52-4eb1-4fc6-a0ac-eb8c50db8751] [type:STACK] [id:12] [name:storm-min-4] Exception occurred in the polling: Text must not be null or empty
cloudbreak_1 | java.lang.IllegalArgumentException: Text must not be null or empty
cloudbreak_1 | at groovy.json.JsonSlurper.parseText(JsonSlurper.java:203)
cloudbreak_1 | at groovy.json.JsonSlurper$parseText.call(Unknown Source)
cloudbreak_1 | at com.sequenceiq.ambari.client.services.ServiceAndHostService$Trait$Helper.getDecommissioningDataNodes(ServiceAndHostService.groovy:227)
cloudbreak_1 | at com.sequenceiq.ambari.client.services.ServiceAndHostService$Trait$Helper$getDecommissioningDataNodes$3.call(Unknown Source)
cloudbreak_1 | at com.sequenceiq.ambari.client.AmbariClient.getDecommissioningDataNodes(AmbariClient.groovy)
//... Is there any way to bypass this issue without adding an HDFS node to the cluster? I am using Cloudbreak 1.16.5storm-min-blueprint.txt
... View more
Labels:
- Labels:
-
Hortonworks Cloudbreak