Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.
geniuszhe
Explorer

Re: Impala - alternative way to install

by Explorer in Support Questions
‎02-06-2018 01:23 AM
‎02-06-2018 01:23 AM
Impala rely on Cloudrea Hbase Jar ,please use relevant jar. ... View more

Re: NiFi-1.1.0 "zookeeper.KeeperException$Connecti...

by Explorer in Support Questions
‎10-30-2017 05:12 AM
‎10-30-2017 05:12 AM
Thanks.Are your cluster stable? ... View more

Re: NiFi-1.1.0 "zookeeper.KeeperException$Connecti...

by Explorer in Support Questions
‎10-27-2017 05:12 AM
‎10-27-2017 05:12 AM
Hi, Have you solved this problem? I have met the same problem. ... View more

Re: compile ambari-2.4.2.0 error

by Explorer in Support Questions
‎03-30-2017 08:09 AM
‎03-30-2017 08:09 AM
Why not use existed rpm ? http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.4.2.0/ambari-2.4.2.0-centos7.tar.gz ... View more

Re: Cloudbreak cluster creation in Openstack faili...

by Explorer in Support Questions
‎03-30-2017 07:05 AM
‎03-30-2017 07:05 AM
I have successfully installed cloudbreak ,Thank you very much ... View more

Re: Cloudbreak cluster creation in Openstack faili...

by Explorer in Support Questions
‎03-30-2017 06:05 AM
‎03-30-2017 06:05 AM
Thanks. I go to try ... View more

Cloudbreak cluster creation in Openstack failing

by Explorer in Support Questions
‎03-30-2017 05:47 AM
‎03-30-2017 05:47 AM
I created cluster using hdp-small-default blueprint, I got errors,cluster status show: Cluster installation failed to complete, please check the Ambari UI for more details. You can try to reinstall the cluster with a different blueprint or fix the failures in Ambari and sync the cluster with Cloudbreak later. cloudbreak logs : /cbreak_traefik_1 | time="2017-03-30T04:03:48Z" level=debug msg="Round trip: http://172.17.0.10:3000, code: 200, duration: 2.164172ms tls:version: 303, tls:resume:false, tls:csuite:c02f, tls:server:" /cbreak_cloudbreak_1 | 2017-03-30 04:03:48,647 [reactorDispatcher-98] pollWithTimeout:34 WARN c.s.c.s.PollingService - [owner:ae2e5c22-25b0-4283-aeb3-dcc06aa706ab] [type:STACK] [id:29] [name:bigdata2] Exception occurred in the polling: Ambari operation failed: [component: 'CLUSTER_INSTALL', requestID: '1'] /cbreak_cloudbreak_1 | com.sequenceiq.cloudbreak.service.cluster.AmbariOperationFailedException: Ambari operation failed: [component: 'CLUSTER_INSTALL', requestID: '1'] /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationsStatusCheckerTask.checkStatus(AmbariOperationsStatusCheckerTask.java:55) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationsStatusCheckerTask.checkStatus(AmbariOperationsStatusCheckerTask.java:22) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.PollingService.pollWithTimeout(PollingService.java:32) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationService.waitForOperations(AmbariOperationService.java:60) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationService.waitForOperations(AmbariOperationService.java:40) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariClusterConnector.waitForClusterInstall(AmbariClusterConnector.java:774) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariClusterConnector.buildAmbariCluster(AmbariClusterConnector.java:243) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.core.cluster.AmbariClusterCreationService.buildAmbariCluster(AmbariClusterCreationService.java:27) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.reactor.handler.cluster.InstallClusterHandler.accept(InstallClusterHandler.java:35) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.reactor.handler.cluster.InstallClusterHandler.accept(InstallClusterHandler.java:18) /cbreak_cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:317) /cbreak_cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:310) /cbreak_cloudbreak_1 | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72) /cbreak_cloudbreak_1 | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51) /cbreak_cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:591) /cbreak_cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:63) /cbreak_cloudbreak_1 | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160) /cbreak_cloudbreak_1 | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74) /cbreak_cloudbreak_1 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) /cbreak_cloudbreak_1 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) /cbreak_cloudbreak_1 | at java.lang.Thread.run(Thread.java:745) /cbreak_cloudbreak_1 | 2017-03-30 04:03:48,647 [reactorDispatcher-98] pollWithTimeout:39 INFO c.s.c.s.PollingService - [owner:ae2e5c22-25b0-4283-aeb3-dcc06aa706ab] [type:STACK] [id:29] [name:bigdata2] Polling failure reached the limit which was 5, poller will drop the last exception. /cbreak_cloudbreak_1 | 2017-03-30 04:03:48,647 [reactorDispatcher-98] handleException:94 ERROR c.s.c.s.c.f.AmbariOperationsStatusCheckerTask - [owner:ae2e5c22-25b0-4283-aeb3-dcc06aa706ab] [type:STACK] [id:29] [name:bigdata2] Ambari operation failed. /cbreak_cloudbreak_1 | com.sequenceiq.cloudbreak.service.cluster.AmbariOperationFailedException: Ambari operation failed: [component: 'CLUSTER_INSTALL', requestID: '1'] /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationsStatusCheckerTask.checkStatus(AmbariOperationsStatusCheckerTask.java:55) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationsStatusCheckerTask.checkStatus(AmbariOperationsStatusCheckerTask.java:22) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.PollingService.pollWithTimeout(PollingService.java:32) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationService.waitForOperations(AmbariOperationService.java:60) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariOperationService.waitForOperations(AmbariOperationService.java:40) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariClusterConnector.waitForClusterInstall(AmbariClusterConnector.java:774) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariClusterConnector.buildAmbariCluster(AmbariClusterConnector.java:243) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.core.cluster.AmbariClusterCreationService.buildAmbariCluster(AmbariClusterCreationService.java:27) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.reactor.handler.cluster.InstallClusterHandler.accept(InstallClusterHandler.java:35) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.reactor.handler.cluster.InstallClusterHandler.accept(InstallClusterHandler.java:18) /cbreak_cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:317) /cbreak_cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:310) /cbreak_cloudbreak_1 | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72) /cbreak_cloudbreak_1 | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51) /cbreak_cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:591) /cbreak_cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:63) /cbreak_cloudbreak_1 | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160) /cbreak_cloudbreak_1 | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74) /cbreak_cloudbreak_1 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) /cbreak_cloudbreak_1 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) /cbreak_cloudbreak_1 | at java.lang.Thread.run(Thread.java:745) /cbreak_cloudbreak_1 | 2017-03-30 04:03:48,647 [reactorDispatcher-98] buildAmbariCluster:261 ERROR c.s.c.s.c.f.AmbariClusterConnector - [owner:ae2e5c22-25b0-4283-aeb3-dcc06aa706ab] [type:STACK] [id:29] [name:bigdata2] Error while building the Ambari cluster. Message Cluster installation failed to complete, please check the Ambari UI for more details. You can try to reinstall the cluster with a different blueprint or fix the failures in Ambari and sync the cluster with Cloudbreak later., throwable: {} /cbreak_cloudbreak_1 | com.sequenceiq.cloudbreak.core.ClusterException: Cluster installation failed to complete, please check the Ambari UI for more details. You can try to reinstall the cluster with a different blueprint or fix the failures in Ambari and sync the cluster with Cloudbreak later. /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariClusterConnector.checkPollingResult(AmbariClusterConnector.java:302) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.service.cluster.flow.AmbariClusterConnector.buildAmbariCluster(AmbariClusterConnector.java:244) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.core.cluster.AmbariClusterCreationService.buildAmbariCluster(AmbariClusterCreationService.java:27) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.reactor.handler.cluster.InstallClusterHandler.accept(InstallClusterHandler.java:35) /cbreak_cloudbreak_1 | at com.sequenceiq.cloudbreak.reactor.handler.cluster.InstallClusterHandler.accept(InstallClusterHandler.java:18) /cbreak_cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:317) /cbreak_cloudbreak_1 | at reactor.bus.EventBus$3.accept(EventBus.java:310) /cbreak_cloudbreak_1 | at reactor.bus.routing.ConsumerFilteringRouter.route(ConsumerFilteringRouter.java:72) /cbreak_cloudbreak_1 | at reactor.bus.routing.TraceableDelegatingRouter.route(TraceableDelegatingRouter.java:51) /cbreak_cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:591) /cbreak_cloudbreak_1 | at reactor.bus.EventBus.accept(EventBus.java:63) /cbreak_cloudbreak_1 | at reactor.core.dispatch.AbstractLifecycleDispatcher.route(AbstractLifecycleDispatcher.java:160) /cbreak_cloudbreak_1 | at reactor.core.dispatch.MultiThreadDispatcher$MultiThreadTask.run(MultiThreadDispatcher.java:74) /cbreak_cloudbreak_1 | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) /cbreak_cloudbreak_1 | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) /cbreak_cloudbreak_1 | at java.lang.Thread.run(Thread.java:745) /cbreak_cloudbreak_1 | 2017-03-30 04:03:48,647 [reactorDispatcher-98] accept:70 DEBUG c.s.c.c.f.Flow2Handler - [owner:ae2e5c22-25b0-4283-aeb3-dcc06aa706ab] [type:STACK] [id:29] [name:bigdata2] flow control event arrived: key: INSTALLCLUSTERFAILED, flowid: 883edc2b-b90c-487f-a195-0438825af8f7, payload: com.sequenceiq.cloudbreak.reactor.api.event.cluster.InstallClusterFailed@1cc7b9f4 I view ambari web UI , I found all the services have installed . the HDFS service is not stable, NameNode frequently crashed down and restart .I found namenode out log: # # java.lang.OutOfMemoryError: Java heap space # -XX:OnOutOfMemoryError=""/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node" "/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node" "/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node"" # Executing /bin/sh -c ""/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node" "/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node" "/usr/hdp/current/hadoop-hdfs-namenode/bin/kill-name-node""... ERROR: Could not find a NameNode PID. ERROR: Could not find a NameNode PID. so I changed namenode Java heap space from 1GB to 2GB, all services are started successfully . the cloudbreak ui : How can I make this cluster show successfully? any help is appreciated.Thanks! ... View more
Labels:

Re: Cloudbreak security group for openstack

by Explorer in Support Questions
‎03-29-2017 07:56 AM
‎03-29-2017 07:56 AM
I use horzion web UI,projects->select admin -> manage members->quotas . this can modify admin security_group_rule ... View more

Re: Cloudbreak security group for openstack

by Explorer in Support Questions
‎03-29-2017 06:33 AM
‎03-29-2017 06:33 AM
Hi, I used this commad before,it doesn't work also.I use Mitaka version ,network rely on Neutron.Nova quota-update security-group-rules maybe not useful.Thank you all the way . ... View more

Cloudbreak security group for openstack

by Explorer in Support Questions
‎03-29-2017 02:59 AM
‎03-29-2017 02:59 AM
Hi, I created security group for openstack by all the ports. reference by follow: Hadoop services : Ambari (8080) Consul (8500) NN (50070) RM Web (8088) Scheduler (8030RM) IPC (8050RM) Job history server (19888)HBase master (60000) HBase master web (60010) HBase RS (16020) HBase RS info (60030) Falcon (15000) Storm (8744) Hive metastore (9083) Hive server (10000) Hive server HTTP (10001) Accumulo master (9999) Accumulo Tserver (9997) Atlas (21000) KNOX (8443) Oozie (11000) Spark HS (18080) NM Web (8042) Zeppelin WebSocket (9996) Zeppelin UI (9995) Kibana (3080) * Elasticsearch (9200) But when I created cluster ,errors came as follow: Failed to create the stack for CloudContext{id=25, name='bigdata', platform='StringType{value='OPENSTACK'}', owner='ae2e5c22-25b0-4283-aeb3-dcc06aa706ab'} due to: Resource CREATE failed: OverQuotaClient: resources.security_group_host_group_master_3: Quota exceeded for resources: ['security_group_rule']. Neutron server returns request_ids: ['req-cb14a5a6-1671-4087-bd3b-c48eca7aca67'] this error maybe my openstack quota security_group_rule set. How can I modify it? I have tried some commands: neutron quota-update --tenant_id admin --security_group_rule 200 openstack quota --secgroup_rules 200 admin these commads could't modify the security_group_rule successfuly. what shoud I do? any help is appreciated.Thanks! ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎02-06-2018 01:23 AM
Public Statistics
Date Registered ‎07-22-2016 06:13 AM
Last Visited ‎02-06-2018 01:23 AM
Total Messages Posted 17
Total Kudos Received 1