1) Remember all data nodes should be healthy to perform this activity, if any disk failure is there, it will throw error like this; ERROR tools.DiskBalancerCLI: java.lang.IllegalArgumentException 2) ERROR tools.DiskBalancerCLI: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.diskbalancer.DiskBalancerException): Disk Balancer is not enabled. add property in HDFS configuration >> dfs.disk.balancer.enabled << under HDFS Service Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml, value = true 3) ERROR tools.DiskBalancerCLI: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied. login through datanode keytab; cd /var/run/cloudera-scm-agent/process && find . -type f -iname "hdfs.keytab" kinit -k -t ./52821-hdfs-DATANODE/hdfs.keytab -p hdfs/hostname@SOME_REALM.COM ... View more

Hello   I am having the same issue,  I get the 3 instances provisioned but I get   module.cdh.aws_instance.cdh_cl-instance (remote-exec): [2017-12-14 03:42:55] INFO [pipeline-thread-5] - c.c.l.pipeline.util.PipelineRunner: >> AllocateInstances$GetSuccessfulInstancesAndTerminateFailedInstances/4 [Environment{name='C5-Reference-AWS Environment', provider=InstanceProviderConfig{type='aws'}, crede ... module.cdh.aws_instance.cdh_cl-instance (remote-exec): [2017-12-14 03:42:55] INFO [pipeline-thread-5] - c.c.l.bootstrap.AllocateInstances: All requested instances failed. module.cdh.aws_instance.cdh_cl-instance (remote-exec): [2017-12-14 03:42:55] INFO [pipeline-thread-5] - c.c.l.bootstrap.AllocateInstances: Minimum number of instances (1) not available. Terminating available instances (0) as well. module.cdh.aws_instance.cdh_cl-instance (remote-exec): [2017-12-14 03:42:56] ERROR [pipeline-thread-5] - c.c.l.pipeline.util.PipelineRunner: Attempt to execute job failed module.cdh.aws_instance.cdh_cl-instance (remote-exec): com.cloudera.launchpad.pipeline.UnrecoverablePipelineError: Insufficient number of instances available in time 20 MINUTES module.cdh.aws_instance.cdh_cl-instance (remote-exec): at com.cloudera.launchpad.bootstrap.AllocateInstances$GetSuccessfulInstancesAndTerminateFailedInstances.run(AllocateInstances.java:294) ~[launchpad-bootstrap-1.5.0.jar!/:1.5.0] module.cdh.aws_instance.cdh_cl-instance (remote-exec): at com.cloudera.launchpad.bootstrap.AllocateInstances$GetSuccessfulInstancesAndTerminateFailedInstances.run(AllocateInstances.java:253) ~[launchpad-bootstrap-1.5.0.jar!/:1.5.0]   I set minCount to 1 as with 0 threw me an error as well, I am attempting to do this via a script, if theres no fix yet could you please tell me how to retry via the .conf file as I havent succeded. ... View more

I have the beginning of Flask based REST api I was working on before my project got discontinued. I tried my best to follow the Director API routes. I'll upload it to Github and share the link here. ... View more