Reply
New Contributor
Posts: 4
Registered: ‎03-11-2018

Mini cluster setup CDH5.13.1

Hi! I'm trying to setup a mini cluster with CDH5.13.1 for some experiments but unfortunately I always receive this error when running "run-all.sh":

impala@impala:/Impala$ testdata/bin/run-all.sh
Killing running services...
Starting cluster services...
Stopping kudu
Stopping kms
Stopping yarn
Stopping hdfs
Starting hdfs (Web UI - http://localhost:5070)
Failed to start hdfs-datanode. The end of the log (/Impala/testdata/cluster/cdh5/node-1/var/log/hdfs-datanode.out) is:
Failed to start hdfs-datanode. The end of the log (/Impala/testdata/cluster/cdh5/node-3/var/log/hdfs-datanode.out) is:
Failed to start hdfs-datanode. The end of the log (/Impala/testdata/cluster/cdh5/node-2/var/log/hdfs-datanode.out) is:
Namenode started
Error in /Impala/testdata/bin/run-mini-dfs.sh at line 40: $IMPALA_HOME/testdata/cluster/admin start_cluster
Error in testdata/bin/run-all.sh at line 42: tee ${IMPALA_CLUSTER_LOGS_DIR}/run-mini-dfs.log

As you can see, all node logs are empty. run-mini-dfs.log provides following information:

Error in /Impala/testdata/bin/run-mini-dfs.sh at line 40: $IMPALA_HOME/testdata/cluster/admin start_cluster

I don't know what's wrong with the start_cluster function. 

 

Further information:
Build: ./buildall.sh -notests -so -start_minicluster
Ubuntu 14.04

I hope you can help me to fix the problem.

New Contributor
Posts: 4
Registered: ‎03-11-2018

Re: Mini cluster setup CDH5.13.1

Does anyone have an idea what the problem might be? I'm stuck at this point :/ 

New Contributor
Posts: 4
Registered: ‎03-11-2018

Re: Mini cluster setup CDH5.13.1

I get the same error with Ubuntu 16.04 and the newest Impala version.

Cloudera Employee
Posts: 1
Registered: ‎11-03-2016

Re: Mini cluster setup CDH5.13.1

Not having seen detailed logs, I'm just throwing out two quick ideas:

1. The minicluster looks quite broken; I wonder if it is a configuration problem. I would first try running bin/create-test-configuration.sh to fix the configuration:

 

  $ # After sourcing bin/impala-config.sh:

  $ bin/create-test-configuration.sh

 

then try starting the minicluster.

 

2. Generally I would suggest avoiding the "-so" switch for buildall.sh: there are multiple outstanding Jiras about the shared-object build not working properly. Building statically linked Impala binaries gives you less artifacts to copy, although the build takes longer.

 

Let me know if this was any help,

 

  - Laszlo

Announcements