Reply
Cloudera Employee
Posts: 5
Registered: ‎08-16-2016

Re: Impala_kudu setup

[ Edited ]

Hi Azim,

 

I think there's some confusion here on your part.

 

In your orginal post, you tried to run this command without success...

 

 

sudo pip install cm-api

 

 

Let's break this command down.

 

  • sudo means "run with administrative privileges"
  • pip is a common tool used to install python packages, and has nothing to do specifically with Cloudera, impala, or kudu
  • install is the action you're asking pip to take
  • cm-api is the Cloudera Manager REST API client, which happens to be a python package. This is the thing you're trying to install.

 

 

The command you were trying to run in essence said, "Using the pip tool with administrative privileges, install the cm-api python package."

 

The command failed because your system does not have pip installed. Again, this has nothing to do with Cloudera, impala, or kudu. pip is simply not available on your system. We tried a couple of things to add pip to your system, but it seems like there is some kind of security setup at your site that prevented us from doing so.

 

So as a workaround, I gave you an alternative method for installing cm-api that didn't require using pip. This apparently worked. You still don't have pip, so there's no reason to believe that running pip -V should work.

 

Does that make sense?

Explorer
Posts: 23
Registered: ‎09-28-2016

Re: Impala_kudu setup

[ Edited ]

Thanks i was able to install impala_kudu service with deploy.py script.

Now i am haveing some issues with impala demon communicating with impala_kudu, i am getting following error: Can anyone help on this 

conf/hbase-env.sh
+ JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -n '' ]]
+ FLAG_FILE=/var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/impala-conf/impalad_flags
+ USE_DEBUG_BUILD=false
+ replace_conf_dir
+ find /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD -type f '!' -path '/var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/logs/*' '!' -name '*.log' '!' -name '*.keytab' '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/6574-impala-IMPALAD#g' '{}' ';'
Can't open /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/supervisor.conf: Permission denied.
+ make_scripts_executable
+ find /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';'
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/6574-impala-IMPALAD#g' /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/impala-conf/impalad_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}#/var/run/cloudera-scm-agent/cgroups/cpu#g' /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/impala-conf/impalad_flags
+ '[' -f /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/impala-conf/.htpasswd ']'
+ chmod 600 /var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/opt/cloudera/parcels/IMPALA_KUDU-2.7.0-2.cdh5.9.0.p0.109/lib/impala/sbin-retail
+ IMPALA_BIN=/opt/cloudera/parcels/IMPALA_KUDU-2.7.0-2.cdh5.9.0.p0.109/lib/impala/sbin-retail
+ [[ true = '' ]]
+ '[' impalad = impalad ']'
+ exec /opt/cloudera/parcels/IMPALA_KUDU-2.7.0-2.cdh5.9.0.p0.109/lib/impala/../../bin/impalad --flagfile=/var/run/cloudera-scm-agent/process/6574-impala-IMPALAD/impala-conf/impalad_flags
Redirecting stderr to /dfs01/log/impalad2/impalad.ERROR
 

Explorer
Posts: 23
Registered: ‎09-28-2016

Re: Impala_kudu setup

Any help is much appreciated guys...

Highlighted
Cloudera Employee
Posts: 31
Registered: ‎02-05-2016

Re: Impala_kudu setup

So it looks like you've made it as far as starting Impala_Kudu from CM. That's great. What is the error you see in CM?

There's no inherent error in the log you provided. Can you take a look at /dfs01/log/impalad2/impalad.ERROR? Anything interesting there? If not, let's look at /var/log/cloudera-scm-agent/cloudera-scm-agent.log.
Announcements