Reply
Highlighted
ojo
New Contributor
Posts: 3
Registered: ‎06-25-2014

Impala.1.3.2 - StateStore error

Hi,

 

I'm a Cloudera newbie so please bear with me :)

 

We have installed Cloudera Manager etc. on a single node (VM), the details are as follows :

 

VM :

lsb_release -a
LSB Version:    :core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch
Distributor ID: RedHatEnterpriseServer
Description:    Red Hat Enterprise Linux Server release 6.2 (Santiago)
Release:        6.2
Codename:       Santiago

 Impala

 

impala-shell -v
Impala Shell v1.3.1-cdh5 (2cd2029) built on Mon May  5 20:45:59 PDT 2014

 The error while creating a database :

 

(Shell build version: Impala Shell v1.3.1-cdh5 (2cd2029) built on Mon May  5 20:45:59 PDT 2014)
[cldx-1383-1236:21000] > show databases;
Query: show databases
+------------------+
| name             |
+------------------+
| _impala_builtins |
+------------------+
Returned 1 row(s) in 0.02s
[cldx-1383-1236:21000] > create database sap_srm_archive;
Query: create database sap_srm_archive
ERROR: AnalysisException: This Impala daemon is not ready to accept user requests. Status: Waiting for catalog update from the StateStore.
[cldx-1383-1236:21000] >

 I referred a couple of threads like this and posting the log Impala_CatalogServer.png



I attempted to start the catalog server but got an error, the log is below :

+ date
+ date
Wed Jun 25 21:50:04 IST 2014
++ dirname /usr/lib64/cmf/service/impala/impala.sh
+ cloudera_config=/usr/lib64/cmf/service/impala
++ cd /usr/lib64/cmf/service/impala/../common
++ pwd
+ cloudera_config=/usr/lib64/cmf/service/common
+ . /usr/lib64/cmf/service/common/cloudera-config.sh
++ set -x
+ source_parcel_environment
+ '[' '!' -z '' ']'
+ export IMPALA_HOME=/usr/lib/impala
+ IMPALA_HOME=/usr/lib/impala
+ export IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ export HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ export HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ [[ -d /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf ]]
+ perl -pi -e 's#{{HBASE_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf/hbase-env.sh
+ JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ USE_DEBUG_BUILD=false
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}##g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ '[' -f /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd ']'
+ chmod 600 /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/usr/lib/impala/sbin-retail
+ IMPALA_BIN=/usr/lib/impala/sbin-retail
+ '[' impalad = catalogd ']'
+ '[' statestore = catalogd ']'
+ '[' catalogd = catalogd ']'
+ exec /usr/lib/impala/../../bin/catalogd --flagfile=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0625 21:50:04.807515 29187 init.cc:113] CPU does not support the SSE3 instruction set, which is required. This could lead to instability.
E0625 21:50:11.240803 29187 catalog.cc:66] java.lang.IllegalStateException: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:51)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:342)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	... 5 more
+ date
+ date
Wed Jun 25 21:50:12 IST 2014
++ dirname /usr/lib64/cmf/service/impala/impala.sh
+ cloudera_config=/usr/lib64/cmf/service/impala
++ cd /usr/lib64/cmf/service/impala/../common
++ pwd
+ cloudera_config=/usr/lib64/cmf/service/common
+ . /usr/lib64/cmf/service/common/cloudera-config.sh
++ set -x
+ source_parcel_environment
+ '[' '!' -z '' ']'
+ export IMPALA_HOME=/usr/lib/impala
+ IMPALA_HOME=/usr/lib/impala
+ export IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ export HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ export HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ [[ -d /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf ]]
+ perl -pi -e 's#{{HBASE_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf/hbase-env.sh
+ JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ USE_DEBUG_BUILD=false
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}##g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ '[' -f /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd ']'
+ chmod 600 /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/usr/lib/impala/sbin-retail
+ IMPALA_BIN=/usr/lib/impala/sbin-retail
+ '[' impalad = catalogd ']'
+ '[' statestore = catalogd ']'
+ '[' catalogd = catalogd ']'
+ exec /usr/lib/impala/../../bin/catalogd --flagfile=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0625 21:50:12.510881 29273 init.cc:113] CPU does not support the SSE3 instruction set, which is required. This could lead to instability.
E0625 21:50:18.619686 29273 catalog.cc:66] java.lang.IllegalStateException: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:51)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:342)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	... 5 more
+ date
+ date
Wed Jun 25 21:50:22 IST 2014
++ dirname /usr/lib64/cmf/service/impala/impala.sh
+ cloudera_config=/usr/lib64/cmf/service/impala
++ cd /usr/lib64/cmf/service/impala/../common
++ pwd
+ cloudera_config=/usr/lib64/cmf/service/common
+ . /usr/lib64/cmf/service/common/cloudera-config.sh
++ set -x
+ source_parcel_environment
+ '[' '!' -z '' ']'
+ export IMPALA_HOME=/usr/lib/impala
+ IMPALA_HOME=/usr/lib/impala
+ export IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ export HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ export HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ [[ -d /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf ]]
+ perl -pi -e 's#{{HBASE_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf/hbase-env.sh
+ JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ USE_DEBUG_BUILD=false
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}##g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ '[' -f /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd ']'
+ chmod 600 /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/usr/lib/impala/sbin-retail
+ IMPALA_BIN=/usr/lib/impala/sbin-retail
+ '[' impalad = catalogd ']'
+ '[' statestore = catalogd ']'
+ '[' catalogd = catalogd ']'
+ exec /usr/lib/impala/../../bin/catalogd --flagfile=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0625 21:50:22.167232 29343 init.cc:113] CPU does not support the SSE3 instruction set, which is required. This could lead to instability.
E0625 21:50:28.992492 29343 catalog.cc:66] java.lang.IllegalStateException: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:51)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:342)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	... 5 more
+ date
+ date
Wed Jun 25 21:50:32 IST 2014
++ dirname /usr/lib64/cmf/service/impala/impala.sh
+ cloudera_config=/usr/lib64/cmf/service/impala
++ cd /usr/lib64/cmf/service/impala/../common
++ pwd
+ cloudera_config=/usr/lib64/cmf/service/common
+ . /usr/lib64/cmf/service/common/cloudera-config.sh
++ set -x
+ source_parcel_environment
+ '[' '!' -z '' ']'
+ export IMPALA_HOME=/usr/lib/impala
+ IMPALA_HOME=/usr/lib/impala
+ export IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ IMPALA_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf
+ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hadoop-conf
+ export HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hive-conf
+ export HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf
+ [[ -d /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf ]]
+ perl -pi -e 's#{{HBASE_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/hbase-conf/hbase-env.sh
+ JDBC_JARS=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ AUX_CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ [[ -z '' ]]
+ export CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ CLASSPATH=/usr/share/java/mysql-connector-java.jar:/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar:/usr/share/java/oracle-connector-java.jar
+ FLAG_FILE=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ USE_DEBUG_BUILD=false
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER#g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}##g' /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ '[' -f /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd ']'
+ chmod 600 /var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/usr/lib/impala/sbin-retail
+ IMPALA_BIN=/usr/lib/impala/sbin-retail
+ '[' impalad = catalogd ']'
+ '[' statestore = catalogd ']'
+ '[' catalogd = catalogd ']'
+ exec /usr/lib/impala/../../bin/catalogd --flagfile=/var/run/cloudera-scm-agent/process/80-impala-CATALOGSERVER/impala-conf/catalogserver_flags
WARNING: Logging before InitGoogleLogging() is written to STDERR
E0625 21:50:32.365809 29451 init.cc:113] CPU does not support the SSE3 instruction set, which is required. This could lead to instability.
E0625 21:50:37.739903 29451 catalog.cc:66] java.lang.IllegalStateException: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:51)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
	at org.apache.thrift.transport.TSocket.open(TSocket.java:185)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:296)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:41)
	at com.cloudera.impala.catalog.MetaStoreClientPool.addClients(MetaStoreClientPool.java:106)
	at com.cloudera.impala.catalog.Catalog.<init>(Catalog.java:87)
	at com.cloudera.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:102)
	at com.cloudera.impala.service.JniCatalog.<init>(JniCatalog.java:78)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:579)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:180)
	... 9 more
)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:342)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:169)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:109)
	at com.cloudera.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:48)
	... 5 more

 I'm not able to figure out what 'connection refused' is pointing at ! And is it that only catalog server is the issue(if anyone can refer to the screenshot of the cloudera manager impala section)

 

Regards,

Omkar



Posts: 1,880
Kudos: 422
Solutions: 297
Registered: ‎07-31-2013

Re: Impala.1.3.2 - StateStore error

The Impala service requires the Hive service to be up and running, specifically the configured CM -> Hive -> Instances -> MetaStore Server daemons.

That is what it is attempting to connect to, and then fails to (ECONNREFUSED cause it is not running/serving).
Announcements