Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Error starting Impala

Error starting Impala

Explorer

Hi,

Impala fails to start with this error:

Any idea?

java:107
Failed to connect to Hive MetaStore. Retrying.
Java exception follows:
java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1773)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:80)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:130)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:101)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:94)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:99)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:78)
	at org.apache.impala.catalog.MetaStoreClientPool.initClients(MetaStoreClientPool.java:174)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:163)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
	at org.apache.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:351)
	at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:119)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1771)
	... 11 more
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:545)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:303)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1771)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:80)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:130)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:101)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:94)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:99)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:78)
	at org.apache.impala.catalog.MetaStoreClientPool.initClients(MetaStoreClientPool.java:174)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:163)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
	at org.apache.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:351)
	at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:119)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:589)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
	... 18 more
)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:594)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:303)




7 REPLIES 7

Re: Error starting Impala

Expert Contributor

Hi @andreas 

It looks like you have a connectivity issue with hive metastore..
try to put off the firewall and test.
Else, please share with us those log files:

/var/log/hive/hadoop-cmf-hive-HIVEMETASTORE-XXXX.log.out
/var/log/impalad/impalad.hdm1.emd.impala.log.INFO.YYYYYYY



Good luck

Highlighted

Re: Error starting Impala

Explorer

javax.jdo.JDODataStoreException: Error executing SQL query "select "DB_ID" from "DBS"".
at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543) ~[datanucleus-api-jdo-4.2.1.jar:?]
at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:388) ~[datanucleus-api-jdo-4.2.1.jar:?]
at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:213) ~[datanucleus-api-jdo-4.2.1.jar:?]
at org.apache.hadoop.hive.metastore.MetaStoreDirectSql.runTestQuery(MetaStoreDirectSql.java:323) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.MetaStoreDirectSql.<init>(MetaStoreDirectSql.java:191) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.initializeHelper(ObjectStore.java:425) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:356) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:317) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:58) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:67) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStoreForConf(HiveMetaStore.java:687) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:653) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:647) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:716) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:419) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7028) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7023) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:7281) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:7208) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.util.RunJar.run(RunJar.java:313) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:227) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
Caused by: org.postgresql.util.PSQLException: ERROR: relation "DBS" does not exist
Position: 21
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2477) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2190) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:300) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:428) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:354) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:169) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:117) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at com.jolbox.bonecp.PreparedStatementHandle.executeQuery(PreparedStatementHandle.java:174) ~[bonecp-0.8.0.RELEASE.jar:?]
at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeQuery(ParamLoggingPreparedStatement.java:375) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:552) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.rdbms.query.SQLQuery.performExecute(SQLQuery.java:645) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.query.Query.executeQuery(Query.java:1844) ~[datanucleus-core-4.1.6.jar:?]
at org.datanucleus.store.rdbms.query.SQLQuery.executeWithArray(SQLQuery.java:807) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.query.Query.execute(Query.java:1715) ~[datanucleus-core-4.1.6.jar:?]
at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:371) ~[datanucleus-api-jdo-4.2.1.jar:?]
... 27 more
2019-07-02 16:35:26,855 ERROR org.apache.hadoop.hive.metastore.HiveMetaStore: [main]: MetaException(message:Version information not found in metastore. )
at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:8066)
at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:8043)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:101)
at com.sun.proxy.$Proxy23.verifySchema(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:654)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:647)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:716)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:419)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7028)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7023)
at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:7281)
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:7208)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:313)
at org.apache.hadoop.util.RunJar.main(RunJar.java:227)

2019-07-02 16:35:26,856 ERROR org.apache.hadoop.hive.metastore.HiveMetaStore: [main]: Metastore Thrift Server threw an exception...
org.apache.hadoop.hive.metastore.api.MetaException: Version information not found in metastore.
at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:8066) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:8043) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:101) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at com.sun.proxy.$Proxy23.verifySchema(Unknown Source) ~[?:?]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:654) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:647) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:716) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:419) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7028) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7023) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:7281) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:7208) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.util.RunJar.run(RunJar.java:313) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:227) [hadoop-common-3.0.0-cdh6.2.0.jar:?]

Re: Error starting Impala

Explorer

Impala error:

E0704 14:17:50.711091 60291 impala-server.cc:1564] There was an error processing the impalad catalog update. Requesting a full topic update to recover: RuntimeException: java.io.FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
CAUSED BY: FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
E0704 14:17:52.714336 60292 Configuration.java:2889] error parsing conf core-site.xml
Java exception follows:
java.io.FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2813)
at org.apache.hadoop.conf.Configuration.getStreamReader(Configuration.java:2906)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2864)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2838)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2715)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1352)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1324)
at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:518)
at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:536)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:430)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:4061)
at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:4024)
at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
at org.apache.impala.catalog.Catalog.<init>(Catalog.java:99)
at org.apache.impala.catalog.ImpaladCatalog.<init>(ImpaladCatalog.java:96)
at org.apache.impala.service.FeCatalogManager$CatalogdImpl.createNewCatalog(FeCatalogManager.java:122)
at org.apache.impala.service.FeCatalogManager$CatalogdImpl.updateCatalogCache(FeCatalogManager.java:109)
at org.apache.impala.service.Frontend.updateCatalogCache(Frontend.java:308)
at org.apache.impala.service.JniFrontend.updateCatalogCache(JniFrontend.java:187)
E0704 14:17:52.714665 60292 impala-server.cc:1564] There was an error processing the impalad catalog update. Requesting a full topic update to recover: RuntimeException: java.io.FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
CAUSED BY: FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)

Re: Error starting Impala

Expert Contributor

Have you made any manual changes to the metastore user or database permissions? because it looks like the DBS table is not found in metastore DB!
Remark: check if the CM point to the correct metastore DB with the pertinent user.

Re: Error starting Impala

Explorer

Hi,

Can you guide me how to check. I am using the default postgres database

Re: Error starting Impala

Explorer

Also another thing i found out is that master server on hbase is not starting. Neve managed to start it.

Re: Error starting Impala

Explorer
And here is the impala log:

E0704 14:10:31.450600 60292 impala-server.cc:1564] There was an error
processing the impalad catalog update. Requesting a full topic update to
recover: RuntimeException: java.io.FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
CAUSED BY: FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
I0704 14:10:32.737851 59764 Frontend.java:1092] Waiting for local catalog
to be initialized, attempt: 81988
E0704 14:10:33.453867 60291 Configuration.java:2889] error parsing conf
core-site.xml
Java exception follows:
java.io.FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at java.io.FileInputStream.(FileInputStream.java:93)
at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2813)
at
org.apache.hadoop.conf.Configuration.getStreamReader(Configuration.java:2906)
at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2864)
at
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2838)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2715)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1352)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1324)
at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:518)
at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:536)
at org.apache.hadoop.mapred.JobConf.(JobConf.java:430)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:4061)
at org.apache.hadoop.hive.conf.HiveConf.(HiveConf.java:4024)
at
org.apache.impala.catalog.MetaStoreClientPool.(MetaStoreClientPool.java:155)
at org.apache.impala.catalog.Catalog.(Catalog.java:99)
at org.apache.impala.catalog.ImpaladCatalog.(ImpaladCatalog.java:96)
at
org.apache.impala.service.FeCatalogManager$CatalogdImpl.createNewCatalog(FeCatalogManager.java:122)
at
org.apache.impala.service.FeCatalogManager$CatalogdImpl.updateCatalogCache(FeCatalogManager.java:109)
at org.apache.impala.service.Frontend.updateCatalogCache(Frontend.java:308)
at
org.apache.impala.service.JniFrontend.updateCatalogCache(JniFrontend.java:187)
I0704 14:10:33.454084 60291 jni-util.cc:256] java.lang.RuntimeException:
java.io.FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2890)
at org.apache.hadoop.conf.Configurat
Here are the permissions:
-rw-r----- 1 cloudera-scm cloudera-scm 3350 Jul 2 16:36
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
Don't have an account?
Coming from Hortonworks? Activate your account here