Cloudera Community

Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

Error starting Impala

Labels:
avatar
author-rank andreas
Explorer

Created on ‎07-04-2019 01:55 AM - edited ‎09-16-2022 07:29 AM

Hi,

Impala fails to start with this error:

Any idea?

java:107 
Failed to connect to Hive MetaStore. Retrying.
Java exception follows:
java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1773)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:80)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:130)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:101)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:94)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:99)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:78)
	at org.apache.impala.catalog.MetaStoreClientPool.initClients(MetaStoreClientPool.java:174)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:163)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
	at org.apache.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:351)
	at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:119)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1771)
	... 11 more
Caused by: MetaException(message:Could not connect to meta store using any of the URIs provided. Most recent failure: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused (Connection refused)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:226)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:545)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:303)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1771)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:80)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:130)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:101)
	at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:94)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:99)
	at org.apache.impala.catalog.MetaStoreClientPool$MetaStoreClient.<init>(MetaStoreClientPool.java:78)
	at org.apache.impala.catalog.MetaStoreClientPool.initClients(MetaStoreClientPool.java:174)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:163)
	at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
	at org.apache.impala.catalog.CatalogServiceCatalog.<init>(CatalogServiceCatalog.java:351)
	at org.apache.impala.service.JniCatalog.<init>(JniCatalog.java:119)
Caused by: java.net.ConnectException: Connection refused (Connection refused)
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
	at java.net.Socket.connect(Socket.java:589)
	at org.apache.thrift.transport.TSocket.open(TSocket.java:221)
	... 18 more
)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.open(HiveMetaStoreClient.java:594)
	at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:303)
5,508 Views
0 Kudos
7 REPLIES 7

avatar
author-rank AcharkiMed
Master Collaborator

Created ‎07-04-2019 02:22 AM

Hi @andreas 

It looks like you have a connectivity issue with hive metastore..
try to put off the firewall and test.
Else, please share with us those log files:

/var/log/hive/hadoop-cmf-hive-HIVEMETASTORE-XXXX.log.out
/var/log/impalad/impalad.hdm1.emd.impala.log.INFO.YYYYYYY



Good luck

5,500 Views
0 Kudos

avatar
author-rank andreas
Explorer

Created ‎07-04-2019 04:16 AM

javax.jdo.JDODataStoreException: Error executing SQL query "select "DB_ID" from "DBS"".
at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:543) ~[datanucleus-api-jdo-4.2.1.jar:?]
at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:388) ~[datanucleus-api-jdo-4.2.1.jar:?]
at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:213) ~[datanucleus-api-jdo-4.2.1.jar:?]
at org.apache.hadoop.hive.metastore.MetaStoreDirectSql.runTestQuery(MetaStoreDirectSql.java:323) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.MetaStoreDirectSql.<init>(MetaStoreDirectSql.java:191) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.initializeHelper(ObjectStore.java:425) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:356) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:317) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:77) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:58) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:67) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStoreForConf(HiveMetaStore.java:687) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:653) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:647) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:716) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:419) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7028) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7023) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:7281) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:7208) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.util.RunJar.run(RunJar.java:313) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:227) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
Caused by: org.postgresql.util.PSQLException: ERROR: relation "DBS" does not exist
Position: 21
at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2477) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2190) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:300) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:428) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:354) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:169) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:117) ~[postgresql-42.1.4.jre7.89c9f79016bab67349a92c00c55907dd.jar:42.1.4.jre7]
at com.jolbox.bonecp.PreparedStatementHandle.executeQuery(PreparedStatementHandle.java:174) ~[bonecp-0.8.0.RELEASE.jar:?]
at org.datanucleus.store.rdbms.ParamLoggingPreparedStatement.executeQuery(ParamLoggingPreparedStatement.java:375) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.rdbms.SQLController.executeStatementQuery(SQLController.java:552) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.rdbms.query.SQLQuery.performExecute(SQLQuery.java:645) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.query.Query.executeQuery(Query.java:1844) ~[datanucleus-core-4.1.6.jar:?]
at org.datanucleus.store.rdbms.query.SQLQuery.executeWithArray(SQLQuery.java:807) ~[datanucleus-rdbms-4.1.7.jar:?]
at org.datanucleus.store.query.Query.execute(Query.java:1715) ~[datanucleus-core-4.1.6.jar:?]
at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:371) ~[datanucleus-api-jdo-4.2.1.jar:?]
... 27 more
2019-07-02 16:35:26,855 ERROR org.apache.hadoop.hive.metastore.HiveMetaStore: [main]: MetaException(message:Version information not found in metastore. )
at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:8066)
at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:8043)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:101)
at com.sun.proxy.$Proxy23.verifySchema(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:654)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:647)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:716)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:419)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7028)
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7023)
at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:7281)
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:7208)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:313)
at org.apache.hadoop.util.RunJar.main(RunJar.java:227)

2019-07-02 16:35:26,856 ERROR org.apache.hadoop.hive.metastore.HiveMetaStore: [main]: Metastore Thrift Server threw an exception...
org.apache.hadoop.hive.metastore.api.MetaException: Version information not found in metastore.
at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:8066) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:8043) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:101) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at com.sun.proxy.$Proxy23.verifySchema(Unknown Source) ~[?:?]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMSForConf(HiveMetaStore.java:654) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:647) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:716) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:419) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:78) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:84) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7028) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:7023) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:7281) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:7208) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_181]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_181]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_181]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_181]
at org.apache.hadoop.util.RunJar.run(RunJar.java:313) [hadoop-common-3.0.0-cdh6.2.0.jar:?]
at org.apache.hadoop.util.RunJar.main(RunJar.java:227) [hadoop-common-3.0.0-cdh6.2.0.jar:?]

5,492 Views
0 Kudos

avatar
author-rank andreas
Explorer

Created ‎07-04-2019 04:18 AM

Impala error:

E0704 14:17:50.711091 60291 impala-server.cc:1564] There was an error processing the impalad catalog update. Requesting a full topic update to recover: RuntimeException: java.io.FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
CAUSED BY: FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
E0704 14:17:52.714336 60292 Configuration.java:2889] error parsing conf core-site.xml
Java exception follows:
java.io.FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2813)
at org.apache.hadoop.conf.Configuration.getStreamReader(Configuration.java:2906)
at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2864)
at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2838)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2715)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1352)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1324)
at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:518)
at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:536)
at org.apache.hadoop.mapred.JobConf.<init>(JobConf.java:430)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:4061)
at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:4024)
at org.apache.impala.catalog.MetaStoreClientPool.<init>(MetaStoreClientPool.java:155)
at org.apache.impala.catalog.Catalog.<init>(Catalog.java:99)
at org.apache.impala.catalog.ImpaladCatalog.<init>(ImpaladCatalog.java:96)
at org.apache.impala.service.FeCatalogManager$CatalogdImpl.createNewCatalog(FeCatalogManager.java:122)
at org.apache.impala.service.FeCatalogManager$CatalogdImpl.updateCatalogCache(FeCatalogManager.java:109)
at org.apache.impala.service.Frontend.updateCatalogCache(Frontend.java:308)
at org.apache.impala.service.JniFrontend.updateCatalogCache(JniFrontend.java:187)
E0704 14:17:52.714665 60292 impala-server.cc:1564] There was an error processing the impalad catalog update. Requesting a full topic update to recover: RuntimeException: java.io.FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)
CAUSED BY: FileNotFoundException: /run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml (Permission denied)

5,490 Views
0 Kudos

avatar
author-rank AcharkiMed
Master Collaborator

Created ‎07-04-2019 07:05 AM

Have you made any manual changes to the metastore user or database permissions? because it looks like the DBS table is not found in metastore DB!
Remark: check if the CM point to the correct metastore DB with the pertinent user.

5,478 Views
0 Kudos

avatar
author-rank andreas
Explorer

Created ‎07-04-2019 10:34 PM

Hi,

Can you guide me how to check. I am using the default postgres database

5,444 Views
0 Kudos

avatar
author-rank andreas
Explorer

Created ‎07-05-2019 12:47 AM

Also another thing i found out is that master server on hbase is not starting. Neve managed to start it.

5,437 Views
0 Kudos

avatar
author-rank andreas
Explorer

Created ‎07-04-2019 04:13 AM

And here is the impala log:

E0704 14:10:31.450600 60292 impala-server.cc:1564] There was an error
processing the impalad catalog update. Requesting a full topic update to
recover: RuntimeException: java.io.FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
CAUSED BY: FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
I0704 14:10:32.737851 59764 Frontend.java:1092] Waiting for local catalog
to be initialized, attempt: 81988
E0704 14:10:33.453867 60291 Configuration.java:2889] error parsing conf
core-site.xml
Java exception follows:
java.io.FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.(FileInputStream.java:138)
at java.io.FileInputStream.(FileInputStream.java:93)
at
sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
at
sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2813)
at
org.apache.hadoop.conf.Configuration.getStreamReader(Configuration.java:2906)
at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2864)
at
org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2838)
at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2715)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1352)
at org.apache.hadoop.conf.Configuration.set(Configuration.java:1324)
at org.apache.hadoop.mapred.JobConf.setJar(JobConf.java:518)
at org.apache.hadoop.mapred.JobConf.setJarByClass(JobConf.java:536)
at org.apache.hadoop.mapred.JobConf.(JobConf.java:430)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:4061)
at org.apache.hadoop.hive.conf.HiveConf.(HiveConf.java:4024)
at
org.apache.impala.catalog.MetaStoreClientPool.(MetaStoreClientPool.java:155)
at org.apache.impala.catalog.Catalog.(Catalog.java:99)
at org.apache.impala.catalog.ImpaladCatalog.(ImpaladCatalog.java:96)
at
org.apache.impala.service.FeCatalogManager$CatalogdImpl.createNewCatalog(FeCatalogManager.java:122)
at
org.apache.impala.service.FeCatalogManager$CatalogdImpl.updateCatalogCache(FeCatalogManager.java:109)
at org.apache.impala.service.Frontend.updateCatalogCache(Frontend.java:308)
at
org.apache.impala.service.JniFrontend.updateCatalogCache(JniFrontend.java:187)
I0704 14:10:33.454084 60291 jni-util.cc:256] java.lang.RuntimeException:
java.io.FileNotFoundException:
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
(Permission denied)
at
org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2890)
at org.apache.hadoop.conf.Configurat
Here are the permissions:
-rw-r----- 1 cloudera-scm cloudera-scm 3350 Jul 2 16:36
/run/cloudera-scm-agent/process/117-impala-IMPALAD/hadoop-conf/core-site.xml
5,493 Views
0 Kudos
Announcements
What's New @ Cloudera
Cloudera DataFlow 2.9 now supports building GenAI pipelines ...
What's New @ Cloudera
Accelerate Data Scientist Productivity with Cloudera Copilot...
What's New @ Cloudera
[RELEASED] Cloudera Streaming Analytics - Kubernetes Operato...
Community Announcements
October 2024 Community Highlights
What's New @ Cloudera
Accelerate Your AI with the Cloudera AI Inference Service wi...
View More Announcements