Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Dropping Hive Table - Lost Metastore Connection

Highlighted

Dropping Hive Table - Lost Metastore Connection

Contributor

HDP 2.3

--------------------

When I drop a table, Hiveserver2 got disconnected from Metastore: Please see the log:

2016-03-22 01:29:08,416 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(185)) - Parsing command: DROP TABLE emp

2016-03-22 01:29:08,420 INFO [main]: parse.ParseDriver (ParseDriver.java:parse(209)) - Parse Completed

2016-03-22 01:29:08,420 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=parse start=1458610148415 end=1458610148420 duration=5 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,420 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=semanticAnalyze from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,646 INFO [main]: ql.Driver (Driver.java:compile(466)) - Semantic Analysis Completed

2016-03-22 01:29:08,646 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=semanticAnalyze start=1458610148420 end=1458610148646 duration=226 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,646 INFO [main]: ql.Driver (Driver.java:getSchema(246)) - Returning Hive schema: Schema(fieldSchemas:null, properties:null)

2016-03-22 01:29:08,646 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=doAuthorization from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,647 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=doAuthorization start=1458610148646 end=1458610148647 duration=1 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,647 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=compile start=1458610148414 end=1458610148647 duration=233 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,647 INFO [main]: ql.Driver (Driver.java:compile(543)) - We are resetting the hadoop caller context to

2016-03-22 01:29:08,647 INFO [main]: ql.Driver (Driver.java:checkConcurrency(166)) - Concurrency mode is disabled, not creating a lock manager

2016-03-22 01:29:08,647 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=Driver.execute from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,647 INFO [main]: ql.Driver (Driver.java:execute(1373)) - Setting caller context to query id saxon_20160322012908_b2183147-565b-423e-8683-627532554bd7

2016-03-22 01:29:08,647 INFO [main]: ql.Driver (Driver.java:execute(1376)) - Starting command(queryId=saxon_20160322012908_b2183147-565b-423e-8683-627532554bd7): DROP TABLE emp

2016-03-22 01:29:08,648 INFO [main]: hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook

2016-03-22 01:29:08,648 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=PreHook.org.apache.hadoop.hive.ql.hooks.ATSHook from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,649 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=PreHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1458610148648 end=1458610148649 duration=1 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,650 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogEnd(162)) - </PERFLOG method=TimeToSubmit start=1458610148413 end=1458610148649 duration=236 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,650 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=runTasks from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,650 INFO [main]: log.PerfLogger (PerfLogger.java:PerfLogBegin(135)) - <PERFLOG method=task.DDL.Stage-0 from=org.apache.hadoop.hive.ql.Driver>

2016-03-22 01:29:08,650 INFO [main]: ql.Driver (Driver.java:launchTask(1701)) - Starting task [Stage-0:DDL] in serial mode

2016-03-22 01:29:29,320 WARN [main]: metastore.RetryingMetaStoreClient (RetryingMetaStoreClient.java:invoke(184)) - MetaStoreClient lost connection. Attempting to reconnect.

MetaException(message:javax.jdo.JDODataStoreException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'OPTION SQL_SELECT_LIMIT=DEFAULT' at line 1

at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:451)

at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:275)

at org.apache.hadoop.hive.metastore.ObjectStore.getMTable(ObjectStore.java:1005)

at org.apache.hadoop.hive.metastore.ObjectStore.getTable(ObjectStore.java:937)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:114)

at com.sun.proxy.$Proxy2.getTable(Unknown Source)

at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1804)

2 REPLIES 2

Re: Dropping Hive Table - Lost Metastore Connection

I think they are unrelated. Are you able to replicate the issue?

Re: Dropping Hive Table - Lost Metastore Connection

Contributor

Yes, so many times.

Don't have an account?
Coming from Hortonworks? Activate your account here