Reply
Explorer
Posts: 35
Registered: ‎11-22-2013

Hive2 server is *NOT* working as expected way

Folks,  I am working on migrating  "Existing HIVE  (not Managed by CM) to HIVE2 (Managed by CM4)".

(our setup has remote mysql as metastoreDB.)
 
Issue Here is,  Metastore & Hive2 server services has been started successfully.
But when run something in HIVE prompt, I am not getting any output.
 
hive> show tables;
OK
Time taken: 3.955 seconds
hive>
 
But Hive Meta-store service is successfully connecting MetaDB (mysql),
which i found by checking connection status.
 
root@prod-2417:/etc/hive/conf# lsof -i:3306
COMMAND  PID USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
java    8037 hive  234u  IPv4 310189      0t0  TCP prod-2417.intranet.com:54453->hadoop-server.intranet.com:mysql (ESTABLISHED)
java    8037 hive  235u  IPv4 310190      0t0  TCP prod-2417.intranet.com:54455->hadoop-server.intranet.com:mysql (ESTABLISHED)
 
I am not seeing any error in HIVE LOG except one warning for hive.metastore.uris 
============================================================
 
2014-04-15 15:54:49,712 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: Starting hive metastore on port 9083
2014-04-15 15:54:50,107 WARN org.apache.hadoop.hive.conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
2014-04-15 15:54:50,172 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: 0: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
2014-04-15 15:54:50,199 INFO org.apache.hadoop.hive.metastore.ObjectStore: ObjectStore, initialize called
2014-04-15 15:54:50,558 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
2014-04-15 15:54:50,559 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
2014-04-15 15:54:50,559 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
2014-04-15 15:54:50,562 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus"  Version: "2.0.3-ZD5977-CDH5293"
2014-04-15 15:54:50,562 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:mysql://hadoop-server.intranet.com:3306/hive?useUnicode=true&characterEncoding=UTF-8" driver="com.mysql.jdbc.Driver" userName="hive"
2014-04-15 15:54:50,562 INFO DataNucleus.Persistence: ===========================================================
2014-04-15 15:54:51,076 INFO DataNucleus.Datastore.Schema: Creating table `DELETEME1397602491064`
2014-04-15 15:54:51,090 INFO DataNucleus.Datastore.Schema: Schema Name could not be determined for this datastore
2014-04-15 15:54:51,091 INFO DataNucleus.Datastore.Schema: Dropping table `DELETEME1397602491064`
2014-04-15 15:54:51,094 INFO DataNucleus.Datastore.Schema: Initialising Catalog "hive", Schema "" using "None" auto-start option
2014-04-15 15:54:51,094 INFO DataNucleus.Datastore.Schema: Catalog "hive", Schema "" initialised - managing 0 classes
2014-04-15 15:54:51,192 WARN org.apache.hadoop.hive.conf.HiveConf: DEPRECATED: Configuration property hive.metastore.local no longer has any effect. Make sure to provide a valid value for hive.metastore.uris if you are connecting to a remote metastore.
2014-04-15 15:54:51,192 INFO org.apache.hadoop.hive.metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
2014-04-15 15:54:51,222 INFO DataNucleus.MetaData: Registering listener for metadata initialisation
2014-04-15 15:54:51,242 INFO org.apache.hadoop.hive.metastore.ObjectStore: Initialized ObjectStore
2014-04-15 15:54:51,651 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MDatabase [Table : `DBS`, InheritanceStrategy : new-table]
2014-04-15 15:54:51,666 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MDatabase.parameters [Table : `DATABASE_PARAMS`]
2014-04-15 15:54:51,765 INFO DataNucleus.Datastore.Schema: Validating 2 index(es) for table `DBS`
2014-04-15 15:54:51,770 INFO DataNucleus.Datastore.Schema: Validating 0 foreign key(s) for table `DBS`
2014-04-15 15:54:51,772 INFO DataNucleus.Datastore.Schema: Validating 2 unique key(s) for table `DBS`
2014-04-15 15:54:51,774 INFO DataNucleus.Datastore.Schema: Validating 2 index(es) for table `DATABASE_PARAMS`
2014-04-15 15:54:51,780 INFO DataNucleus.Datastore.Schema: Validating 1 foreign key(s) for table `DATABASE_PARAMS`
2014-04-15 15:54:51,782 INFO DataNucleus.Datastore.Schema: Validating 1 unique key(s) for table `DATABASE_PARAMS`
2014-04-15 15:54:51,986 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MDatabase
2014-04-15 15:54:52,142 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: Starting DB backed MetaStore Server with SetUGI enabled
2014-04-15 15:54:52,150 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: Started the new metaserver on port [9083]...
2014-04-15 15:54:52,150 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: Options.minWorkerThreads = 200
2014-04-15 15:54:52,150 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: Options.maxWorkerThreads = 100000
2014-04-15 15:54:52,150 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: TCP keepalive = true
2014-04-15 15:54:54,448 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: 1: get_databases: default
2014-04-15 15:54:54,451 INFO org.apache.hadoop.hive.metastore.HiveMetaStore.audit: ugi=hive     ip=/10.X.X.X  cmd=get_databases: default
2014-04-15 15:54:54,454 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: 1: Opening raw store with implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
2014-04-15 15:54:54,455 INFO org.apache.hadoop.hive.metastore.ObjectStore: ObjectStore, initialize called
2014-04-15 15:54:54,456 INFO org.apache.hadoop.hive.metastore.ObjectStore: Initialized ObjectStore
 
 
 
But Everything is working fine with our old HIVE server.
Any idea or Suggestion where should i start to figure this issue out.
 
My HIVE version is  Hive-0.9.0+158-1.cdh4.1.3 & CDH 4.1.3
 
Best Regards,
Bommuraj
Posts: 1,886
Kudos: 425
Solutions: 300
Registered: ‎07-31-2013

Re: Hive2 server is *NOT* working as expected way

Is your database name "hive"? Can you send the output of "SHOW DATABASES;" from the MySQL at hadoop-server.intranet.com?