Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 07-10-2017 08:31 PM
stderr: /var/lib/ambari-agent/data/errors-617.txt
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 260, in <module>
HiveMetastore().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 314, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 60, in start
create_metastore_schema()
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py", line 371, in create_metastore_schema
user = params.hive_user
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-server2-hive2/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED] -verbose' returned 1. SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hive2/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:mysql://ip-10-0-1-45.ec2.internal/hive?createDatabaseIfNotExist=true
Metastore Connection Driver : com.mysql.jdbc.Driver
Metastore connection User: hive
Starting metastore schema initialization to 2.1.1000
Initialization script hive-schema-2.1.1000.mysql.sql
Connecting to jdbc:mysql://ip-10-0-1-45.ec2.internal/hive?createDatabaseIfNotExist=true
Connected to: MySQL (version 5.6.36)
Driver: MySQL Connector Java (version mysql-connector-java-5.1.25-SNAPSHOT ( Revision: ${bzr.revision-id} ))
Transaction isolation: TRANSACTION_READ_COMMITTED
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> !autocommit on
Autocommit status: true
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_CHARACTER_SET_C
LIENT=@@CHARACTER_SET_CLIENT */
No rows affected (0.021 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_CHARACTER_SET_R
ESULTS=@@CHARACTER_SET_RESULTS */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_COLLATION_CONNE
CTION=@@COLLATION_CONNECTION */
No rows affected (0.013 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET NAMES utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40103 SET @OLD_TIME_ZONE=@@TIM
E_ZONE */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40103 SET TIME_ZONE='+00:00' *
/
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40014 SET @OLD_UNIQUE_CHECKS=@
@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40014 SET @OLD_FOREIGN_KEY_CHE
CKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_SQL_MODE=@@SQL_
MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40111 SET @OLD_SQL_NOTES=@@SQL
_NOTES, SQL_NOTES=0 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `BUCKE
TING_COLS` ( `SD_ID` bigint(20) NOT NULL, `BUCKET_COL_NAME` varchar(256) CHARACT
ER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, P
RIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `BUCKETING_COLS_N49` (`SD_ID`), CONSTRAI
NT `BUCKETING_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGIN
E=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.008 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `CDS`
( `CD_ID` bigint(20) NOT NULL, PRIMARY KEY (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHA
RSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `COLUM
NS_V2` ( `CD_ID` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin
1 COLLATE latin1_bin DEFAULT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET lati
n1 COLLATE latin1_bin NOT NULL, `TYPE_NAME` varchar(4000) DEFAULT NULL, `INTEGER
_IDX` int(11) NOT NULL, PRIMARY KEY (`CD_ID`,`COLUMN_NAME`), KEY `COLUMNS_V2_N49
` (`CD_ID`), CONSTRAINT `COLUMNS_V2_FK1` FOREIGN KEY (`CD_ID`) REFERENCES `CDS`
(`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `DATAB
ASE_PARAMS` ( `DB_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(180) CHARACTER SE
T latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`,`PARAM_KEY`), KEY `
DATABASE_PARAMS_N49` (`DB_ID`), CONSTRAINT `DATABASE_PARAMS_FK1` FOREIGN KEY (`D
B_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `DBS`
( `DB_ID` bigint(20) NOT NULL, `DESC` varchar(4000) CHARACTER SET latin1 COLLATE
latin1_bin DEFAULT NULL, `DB_LOCATION_URI` varchar(4000) CHARACTER SET latin1 C
OLLATE latin1_bin NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE lat
in1_bin DEFAULT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE lat
in1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE lati
n1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`), UNIQUE KEY `UNIQUE_DATABASE` (`NAME`
) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `DB_PR
IVS` ( `DB_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID
` bigint(20) DEFAULT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varcha
r(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varc
har(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME`
varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TY
PE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_PRIV`
varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY
(`DB_GRANT_ID`), UNIQUE KEY `DBPRIVILEGEINDEX` (`DB_ID`,`PRINCIPAL_NAME`,`PRINCI
PAL_TYPE`,`DB_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `DB_PRIVS_N49` (`DB_ID`), CON
STRAINT `DB_PRIVS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE
=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `GLOBA
L_PRIVS` ( `USER_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL,
`GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET lati
n1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin DEFAULT NULL, `USER_PRIV` varchar(128) CHARACTER S
ET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`USER_GRANT_ID`), UNIQUE
KEY `GLOBALPRIVILEGEINDEX` (`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`USER_PRIV`,`GRAN
TOR`,`GRANTOR_TYPE`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.006 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `IDXS`
( `INDEX_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DEFERRED_REB
UILD` bit(1) NOT NULL, `INDEX_HANDLER_CLASS` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `INDEX_NAME` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `INDEX_TBL_ID` bigint(20) DEFAULT NULL, `LAST_A
CCESS_TIME` int(11) NOT NULL, `ORIG_TBL_ID` bigint(20) DEFAULT NULL, `SD_ID` big
int(20) DEFAULT NULL, PRIMARY KEY (`INDEX_ID`), UNIQUE KEY `UNIQUEINDEX` (`INDEX
_NAME`,`ORIG_TBL_ID`), KEY `IDXS_N51` (`SD_ID`), KEY `IDXS_N50` (`INDEX_TBL_ID`)
, KEY `IDXS_N49` (`ORIG_TBL_ID`), CONSTRAINT `IDXS_FK1` FOREIGN KEY (`ORIG_TBL_I
D`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `IDXS_FK2` FOREIGN KEY (`SD_ID`) RE
FERENCES `SDS` (`SD_ID`), CONSTRAINT `IDXS_FK3` FOREIGN KEY (`INDEX_TBL_ID`) REF
ERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `INDEX
_PARAMS` ( `INDEX_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SE
T latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`INDEX_ID`,`PARAM_KEY`), KE
Y `INDEX_PARAMS_N49` (`INDEX_ID`), CONSTRAINT `INDEX_PARAMS_FK1` FOREIGN KEY (`I
NDEX_ID`) REFERENCES `IDXS` (`INDEX_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `NUCLE
US_TABLES` ( `CLASS_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin N
OT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT N
ULL, `TYPE` varchar(4) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `OWNER`
varchar(2) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `VERSION` varchar(
20) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTERFACE_NAME` varchar(2
55) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`CLASS_NA
ME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TIONS` ( `PART_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `LAST_AC
CESS_TIME` int(11) NOT NULL, `PART_NAME` varchar(767) CHARACTER SET latin1 COLLA
TE latin1_bin DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_ID` bigint(20)
DEFAULT NULL, PRIMARY KEY (`PART_ID`), UNIQUE KEY `UNIQUEPARTITION` (`PART_NAME
`,`TBL_ID`), KEY `PARTITIONS_N49` (`TBL_ID`), KEY `PARTITIONS_N50` (`SD_ID`), CO
NSTRAINT `PARTITIONS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), C
ONSTRAINT `PARTITIONS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) EN
GINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_EVENTS` ( `PART_NAME_ID` bigint(20) NOT NULL, `DB_NAME` varchar(128) CHARAC
TER SET latin1 COLLATE latin1_bin DEFAULT NULL, `EVENT_TIME` bigint(20) NOT NULL
, `EVENT_TYPE` int(11) NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET lat
in1 COLLATE latin1_bin DEFAULT NULL, `TBL_NAME` varchar(128) CHARACTER SET latin
1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_NAME_ID`), KEY `PARTITIONE
VENTINDEX` (`PARTITION_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.006 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_KEYS` ( `TBL_ID` bigint(20) NOT NULL, `PKEY_COMMENT` varchar(4000) CHARACTE
R SET latin1 COLLATE latin1_bin DEFAULT NULL, `PKEY_NAME` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin NOT NULL, `PKEY_TYPE` varchar(767) CHARACTER SET
latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY
(`TBL_ID`,`PKEY_NAME`), KEY `PARTITION_KEYS_N49` (`TBL_ID`), CONSTRAINT `PARTITI
ON_KEYS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB
DEFAULT CHARSET=latin1
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_KEY_VALS` ( `PART_ID` bigint(20) NOT NULL, `PART_KEY_VAL` varchar(256) CHAR
ACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL
, PRIMARY KEY (`PART_ID`,`INTEGER_IDX`), KEY `PARTITION_KEY_VALS_N49` (`PART_ID`
), CONSTRAINT `PARTITION_KEY_VALS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTI
TIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_PARAMS` ( `PART_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER
SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER S
ET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_ID`,`PARAM_KEY`),
KEY `PARTITION_PARAMS_N49` (`PART_ID`), CONSTRAINT `PARTITION_PARAMS_FK1` FOREIG
N KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CH
ARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PART_
COL_PRIVS` ( `PART_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(1
000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11)
NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACT
ER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL
, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT
NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFA
ULT NULL, `PART_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin D
EFAULT NULL, PRIMARY KEY (`PART_COLUMN_GRANT_ID`), KEY `PART_COL_PRIVS_N49` (`PA
RT_ID`), KEY `PARTITIONCOLUMNPRIVILEGEINDEX` (`PART_ID`,`COLUMN_NAME`,`PRINCIPAL
_NAME`,`PRINCIPAL_TYPE`,`PART_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `P
ART_COL_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) )
ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PART_
PRIVS` ( `PART_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `G
RANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 C
OLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_
NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCI
PAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PA
RT_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIM
ARY KEY (`PART_GRANT_ID`), KEY `PARTPRIVILEGEINDEX` (`PART_ID`,`PRINCIPAL_NAME`,
`PRINCIPAL_TYPE`,`PART_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `PART_PRIVS_N49` (`P
ART_ID`), CONSTRAINT `PART_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTIT
IONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `ROLES
` ( `ROLE_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `OWNER_NAME`
varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_NAME` v
archar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`
ROLE_ID`), UNIQUE KEY `ROLEENTITYINDEX` (`ROLE_NAME`) ) ENGINE=InnoDB DEFAULT CH
ARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `ROLE_
MAP` ( `ROLE_GRANT_ID` bigint(20) NOT NULL, `ADD_TIME` int(11) NOT NULL, `GRANT_
OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLAT
E latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLL
ATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET lat
in1 COLLATE latin1_bin DEFAULT NULL, `ROLE_ID` bigint(20) DEFAULT NULL, PRIMARY
KEY (`ROLE_GRANT_ID`), UNIQUE KEY `USERROLEMAPINDEX` (`PRINCIPAL_NAME`,`ROLE_ID`
,`GRANTOR`,`GRANTOR_TYPE`), KEY `ROLE_MAP_N49` (`ROLE_ID`), CONSTRAINT `ROLE_MAP
_FK1` FOREIGN KEY (`ROLE_ID`) REFERENCES `ROLES` (`ROLE_ID`) ) ENGINE=InnoDB DEF
AULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SDS`
( `SD_ID` bigint(20) NOT NULL, `CD_ID` bigint(20) DEFAULT NULL, `INPUT_FORMAT` v
archar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `IS_COMPRESSE
D` bit(1) NOT NULL, `IS_STOREDASSUBDIRECTORIES` bit(1) NOT NULL, `LOCATION` varc
har(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `NUM_BUCKETS` in
t(11) NOT NULL, `OUTPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin
1_bin DEFAULT NULL, `SERDE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`SD_ID`), K
EY `SDS_N49` (`SERDE_ID`), KEY `SDS_N50` (`CD_ID`), CONSTRAINT `SDS_FK1` FOREIGN
KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), CONSTRAINT `SDS_FK2` FOREIGN
KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SD_PA
RAMS` ( `SD_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET lati
n1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`PARAM_KEY`), KEY `SD_PAR
AMS_N49` (`SD_ID`), CONSTRAINT `SD_PARAMS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES
`SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SEQUE
NCE_TABLE` ( `SEQUENCE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bi
n NOT NULL, `NEXT_VAL` bigint(20) NOT NULL, PRIMARY KEY (`SEQUENCE_NAME`) ) ENGI
NE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SERDE
S` ( `SERDE_ID` bigint(20) NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 CO
LLATE latin1_bin DEFAULT NULL, `SLIB` varchar(4000) CHARACTER SET latin1 COLLATE
latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARS
ET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SERDE
_PARAMS` ( `SERDE_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SE
T latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`,`PARAM_KEY`), KE
Y `SERDE_PARAMS_N49` (`SERDE_ID`), CONSTRAINT `SERDE_PARAMS_FK1` FOREIGN KEY (`S
ERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin
1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_COL_NAMES` ( `SD_ID` bigint(20) NOT NULL, `SKEWED_COL_NAME` varchar(256) CHARA
CTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL,
PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SKEWED_COL_NAMES_N49` (`SD_ID`), CONS
TRAINT `SKEWED_COL_NAMES_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) )
ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_COL_VALUE_LOC_MAP` ( `SD_ID` bigint(20) NOT NULL, `STRING_LIST_ID_KID` bigint(
20) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin D
EFAULT NULL, PRIMARY KEY (`SD_ID`,`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_L
OC_MAP_N49` (`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N50` (`SD_ID`)
, CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK2` FOREIGN KEY (`STRING_LIST_ID_KID`) R
EFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_COL_VALUE_
LOC_MAP_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DE
FAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_STRING_LIST` ( `STRING_LIST_ID` bigint(20) NOT NULL, PRIMARY KEY (`STRING_LIST
_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.005 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.011 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_STRING_LIST_VALUES` ( `STRING_LIST_ID` bigint(20) NOT NULL, `STRING_LIST_VALUE
` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_ID
X` int(11) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`,`INTEGER_IDX`), KEY `SKEWED_S
TRING_LIST_VALUES_N49` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_STRING_LIST_VALUES
_FK1` FOREIGN KEY (`STRING_LIST_ID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LI
ST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_VALUES` ( `SD_ID_OID` bigint(20) NOT NULL, `STRING_LIST_ID_EID` bigint(20) NOT
NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID_OID`,`INTEGER_IDX`),
KEY `SKEWED_VALUES_N50` (`SD_ID_OID`), KEY `SKEWED_VALUES_N49` (`STRING_LIST_ID_
EID`), CONSTRAINT `SKEWED_VALUES_FK2` FOREIGN KEY (`STRING_LIST_ID_EID`) REFEREN
CES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_VALUES_FK1` FORE
IGN KEY (`SD_ID_OID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET
=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SORT_
COLS` ( `SD_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(1000) CHARACTER SET l
atin1 COLLATE latin1_bin DEFAULT NULL, `ORDER` int(11) NOT NULL, `INTEGER_IDX` i
nt(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SORT_COLS_N49` (`SD_I
D`), CONSTRAINT `SORT_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TABLE
_PARAMS` ( `TBL_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET
latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET la
tin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_ID`,`PARAM_KEY`), KEY `T
ABLE_PARAMS_N49` (`TBL_ID`), CONSTRAINT `TABLE_PARAMS_FK1` FOREIGN KEY (`TBL_ID`
) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.018 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TBLS`
( `TBL_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(
20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `OWNER` varchar(767) CHAR
ACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `RETENTION` int(11) NOT NULL,
`SD_ID` bigint(20) DEFAULT NULL, `TBL_NAME` varchar(128) CHARACTER SET latin1 CO
LLATE latin1_bin DEFAULT NULL, `TBL_TYPE` varchar(128) CHARACTER SET latin1 COLL
ATE latin1_bin DEFAULT NULL, `VIEW_EXPANDED_TEXT` mediumtext, `VIEW_ORIGINAL_TEX
T` mediumtext, PRIMARY KEY (`TBL_ID`), UNIQUE KEY `UNIQUETABLE` (`TBL_NAME`,`DB_
ID`), KEY `TBLS_N50` (`SD_ID`), KEY `TBLS_N49` (`DB_ID`), CONSTRAINT `TBLS_FK1`
FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `TBLS_FK2` FOREIGN
KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TBL_C
OL_PRIVS` ( `TBL_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(100
0) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) N
OT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER S
ET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARA
CTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) C
HARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_COL_PRIV` varchar(128)
CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAU
LT NULL, PRIMARY KEY (`TBL_COLUMN_GRANT_ID`), KEY `TABLECOLUMNPRIVILEGEINDEX` (`
TBL_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_COL_PRIV`,`GRANTOR`
,`GRANTOR_TYPE`), KEY `TBL_COL_PRIVS_N49` (`TBL_ID`), CONSTRAINT `TBL_COL_PRIVS_
FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT
CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TBL_P
RIVS` ( `TBL_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRA
NT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COL
LATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 C
OLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET lati
n1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_PRIV` varchar(128) CHARACTER SET la
tin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, PRIMARY
KEY (`TBL_GRANT_ID`), KEY `TBL_PRIVS_N49` (`TBL_ID`), KEY `TABLEPRIVILEGEINDEX`
(`TBL_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`)
, CONSTRAINT `TBL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TAB_C
OL_STATS` ( `CS_ID` bigint(20) NOT NULL, `DB_NAME` varchar(128) CHARACTER SET la
tin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(1000) CHARACTER SET latin1 C
OLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLL
ATE latin1_bin NOT NULL, `TBL_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(2
0), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_
VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20),
`AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `
NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID
`), CONSTRAINT `TAB_COL_STATS_FK` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL
_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PART_
COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `DB_NAME` varchar(128) CHARACTER SET l
atin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin
1 COLLATE latin1_bin NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin
1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(1000) CHARACTER SET latin1
COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COL
LATE latin1_bin NOT NULL, `PART_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint
(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LO
W_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin
1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin
1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20
), `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20),
`NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_
ID`), CONSTRAINT `PART_COL_STATS_FK` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITI
ONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE INDEX PCS_STATS_IDX ON PAR
T_COL_STATS (DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE
Error: Duplicate key name 'PCS_STATS_IDX' (state=42000,code=1061)
Closing: 0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hive?createDatabaseIfNotExist=true
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
Underlying cause: java.io.IOException : Schema script failed, errorcode 2
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:304)
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:277)
at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:526)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.io.IOException: Schema script failed, errorcode 2
at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:410)
at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:367)
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:300)
... 8 more
*** schemaTool failed ***stdout: /var/lib/ambari-agent/data/output-617.txt
2017-07-10 20:22:39,909 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-07-10 20:22:40,105 - Stack Feature Version Info: stack_version=2.6, version=None, current_cluster_version=None -> 2.6
2017-07-10 20:22:40,117 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
User Group mapping (user_group) is missing in the hostLevelParams
2017-07-10 20:22:40,120 - Group['metron'] {}
2017-07-10 20:22:40,121 - Group['livy'] {}
2017-07-10 20:22:40,122 - Group['elasticsearch'] {}
2017-07-10 20:22:40,122 - Group['spark'] {}
2017-07-10 20:22:40,122 - Group['zeppelin'] {}
2017-07-10 20:22:40,122 - Group['hadoop'] {}
2017-07-10 20:22:40,123 - Group['kibana'] {}
2017-07-10 20:22:40,123 - Group['users'] {}
2017-07-10 20:22:40,123 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,125 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,126 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,127 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,128 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,129 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2017-07-10 20:22:40,130 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop']}
2017-07-10 20:22:40,131 - User['metron'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,132 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,132 - User['elasticsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,133 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,134 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2017-07-10 20:22:40,135 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,136 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,137 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,138 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,139 - User['kibana'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,140 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,141 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,142 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,143 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-10 20:22:40,145 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-07-10 20:22:40,151 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-07-10 20:22:40,152 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-07-10 20:22:40,153 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-10 20:22:40,154 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2017-07-10 20:22:40,160 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2017-07-10 20:22:40,160 - Group['hdfs'] {}
2017-07-10 20:22:40,161 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': [u'hadoop', u'hdfs']}
2017-07-10 20:22:40,162 - FS Type:
2017-07-10 20:22:40,162 - Directory['/etc/hadoop'] {'mode': 0755}
2017-07-10 20:22:40,187 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 20:22:40,189 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2017-07-10 20:22:40,210 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2017-07-10 20:22:40,222 - Skipping Execute[('setenforce', '0')] due to only_if
2017-07-10 20:22:40,222 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2017-07-10 20:22:40,225 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2017-07-10 20:22:40,225 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2017-07-10 20:22:40,231 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2017-07-10 20:22:40,234 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2017-07-10 20:22:40,244 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:40,261 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 20:22:40,262 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2017-07-10 20:22:40,263 - File['/usr/hdp/current/hadoop-client/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 20:22:40,270 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2017-07-10 20:22:40,276 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2017-07-10 20:22:40,519 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-07-10 20:22:40,530 - call['ambari-python-wrap /usr/bin/hdp-select status hive-server2'] {'timeout': 20}
2017-07-10 20:22:40,553 - call returned (0, 'hive-server2 - 2.6.1.0-129')
2017-07-10 20:22:40,554 - Stack Feature Version Info: stack_version=2.6, version=None, current_cluster_version=None -> 2.6
2017-07-10 20:22:40,585 - File['/var/lib/ambari-agent/cred/lib/CredentialUtil.jar'] {'content': DownloadSource('http://ip-10-0-1-57.ec2.internal:8080/resources/CredentialUtil.jar'), 'mode': 0755}
2017-07-10 20:22:40,587 - Not downloading the file from http://ip-10-0-1-57.ec2.internal:8080/resources/CredentialUtil.jar, because /var/lib/ambari-agent/tmp/CredentialUtil.jar already exists
2017-07-10 20:22:40,587 - checked_call[('/usr/jdk64/jdk1.8.0_112/bin/java', '-cp', u'/var/lib/ambari-agent/cred/lib/*', 'org.apache.ambari.server.credentialapi.CredentialUtil', 'get', 'javax.jdo.option.ConnectionPassword', '-provider', u'jceks://file/var/lib/ambari-agent/cred/conf/hive/hive-site.jceks')] {}
2017-07-10 20:22:41,540 - checked_call returned (0, 'SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".\nSLF4J: Defaulting to no-operation (NOP) logger implementation\nSLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.\nJul 10, 2017 8:22:41 PM org.apache.hadoop.util.NativeCodeLoader <clinit>\nWARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable\nAdmin')
2017-07-10 20:22:41,552 - Directory['/etc/hive'] {'mode': 0755}
2017-07-10 20:22:41,552 - Directories to fill with configs: [u'/usr/hdp/current/hive-metastore/conf', u'/usr/hdp/current/hive-metastore/conf/conf.server']
2017-07-10 20:22:41,553 - Directory['/etc/hive/2.6.1.0-129/0'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0755}
2017-07-10 20:22:41,553 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/2.6.1.0-129/0', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2017-07-10 20:22:41,564 - Generating config: /etc/hive/2.6.1.0-129/0/mapred-site.xml
2017-07-10 20:22:41,564 - File['/etc/hive/2.6.1.0-129/0/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,605 - File['/etc/hive/2.6.1.0-129/0/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,606 - File['/etc/hive/2.6.1.0-129/0/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,608 - File['/etc/hive/2.6.1.0-129/0/hive-exec-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,611 - File['/etc/hive/2.6.1.0-129/0/hive-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,612 - Directory['/etc/hive/2.6.1.0-129/0/conf.server'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0700}
2017-07-10 20:22:41,612 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/2.6.1.0-129/0/conf.server', 'mode': 0600, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2017-07-10 20:22:41,619 - Generating config: /etc/hive/2.6.1.0-129/0/conf.server/mapred-site.xml
2017-07-10 20:22:41,620 - File['/etc/hive/2.6.1.0-129/0/conf.server/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,660 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,661 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,663 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-exec-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,665 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,666 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks'] {'content': StaticFile('/var/lib/ambari-agent/cred/conf/hive/hive-site.jceks'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0640}
2017-07-10 20:22:41,667 - Writing File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks'] because contents don't match
2017-07-10 20:22:41,667 - XmlConfig['hive-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-metastore/conf/conf.server', 'mode': 0600, 'configuration_attributes': {u'hidden': {u'javax.jdo.option.ConnectionPassword': u'HIVE_CLIENT,WEBHCAT_SERVER,HCAT,CONFIG_DOWNLOAD'}}, 'owner': 'hive', 'configurations': ...}
2017-07-10 20:22:41,675 - Generating config: /usr/hdp/current/hive-metastore/conf/conf.server/hive-site.xml
2017-07-10 20:22:41,676 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,803 - XmlConfig['hivemetastore-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-metastore/conf/conf.server', 'mode': 0600, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': {u'hive.service.metrics.hadoop2.component': u'hivemetastore', u'hive.metastore.metrics.enabled': u'true', u'hive.service.metrics.reporter': u'HADOOP2'}}
2017-07-10 20:22:41,811 - Generating config: /usr/hdp/current/hive-metastore/conf/conf.server/hivemetastore-site.xml
2017-07-10 20:22:41,811 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hivemetastore-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,818 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-env.sh'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,818 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2017-07-10 20:22:41,821 - File['/etc/security/limits.d/hive.conf'] {'content': Template('hive.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2017-07-10 20:22:41,822 - File['/usr/lib/ambari-agent/DBConnectionVerification.jar'] {'content': DownloadSource('http://ip-10-0-1-57.ec2.internal:8080/resources/DBConnectionVerification.jar'), 'mode': 0644}
2017-07-10 20:22:41,822 - Not downloading the file from http://ip-10-0-1-57.ec2.internal:8080/resources/DBConnectionVerification.jar, because /var/lib/ambari-agent/tmp/DBConnectionVerification.jar already exists
2017-07-10 20:22:41,825 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hadoop-metrics2-hivemetastore.properties'] {'content': Template('hadoop-metrics2-hivemetastore.properties.j2'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,826 - File['/var/lib/ambari-agent/tmp/start_metastore_script'] {'content': StaticFile('startMetastore.sh'), 'mode': 0755}
2017-07-10 20:22:41,827 - Directory['/var/run/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2017-07-10 20:22:41,827 - Directory['/var/log/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2017-07-10 20:22:41,828 - Directory['/var/lib/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2017-07-10 20:22:41,829 - Execute['export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-server2-hive2/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED] -verbose'] {'not_if': u"ambari-sudo.sh su hive -l -s /bin/bash -c 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-server2-hive2/bin/schematool -info -dbType mysql -userName hive -passWord [PROTECTED] -verbose'", 'user': 'hive'}
Command failed after 1 tries
Created 07-11-2017 01:01 AM
This is known issue.
To resolve this:
Please take backup of your metastore DB before doing any changes.
On the Hive Metastore installed node:
1) As the error mentions "Initialization script hive-schema-2.1.1000.mysql.sql", check /usr/hdp/current/hive-server2-hive2/scripts/metastore/upgrade/mysql/hive-*schema-2.1.0.mysql.sql
For example:
cd /usr/hdp/current/hive-server2-hive2/scripts/metastore/upgrade/mysql/
grep 'CREATE INDEX' hive-*schema-2.1.0.mysql.sql
hive-schema-2.1.1000.mysql.sql:CREATE INDEX PCS_STATS_IDX ON PART_COL_STATS (DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE; hive-schema-2.1.1000.mysql.sql:CREATE INDEX `CONSTRAINTS_PARENT_TABLE_ID_INDEX` ON KEY_CONSTRAINTS (`PARENT_TBL_ID`) USING BTREE; hive-txn-schema-2.1.0.mysql.sql:CREATE INDEX HL_TXNID_IDX ON HIVE_LOCKS (HL_TXNID);
2) Delete above indexes from MySQL:
Make sure you are using the database that is specified in log above.
Connecting to jdbc:mysql://localhost/hive?createDatabaseIfNotExist=true
use <hivedB> drop index CONSTRAINTS_PARENT_TABLE_ID_INDEX on KEY_CONSTRAINTS; drop index PCS_STATS_IDX on PART_COL_STATS; drop index HL_TXNID_IDX on HIVE_LOCKS;
3) Add "IF NOT EXISTS" in the following tables by editing hive-txn-schema-2.1.0.mysql.sql file:
grep 'CREATE TABLE' hive-*schema-2.1.0.mysql.sql | grep -v 'IF NOT EXISTS' hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE TXNS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE TXN_COMPONENTS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE COMPLETED_TXN_COMPONENTS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE NEXT_TXN_ID ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE HIVE_LOCKS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE NEXT_LOCK_ID ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE COMPACTION_QUEUE ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE COMPLETED_COMPACTIONS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE NEXT_COMPACTION_QUEUE_ID ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE AUX_TABLE ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE WRITE_SET (
For example:
sed -i.bak 's/^CREATE TABLE \([^I][^F]\)/CREATE TABLE IF NOT EXISTS \1/g' hive-txn-schema-2.1.0.mysql.sql
4) Starting Hive Metastore from Ambari
5) After starting the metastore, if the following error happens, remove the conflicting row and start again.
0: jdbc:mysql://sandbox.hortonworks.com/hive> INSERT INTO VERSION (VER_ID, SCHEMA _VERSION, VERSION_COMMENT) VALUES (1, '2.1.0', 'Hive release version 2.1.0') Error: Duplicate entry '1' for key 'PRIMARY' (state=23000,code=1062)
Created 07-11-2017 12:43 AM
@Rahul P you can try below steps:
Log into your mysql db:
# mysql -u root -p -h localhost #use hive; #drop INDEX PCS_STATS_IDX ON PART_COL_STATS;
Restart the metastore.
Created 07-11-2017 01:01 AM
This is known issue.
To resolve this:
Please take backup of your metastore DB before doing any changes.
On the Hive Metastore installed node:
1) As the error mentions "Initialization script hive-schema-2.1.1000.mysql.sql", check /usr/hdp/current/hive-server2-hive2/scripts/metastore/upgrade/mysql/hive-*schema-2.1.0.mysql.sql
For example:
cd /usr/hdp/current/hive-server2-hive2/scripts/metastore/upgrade/mysql/
grep 'CREATE INDEX' hive-*schema-2.1.0.mysql.sql
hive-schema-2.1.1000.mysql.sql:CREATE INDEX PCS_STATS_IDX ON PART_COL_STATS (DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE; hive-schema-2.1.1000.mysql.sql:CREATE INDEX `CONSTRAINTS_PARENT_TABLE_ID_INDEX` ON KEY_CONSTRAINTS (`PARENT_TBL_ID`) USING BTREE; hive-txn-schema-2.1.0.mysql.sql:CREATE INDEX HL_TXNID_IDX ON HIVE_LOCKS (HL_TXNID);
2) Delete above indexes from MySQL:
Make sure you are using the database that is specified in log above.
Connecting to jdbc:mysql://localhost/hive?createDatabaseIfNotExist=true
use <hivedB> drop index CONSTRAINTS_PARENT_TABLE_ID_INDEX on KEY_CONSTRAINTS; drop index PCS_STATS_IDX on PART_COL_STATS; drop index HL_TXNID_IDX on HIVE_LOCKS;
3) Add "IF NOT EXISTS" in the following tables by editing hive-txn-schema-2.1.0.mysql.sql file:
grep 'CREATE TABLE' hive-*schema-2.1.0.mysql.sql | grep -v 'IF NOT EXISTS' hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE TXNS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE TXN_COMPONENTS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE COMPLETED_TXN_COMPONENTS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE NEXT_TXN_ID ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE HIVE_LOCKS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE NEXT_LOCK_ID ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE COMPACTION_QUEUE ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE COMPLETED_COMPACTIONS ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE NEXT_COMPACTION_QUEUE_ID ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE AUX_TABLE ( hive-txn-schema-2.1.0.mysql.sql:CREATE TABLE WRITE_SET (
For example:
sed -i.bak 's/^CREATE TABLE \([^I][^F]\)/CREATE TABLE IF NOT EXISTS \1/g' hive-txn-schema-2.1.0.mysql.sql
4) Starting Hive Metastore from Ambari
5) After starting the metastore, if the following error happens, remove the conflicting row and start again.
0: jdbc:mysql://sandbox.hortonworks.com/hive> INSERT INTO VERSION (VER_ID, SCHEMA _VERSION, VERSION_COMMENT) VALUES (1, '2.1.0', 'Hive release version 2.1.0') Error: Duplicate entry '1' for key 'PRIMARY' (state=23000,code=1062)
Created 10-04-2017 12:08 PM
I had to follow each of the step you mentioned and thanks for the sed command. Cant believe this hasn't been fixed this as yet 🙂