Member since
06-26-2017
24
Posts
2
Kudos Received
0
Solutions
07-20-2017
06:36 PM
@Vipin Rathor I did mention zookeeper clients and kafka broker lists in application.yml file
... View more
07-20-2017
06:34 PM
@Vipin Rathor I should have done this long ago. Well this is my application.yml file server:
port: 8082 spring:
datasource: driverClassName: com.mysql.jdbc.Driver
url: jdbc:mysql://ip-10-0-1-17.ec2.internal:3306/metronrest username: Admin
password: Admin jpa: hibernate: ddl-auto: update zookeeper: url: {ip-10-0-1-17.ec2.internal: 2181}
kafka: broker: url: {ip-10-0-1-214.ec2.internal: 6667,ip-10-0-1-234.ec2.internal: 6667}
hdfs:
namenode:
url: {ip-10-0-1-17.ec2.internal: 8020} grok:
path:
temp: ./patterns/temp default: /apps/metron/patterns storm: ui: url: {ip-10-0-1-17.ec2.internal} parser: script.path: /usr/hcp/1.1.0.0-71/metron/bin/start_parser_topology.sh enrichment:
script.path: /usr/hcp/1.1.0.0-71/metron/bin/start_enrichment_topology.sh indexing:
script.path: /usr/hcp/1.1.0.0-71/metron/bin/start_elasticsearch_topology.sh
... View more
07-20-2017
02:03 PM
Hello @Vipin Rathor sorry for the delay and thanks for the reply.
It kinda worked now I am not getting any socket errors but insted getting this :
... View more
07-17-2017
04:28 PM
@asubramanian below is my application.yml file. And versions are: Metron 0.4.0.1.1.0.0
hcp is 1.1.0.0-71 server:
port: 8082
spring: datasource:
driver ClassName: com.mysql.jdbc.Driver url: jdbc:mysql://ip-10-0-1-203.ec2.internal:3306/metronrest username: Admin password: Admin platform: h2 jpa: hibernate:
ddl-auto: update zookeeper: url: ${ip-10-0-1-203.ec2.internal:2181,ip-10-0-1-108.ec2.internal:2181,ip-10-0 -1-74.ec2.internal:2181} kafka:
broker:
url: ${ip-10-0-1-108.ec2.internal:6667,ip-10-0-1-74.ec2.internal:6667} hdfs: namenode: url: ${ip-10-0-1-203.ec2.internal:8020} grok: path: temp: ./patterns/temp
default: /apps/metron/patterns storm:
ui:
url: ${ip-10-0-1-203.ec2.internal:8744} parser: script.path: /usr/hcp/1.1.0.0-71/metron/bin/start_parser_topology.sh enrichment:
script.path: /usr/hcp/1.1.0.0-71/metron/bin/start_enrichment_topology.sh indexing:
script.path: /usr/hcp/1.1.0.0-71/metron/bin/start_elasticsearch_topology.sh
... View more
07-17-2017
02:18 PM
Hi , I am trying to run Metron using Ambari on Amazon EC2 instance. I downloaded Metron rest and on a metron node and trying to start the process. But I am getting socket errors. Help much appreciated.
... View more
Labels:
- Labels:
-
Apache Metron
07-17-2017
02:14 PM
Hi , I am trying to run Metron using Ambari on Amazon EC2 instance. I downloaded Metron rest and on a metron node and trying to start the process. But I am getting socket errors. Help much appreciated.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Metron
07-14-2017
08:19 PM
Follow up : The error I am actually getting is below :
... View more
07-14-2017
05:13 PM
SO basically my MySQL server is running on Node 1. In that I created users and stuff. On Node 2 the HCP package (Metron) is installed. While configuring the managment module I did give rest-host as Node2's public ip (NOTE: METRON REST AND MANAGMENT MODULE ARE RUNNING ON THE SAME INSTANCE AND HAVE SAME PUBLIC IP) along with port num 8082. Now when I try to access the managment module with :4200 it takes me no where. The page remains static. In the background when I run the ./bin/start_managment-ui.sh with the port num and rest-host:port-num it does'nt terminate after running. Instead is giving me kind of logs for the managment UI.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Metron
07-14-2017
02:12 PM
@Lee Adrian Well i tried using bro plugin for kafka, but I am getting errors. Do you have any documentation with steps to follow ?
... View more
07-13-2017
10:23 PM
@Laurens Vets Thanks for replying. I figured out myself. The thing was the HDP package was not compatible with Metron. I was using an older version of HDP with newer version of Metron.
... View more
07-13-2017
10:20 PM
No I cannot access it. I tried everything even adding them into the root group. But it is not allowing me.
... View more
07-13-2017
04:44 PM
@asubramanian I installed Metron using Ambari. How do I configure snort,bro and yaf ?? Could you please tell me
... View more
07-13-2017
03:10 PM
Labels:
- Labels:
-
Apache Ambari
-
Apache Metron
07-11-2017
09:20 PM
stderr: /var/lib/ambari-agent/data/errors-82.txt Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/service_check.py", line 75, in <module>
NifiServiceCheck().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/service_check.py", line 45, in service_check
NifiServiceCheck.check_nifi_portal(url)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py", line 55, in wrapper
return function(*args, **kwargs)
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/service_check.py", line 68, in check_nifi_portal
raise Fail("Error connecting to {0}. Reason - {1}.".format(url, e.reason))
resource_management.core.exceptions.Fail: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused. stdout: /var/lib/ambari-agent/data/output-82.txt 2017-07-11 21:11:08,487 - Stack Feature Version Info: stack_version=2.1, version=None, current_cluster_version=2.1.4.0-5 -> 2.1
2017-07-11 21:11:08,496 - Running Nifi service check
2017-07-11 21:11:08,496 - Checking Nifi portal https://ip-10-0-1-156.ec2.internal:9091/nifi status
2017-07-11 21:11:08,498 - Will retry 14 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 5 sec(s)
2017-07-11 21:11:13,505 - Will retry 13 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 10 sec(s)
2017-07-11 21:11:23,515 - Will retry 12 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:11:43,536 - Will retry 11 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:12:03,554 - Will retry 10 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:12:23,571 - Will retry 9 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:12:43,594 - Will retry 8 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:13:03,615 - Will retry 7 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:13:23,634 - Will retry 6 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:13:43,654 - Will retry 5 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:14:03,668 - Will retry 4 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:14:23,683 - Will retry 3 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:14:43,705 - Will retry 2 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
2017-07-11 21:15:03,722 - Will retry 1 time(s), caught exception: Error connecting to https://ip-10-0-1-156.ec2.internal:9091/nifi. Reason - [Errno 111] Connection refused.. Sleeping for 20 sec(s)
Command failed after 1 tries
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache NiFi
07-10-2017
08:31 PM
stderr: /var/lib/ambari-agent/data/errors-617.txt Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 260, in <module>
HiveMetastore().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 314, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py", line 60, in start
create_metastore_schema()
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py", line 371, in create_metastore_schema
user = params.hive_user
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-server2-hive2/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED] -verbose' returned 1. SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hive2/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.6.1.0-129/hadoop/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:mysql://ip-10-0-1-45.ec2.internal/hive?createDatabaseIfNotExist=true
Metastore Connection Driver : com.mysql.jdbc.Driver
Metastore connection User: hive
Starting metastore schema initialization to 2.1.1000
Initialization script hive-schema-2.1.1000.mysql.sql
Connecting to jdbc:mysql://ip-10-0-1-45.ec2.internal/hive?createDatabaseIfNotExist=true
Connected to: MySQL (version 5.6.36)
Driver: MySQL Connector Java (version mysql-connector-java-5.1.25-SNAPSHOT ( Revision: ${bzr.revision-id} ))
Transaction isolation: TRANSACTION_READ_COMMITTED
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> !autocommit on
Autocommit status: true
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_CHARACTER_SET_C
LIENT=@@CHARACTER_SET_CLIENT */
No rows affected (0.021 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_CHARACTER_SET_R
ESULTS=@@CHARACTER_SET_RESULTS */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_COLLATION_CONNE
CTION=@@COLLATION_CONNECTION */
No rows affected (0.013 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET NAMES utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40103 SET @OLD_TIME_ZONE=@@TIM
E_ZONE */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40103 SET TIME_ZONE='+00:00' *
/
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40014 SET @OLD_UNIQUE_CHECKS=@
@UNIQUE_CHECKS, UNIQUE_CHECKS=0 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40014 SET @OLD_FOREIGN_KEY_CHE
CKS=@@FOREIGN_KEY_CHECKS, FOREIGN_KEY_CHECKS=0 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @OLD_SQL_MODE=@@SQL_
MODE, SQL_MODE='NO_AUTO_VALUE_ON_ZERO' */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40111 SET @OLD_SQL_NOTES=@@SQL
_NOTES, SQL_NOTES=0 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `BUCKE
TING_COLS` ( `SD_ID` bigint(20) NOT NULL, `BUCKET_COL_NAME` varchar(256) CHARACT
ER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL, P
RIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `BUCKETING_COLS_N49` (`SD_ID`), CONSTRAI
NT `BUCKETING_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGIN
E=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.008 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.008 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `CDS`
( `CD_ID` bigint(20) NOT NULL, PRIMARY KEY (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHA
RSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `COLUM
NS_V2` ( `CD_ID` bigint(20) NOT NULL, `COMMENT` varchar(256) CHARACTER SET latin
1 COLLATE latin1_bin DEFAULT NULL, `COLUMN_NAME` varchar(767) CHARACTER SET lati
n1 COLLATE latin1_bin NOT NULL, `TYPE_NAME` varchar(4000) DEFAULT NULL, `INTEGER
_IDX` int(11) NOT NULL, PRIMARY KEY (`CD_ID`,`COLUMN_NAME`), KEY `COLUMNS_V2_N49
` (`CD_ID`), CONSTRAINT `COLUMNS_V2_FK1` FOREIGN KEY (`CD_ID`) REFERENCES `CDS`
(`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `DATAB
ASE_PARAMS` ( `DB_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(180) CHARACTER SE
T latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`,`PARAM_KEY`), KEY `
DATABASE_PARAMS_N49` (`DB_ID`), CONSTRAINT `DATABASE_PARAMS_FK1` FOREIGN KEY (`D
B_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `DBS`
( `DB_ID` bigint(20) NOT NULL, `DESC` varchar(4000) CHARACTER SET latin1 COLLATE
latin1_bin DEFAULT NULL, `DB_LOCATION_URI` varchar(4000) CHARACTER SET latin1 C
OLLATE latin1_bin NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 COLLATE lat
in1_bin DEFAULT NULL, `OWNER_NAME` varchar(128) CHARACTER SET latin1 COLLATE lat
in1_bin DEFAULT NULL, `OWNER_TYPE` varchar(10) CHARACTER SET latin1 COLLATE lati
n1_bin DEFAULT NULL, PRIMARY KEY (`DB_ID`), UNIQUE KEY `UNIQUE_DATABASE` (`NAME`
) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `DB_PR
IVS` ( `DB_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID
` bigint(20) DEFAULT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varcha
r(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varc
har(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME`
varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TY
PE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `DB_PRIV`
varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY
(`DB_GRANT_ID`), UNIQUE KEY `DBPRIVILEGEINDEX` (`DB_ID`,`PRINCIPAL_NAME`,`PRINCI
PAL_TYPE`,`DB_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `DB_PRIVS_N49` (`DB_ID`), CON
STRAINT `DB_PRIVS_FK1` FOREIGN KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE
=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `GLOBA
L_PRIVS` ( `USER_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL,
`GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET lati
n1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin DEFAULT NULL, `USER_PRIV` varchar(128) CHARACTER S
ET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`USER_GRANT_ID`), UNIQUE
KEY `GLOBALPRIVILEGEINDEX` (`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`USER_PRIV`,`GRAN
TOR`,`GRANTOR_TYPE`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.006 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `IDXS`
( `INDEX_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DEFERRED_REB
UILD` bit(1) NOT NULL, `INDEX_HANDLER_CLASS` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `INDEX_NAME` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `INDEX_TBL_ID` bigint(20) DEFAULT NULL, `LAST_A
CCESS_TIME` int(11) NOT NULL, `ORIG_TBL_ID` bigint(20) DEFAULT NULL, `SD_ID` big
int(20) DEFAULT NULL, PRIMARY KEY (`INDEX_ID`), UNIQUE KEY `UNIQUEINDEX` (`INDEX
_NAME`,`ORIG_TBL_ID`), KEY `IDXS_N51` (`SD_ID`), KEY `IDXS_N50` (`INDEX_TBL_ID`)
, KEY `IDXS_N49` (`ORIG_TBL_ID`), CONSTRAINT `IDXS_FK1` FOREIGN KEY (`ORIG_TBL_I
D`) REFERENCES `TBLS` (`TBL_ID`), CONSTRAINT `IDXS_FK2` FOREIGN KEY (`SD_ID`) RE
FERENCES `SDS` (`SD_ID`), CONSTRAINT `IDXS_FK3` FOREIGN KEY (`INDEX_TBL_ID`) REF
ERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `INDEX
_PARAMS` ( `INDEX_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SE
T latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`INDEX_ID`,`PARAM_KEY`), KE
Y `INDEX_PARAMS_N49` (`INDEX_ID`), CONSTRAINT `INDEX_PARAMS_FK1` FOREIGN KEY (`I
NDEX_ID`) REFERENCES `IDXS` (`INDEX_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `NUCLE
US_TABLES` ( `CLASS_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin N
OT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin NOT N
ULL, `TYPE` varchar(4) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `OWNER`
varchar(2) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `VERSION` varchar(
20) CHARACTER SET latin1 COLLATE latin1_bin NOT NULL, `INTERFACE_NAME` varchar(2
55) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`CLASS_NA
ME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TIONS` ( `PART_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `LAST_AC
CESS_TIME` int(11) NOT NULL, `PART_NAME` varchar(767) CHARACTER SET latin1 COLLA
TE latin1_bin DEFAULT NULL, `SD_ID` bigint(20) DEFAULT NULL, `TBL_ID` bigint(20)
DEFAULT NULL, PRIMARY KEY (`PART_ID`), UNIQUE KEY `UNIQUEPARTITION` (`PART_NAME
`,`TBL_ID`), KEY `PARTITIONS_N49` (`TBL_ID`), KEY `PARTITIONS_N50` (`SD_ID`), CO
NSTRAINT `PARTITIONS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`), C
ONSTRAINT `PARTITIONS_FK2` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) EN
GINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_EVENTS` ( `PART_NAME_ID` bigint(20) NOT NULL, `DB_NAME` varchar(128) CHARAC
TER SET latin1 COLLATE latin1_bin DEFAULT NULL, `EVENT_TIME` bigint(20) NOT NULL
, `EVENT_TYPE` int(11) NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET lat
in1 COLLATE latin1_bin DEFAULT NULL, `TBL_NAME` varchar(128) CHARACTER SET latin
1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_NAME_ID`), KEY `PARTITIONE
VENTINDEX` (`PARTITION_NAME`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.01 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.006 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_KEYS` ( `TBL_ID` bigint(20) NOT NULL, `PKEY_COMMENT` varchar(4000) CHARACTE
R SET latin1 COLLATE latin1_bin DEFAULT NULL, `PKEY_NAME` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin NOT NULL, `PKEY_TYPE` varchar(767) CHARACTER SET
latin1 COLLATE latin1_bin NOT NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY
(`TBL_ID`,`PKEY_NAME`), KEY `PARTITION_KEYS_N49` (`TBL_ID`), CONSTRAINT `PARTITI
ON_KEYS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB
DEFAULT CHARSET=latin1
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_KEY_VALS` ( `PART_ID` bigint(20) NOT NULL, `PART_KEY_VAL` varchar(256) CHAR
ACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL
, PRIMARY KEY (`PART_ID`,`INTEGER_IDX`), KEY `PARTITION_KEY_VALS_N49` (`PART_ID`
), CONSTRAINT `PARTITION_KEY_VALS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTI
TIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PARTI
TION_PARAMS` ( `PART_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER
SET latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER S
ET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`PART_ID`,`PARAM_KEY`),
KEY `PARTITION_PARAMS_N49` (`PART_ID`), CONSTRAINT `PARTITION_PARAMS_FK1` FOREIG
N KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CH
ARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PART_
COL_PRIVS` ( `PART_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(1
000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11)
NOT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACT
ER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL
, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT
NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFA
ULT NULL, `PART_COL_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin D
EFAULT NULL, PRIMARY KEY (`PART_COLUMN_GRANT_ID`), KEY `PART_COL_PRIVS_N49` (`PA
RT_ID`), KEY `PARTITIONCOLUMNPRIVILEGEINDEX` (`PART_ID`,`COLUMN_NAME`,`PRINCIPAL
_NAME`,`PRINCIPAL_TYPE`,`PART_COL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), CONSTRAINT `P
ART_COL_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITIONS` (`PART_ID`) )
ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PART_
PRIVS` ( `PART_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `G
RANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 C
OLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `PART_ID` bigint(20) DEFAULT NULL, `PRINCIPAL_
NAME` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCI
PAL_TYPE` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PA
RT_PRIV` varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIM
ARY KEY (`PART_GRANT_ID`), KEY `PARTPRIVILEGEINDEX` (`PART_ID`,`PRINCIPAL_NAME`,
`PRINCIPAL_TYPE`,`PART_PRIV`,`GRANTOR`,`GRANTOR_TYPE`), KEY `PART_PRIVS_N49` (`P
ART_ID`), CONSTRAINT `PART_PRIVS_FK1` FOREIGN KEY (`PART_ID`) REFERENCES `PARTIT
IONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `ROLES
` ( `ROLE_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `OWNER_NAME`
varchar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `ROLE_NAME` v
archar(128) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`
ROLE_ID`), UNIQUE KEY `ROLEENTITYINDEX` (`ROLE_NAME`) ) ENGINE=InnoDB DEFAULT CH
ARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `ROLE_
MAP` ( `ROLE_GRANT_ID` bigint(20) NOT NULL, `ADD_TIME` int(11) NOT NULL, `GRANT_
OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COLLAT
E latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 COLL
ATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET lat
in1 COLLATE latin1_bin DEFAULT NULL, `ROLE_ID` bigint(20) DEFAULT NULL, PRIMARY
KEY (`ROLE_GRANT_ID`), UNIQUE KEY `USERROLEMAPINDEX` (`PRINCIPAL_NAME`,`ROLE_ID`
,`GRANTOR`,`GRANTOR_TYPE`), KEY `ROLE_MAP_N49` (`ROLE_ID`), CONSTRAINT `ROLE_MAP
_FK1` FOREIGN KEY (`ROLE_ID`) REFERENCES `ROLES` (`ROLE_ID`) ) ENGINE=InnoDB DEF
AULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SDS`
( `SD_ID` bigint(20) NOT NULL, `CD_ID` bigint(20) DEFAULT NULL, `INPUT_FORMAT` v
archar(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `IS_COMPRESSE
D` bit(1) NOT NULL, `IS_STOREDASSUBDIRECTORIES` bit(1) NOT NULL, `LOCATION` varc
har(4000) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `NUM_BUCKETS` in
t(11) NOT NULL, `OUTPUT_FORMAT` varchar(4000) CHARACTER SET latin1 COLLATE latin
1_bin DEFAULT NULL, `SERDE_ID` bigint(20) DEFAULT NULL, PRIMARY KEY (`SD_ID`), K
EY `SDS_N49` (`SERDE_ID`), KEY `SDS_N50` (`CD_ID`), CONSTRAINT `SDS_FK1` FOREIGN
KEY (`SERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`), CONSTRAINT `SDS_FK2` FOREIGN
KEY (`CD_ID`) REFERENCES `CDS` (`CD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SD_PA
RAMS` ( `SD_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET lati
n1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SD_ID`,`PARAM_KEY`), KEY `SD_PAR
AMS_N49` (`SD_ID`), CONSTRAINT `SD_PARAMS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES
`SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SEQUE
NCE_TABLE` ( `SEQUENCE_NAME` varchar(255) CHARACTER SET latin1 COLLATE latin1_bi
n NOT NULL, `NEXT_VAL` bigint(20) NOT NULL, PRIMARY KEY (`SEQUENCE_NAME`) ) ENGI
NE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SERDE
S` ( `SERDE_ID` bigint(20) NOT NULL, `NAME` varchar(128) CHARACTER SET latin1 CO
LLATE latin1_bin DEFAULT NULL, `SLIB` varchar(4000) CHARACTER SET latin1 COLLATE
latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARS
ET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SERDE
_PARAMS` ( `SERDE_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SE
T latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`SERDE_ID`,`PARAM_KEY`), KE
Y `SERDE_PARAMS_N49` (`SERDE_ID`), CONSTRAINT `SERDE_PARAMS_FK1` FOREIGN KEY (`S
ERDE_ID`) REFERENCES `SERDES` (`SERDE_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin
1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_COL_NAMES` ( `SD_ID` bigint(20) NOT NULL, `SKEWED_COL_NAME` varchar(256) CHARA
CTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_IDX` int(11) NOT NULL,
PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SKEWED_COL_NAMES_N49` (`SD_ID`), CONS
TRAINT `SKEWED_COL_NAMES_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) )
ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_COL_VALUE_LOC_MAP` ( `SD_ID` bigint(20) NOT NULL, `STRING_LIST_ID_KID` bigint(
20) NOT NULL, `LOCATION` varchar(4000) CHARACTER SET latin1 COLLATE latin1_bin D
EFAULT NULL, PRIMARY KEY (`SD_ID`,`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_L
OC_MAP_N49` (`STRING_LIST_ID_KID`), KEY `SKEWED_COL_VALUE_LOC_MAP_N50` (`SD_ID`)
, CONSTRAINT `SKEWED_COL_VALUE_LOC_MAP_FK2` FOREIGN KEY (`STRING_LIST_ID_KID`) R
EFERENCES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_COL_VALUE_
LOC_MAP_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DE
FAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_STRING_LIST` ( `STRING_LIST_ID` bigint(20) NOT NULL, PRIMARY KEY (`STRING_LIST
_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.005 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.011 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_STRING_LIST_VALUES` ( `STRING_LIST_ID` bigint(20) NOT NULL, `STRING_LIST_VALUE
` varchar(256) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `INTEGER_ID
X` int(11) NOT NULL, PRIMARY KEY (`STRING_LIST_ID`,`INTEGER_IDX`), KEY `SKEWED_S
TRING_LIST_VALUES_N49` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_STRING_LIST_VALUES
_FK1` FOREIGN KEY (`STRING_LIST_ID`) REFERENCES `SKEWED_STRING_LIST` (`STRING_LI
ST_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SKEWE
D_VALUES` ( `SD_ID_OID` bigint(20) NOT NULL, `STRING_LIST_ID_EID` bigint(20) NOT
NULL, `INTEGER_IDX` int(11) NOT NULL, PRIMARY KEY (`SD_ID_OID`,`INTEGER_IDX`),
KEY `SKEWED_VALUES_N50` (`SD_ID_OID`), KEY `SKEWED_VALUES_N49` (`STRING_LIST_ID_
EID`), CONSTRAINT `SKEWED_VALUES_FK2` FOREIGN KEY (`STRING_LIST_ID_EID`) REFEREN
CES `SKEWED_STRING_LIST` (`STRING_LIST_ID`), CONSTRAINT `SKEWED_VALUES_FK1` FORE
IGN KEY (`SD_ID_OID`) REFERENCES `SDS` (`SD_ID`) ) ENGINE=InnoDB DEFAULT CHARSET
=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `SORT_
COLS` ( `SD_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(1000) CHARACTER SET l
atin1 COLLATE latin1_bin DEFAULT NULL, `ORDER` int(11) NOT NULL, `INTEGER_IDX` i
nt(11) NOT NULL, PRIMARY KEY (`SD_ID`,`INTEGER_IDX`), KEY `SORT_COLS_N49` (`SD_I
D`), CONSTRAINT `SORT_COLS_FK1` FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TABLE
_PARAMS` ( `TBL_ID` bigint(20) NOT NULL, `PARAM_KEY` varchar(256) CHARACTER SET
latin1 COLLATE latin1_bin NOT NULL, `PARAM_VALUE` varchar(4000) CHARACTER SET la
tin1 COLLATE latin1_bin DEFAULT NULL, PRIMARY KEY (`TBL_ID`,`PARAM_KEY`), KEY `T
ABLE_PARAMS_N49` (`TBL_ID`), CONSTRAINT `TABLE_PARAMS_FK1` FOREIGN KEY (`TBL_ID`
) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.018 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.004 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TBLS`
( `TBL_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `DB_ID` bigint(
20) DEFAULT NULL, `LAST_ACCESS_TIME` int(11) NOT NULL, `OWNER` varchar(767) CHAR
ACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `RETENTION` int(11) NOT NULL,
`SD_ID` bigint(20) DEFAULT NULL, `TBL_NAME` varchar(128) CHARACTER SET latin1 CO
LLATE latin1_bin DEFAULT NULL, `TBL_TYPE` varchar(128) CHARACTER SET latin1 COLL
ATE latin1_bin DEFAULT NULL, `VIEW_EXPANDED_TEXT` mediumtext, `VIEW_ORIGINAL_TEX
T` mediumtext, PRIMARY KEY (`TBL_ID`), UNIQUE KEY `UNIQUETABLE` (`TBL_NAME`,`DB_
ID`), KEY `TBLS_N50` (`SD_ID`), KEY `TBLS_N49` (`DB_ID`), CONSTRAINT `TBLS_FK1`
FOREIGN KEY (`SD_ID`) REFERENCES `SDS` (`SD_ID`), CONSTRAINT `TBLS_FK2` FOREIGN
KEY (`DB_ID`) REFERENCES `DBS` (`DB_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TBL_C
OL_PRIVS` ( `TBL_COLUMN_GRANT_ID` bigint(20) NOT NULL, `COLUMN_NAME` varchar(100
0) CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `CREATE_TIME` int(11) N
OT NULL, `GRANT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER S
ET latin1 COLLATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER
SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARA
CTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) C
HARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_COL_PRIV` varchar(128)
CHARACTER SET latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAU
LT NULL, PRIMARY KEY (`TBL_COLUMN_GRANT_ID`), KEY `TABLECOLUMNPRIVILEGEINDEX` (`
TBL_ID`,`COLUMN_NAME`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_COL_PRIV`,`GRANTOR`
,`GRANTOR_TYPE`), KEY `TBL_COL_PRIVS_N49` (`TBL_ID`), CONSTRAINT `TBL_COL_PRIVS_
FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`) ) ENGINE=InnoDB DEFAULT
CHARSET=latin1
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET @saved_cs_client
= @@character_set_client */
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= utf8 */
No rows affected (0.003 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TBL_P
RIVS` ( `TBL_GRANT_ID` bigint(20) NOT NULL, `CREATE_TIME` int(11) NOT NULL, `GRA
NT_OPTION` smallint(6) NOT NULL, `GRANTOR` varchar(128) CHARACTER SET latin1 COL
LATE latin1_bin DEFAULT NULL, `GRANTOR_TYPE` varchar(128) CHARACTER SET latin1 C
OLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_NAME` varchar(128) CHARACTER SET lati
n1 COLLATE latin1_bin DEFAULT NULL, `PRINCIPAL_TYPE` varchar(128) CHARACTER SET
latin1 COLLATE latin1_bin DEFAULT NULL, `TBL_PRIV` varchar(128) CHARACTER SET la
tin1 COLLATE latin1_bin DEFAULT NULL, `TBL_ID` bigint(20) DEFAULT NULL, PRIMARY
KEY (`TBL_GRANT_ID`), KEY `TBL_PRIVS_N49` (`TBL_ID`), KEY `TABLEPRIVILEGEINDEX`
(`TBL_ID`,`PRINCIPAL_NAME`,`PRINCIPAL_TYPE`,`TBL_PRIV`,`GRANTOR`,`GRANTOR_TYPE`)
, CONSTRAINT `TBL_PRIVS_FK1` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL_ID`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0.002 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> /*!40101 SET character_set_client
= @saved_cs_client */
No rows affected (0.001 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `TAB_C
OL_STATS` ( `CS_ID` bigint(20) NOT NULL, `DB_NAME` varchar(128) CHARACTER SET la
tin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin1
COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(1000) CHARACTER SET latin1 C
OLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COLL
ATE latin1_bin NOT NULL, `TBL_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint(2
0), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LOW_
VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin1
COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20),
`AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20), `
NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_ID
`), CONSTRAINT `TAB_COL_STATS_FK` FOREIGN KEY (`TBL_ID`) REFERENCES `TBLS` (`TBL
_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE TABLE IF NOT EXISTS `PART_
COL_STATS` ( `CS_ID` bigint(20) NOT NULL, `DB_NAME` varchar(128) CHARACTER SET l
atin1 COLLATE latin1_bin NOT NULL, `TABLE_NAME` varchar(128) CHARACTER SET latin
1 COLLATE latin1_bin NOT NULL, `PARTITION_NAME` varchar(767) CHARACTER SET latin
1 COLLATE latin1_bin NOT NULL, `COLUMN_NAME` varchar(1000) CHARACTER SET latin1
COLLATE latin1_bin NOT NULL, `COLUMN_TYPE` varchar(128) CHARACTER SET latin1 COL
LATE latin1_bin NOT NULL, `PART_ID` bigint(20) NOT NULL, `LONG_LOW_VALUE` bigint
(20), `LONG_HIGH_VALUE` bigint(20), `DOUBLE_HIGH_VALUE` double(53,4), `DOUBLE_LO
W_VALUE` double(53,4), `BIG_DECIMAL_LOW_VALUE` varchar(4000) CHARACTER SET latin
1 COLLATE latin1_bin, `BIG_DECIMAL_HIGH_VALUE` varchar(4000) CHARACTER SET latin
1 COLLATE latin1_bin, `NUM_NULLS` bigint(20) NOT NULL, `NUM_DISTINCTS` bigint(20
), `AVG_COL_LEN` double(53,4), `MAX_COL_LEN` bigint(20), `NUM_TRUES` bigint(20),
`NUM_FALSES` bigint(20), `LAST_ANALYZED` bigint(20) NOT NULL, PRIMARY KEY (`CS_
ID`), CONSTRAINT `PART_COL_STATS_FK` FOREIGN KEY (`PART_ID`) REFERENCES `PARTITI
ONS` (`PART_ID`) ) ENGINE=InnoDB DEFAULT CHARSET=latin1
No rows affected (0 seconds)
0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hiv> CREATE INDEX PCS_STATS_IDX ON PAR
T_COL_STATS (DB_NAME,TABLE_NAME,COLUMN_NAME,PARTITION_NAME) USING BTREE
Error: Duplicate key name 'PCS_STATS_IDX' (state=42000,code=1061)
Closing: 0: jdbc:mysql://ip-10-0-1-45.ec2.internal/hive?createDatabaseIfNotExist=true
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
Underlying cause: java.io.IOException : Schema script failed, errorcode 2
org.apache.hadoop.hive.metastore.HiveMetaException: Schema initialization FAILED! Metastore state would be inconsistent !!
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:304)
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:277)
at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:526)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: java.io.IOException: Schema script failed, errorcode 2
at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:410)
at org.apache.hive.beeline.HiveSchemaTool.runBeeLine(HiveSchemaTool.java:367)
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:300)
... 8 more
*** schemaTool failed *** stdout: /var/lib/ambari-agent/data/output-617.txt 2017-07-10 20:22:39,909 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-07-10 20:22:40,105 - Stack Feature Version Info: stack_version=2.6, version=None, current_cluster_version=None -> 2.6
2017-07-10 20:22:40,117 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
User Group mapping (user_group) is missing in the hostLevelParams
2017-07-10 20:22:40,120 - Group['metron'] {}
2017-07-10 20:22:40,121 - Group['livy'] {}
2017-07-10 20:22:40,122 - Group['elasticsearch'] {}
2017-07-10 20:22:40,122 - Group['spark'] {}
2017-07-10 20:22:40,122 - Group['zeppelin'] {}
2017-07-10 20:22:40,122 - Group['hadoop'] {}
2017-07-10 20:22:40,123 - Group['kibana'] {}
2017-07-10 20:22:40,123 - Group['users'] {}
2017-07-10 20:22:40,123 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,125 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,126 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,127 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,128 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,129 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2017-07-10 20:22:40,130 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop']}
2017-07-10 20:22:40,131 - User['metron'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,132 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,132 - User['elasticsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,133 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,134 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2017-07-10 20:22:40,135 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,136 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,137 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,138 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,139 - User['kibana'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,140 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,141 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,142 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 20:22:40,143 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-10 20:22:40,145 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-07-10 20:22:40,151 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-07-10 20:22:40,152 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-07-10 20:22:40,153 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-10 20:22:40,154 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2017-07-10 20:22:40,160 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2017-07-10 20:22:40,160 - Group['hdfs'] {}
2017-07-10 20:22:40,161 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': [u'hadoop', u'hdfs']}
2017-07-10 20:22:40,162 - FS Type:
2017-07-10 20:22:40,162 - Directory['/etc/hadoop'] {'mode': 0755}
2017-07-10 20:22:40,187 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 20:22:40,189 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2017-07-10 20:22:40,210 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2017-07-10 20:22:40,222 - Skipping Execute[('setenforce', '0')] due to only_if
2017-07-10 20:22:40,222 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2017-07-10 20:22:40,225 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2017-07-10 20:22:40,225 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2017-07-10 20:22:40,231 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2017-07-10 20:22:40,234 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2017-07-10 20:22:40,244 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:40,261 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 20:22:40,262 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2017-07-10 20:22:40,263 - File['/usr/hdp/current/hadoop-client/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 20:22:40,270 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2017-07-10 20:22:40,276 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2017-07-10 20:22:40,519 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-07-10 20:22:40,530 - call['ambari-python-wrap /usr/bin/hdp-select status hive-server2'] {'timeout': 20}
2017-07-10 20:22:40,553 - call returned (0, 'hive-server2 - 2.6.1.0-129')
2017-07-10 20:22:40,554 - Stack Feature Version Info: stack_version=2.6, version=None, current_cluster_version=None -> 2.6
2017-07-10 20:22:40,585 - File['/var/lib/ambari-agent/cred/lib/CredentialUtil.jar'] {'content': DownloadSource('http://ip-10-0-1-57.ec2.internal:8080/resources/CredentialUtil.jar'), 'mode': 0755}
2017-07-10 20:22:40,587 - Not downloading the file from http://ip-10-0-1-57.ec2.internal:8080/resources/CredentialUtil.jar, because /var/lib/ambari-agent/tmp/CredentialUtil.jar already exists
2017-07-10 20:22:40,587 - checked_call[('/usr/jdk64/jdk1.8.0_112/bin/java', '-cp', u'/var/lib/ambari-agent/cred/lib/*', 'org.apache.ambari.server.credentialapi.CredentialUtil', 'get', 'javax.jdo.option.ConnectionPassword', '-provider', u'jceks://file/var/lib/ambari-agent/cred/conf/hive/hive-site.jceks')] {}
2017-07-10 20:22:41,540 - checked_call returned (0, 'SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".\nSLF4J: Defaulting to no-operation (NOP) logger implementation\nSLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.\nJul 10, 2017 8:22:41 PM org.apache.hadoop.util.NativeCodeLoader <clinit>\nWARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable\nAdmin')
2017-07-10 20:22:41,552 - Directory['/etc/hive'] {'mode': 0755}
2017-07-10 20:22:41,552 - Directories to fill with configs: [u'/usr/hdp/current/hive-metastore/conf', u'/usr/hdp/current/hive-metastore/conf/conf.server']
2017-07-10 20:22:41,553 - Directory['/etc/hive/2.6.1.0-129/0'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0755}
2017-07-10 20:22:41,553 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/2.6.1.0-129/0', 'mode': 0644, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2017-07-10 20:22:41,564 - Generating config: /etc/hive/2.6.1.0-129/0/mapred-site.xml
2017-07-10 20:22:41,564 - File['/etc/hive/2.6.1.0-129/0/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,605 - File['/etc/hive/2.6.1.0-129/0/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,606 - File['/etc/hive/2.6.1.0-129/0/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,608 - File['/etc/hive/2.6.1.0-129/0/hive-exec-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,611 - File['/etc/hive/2.6.1.0-129/0/hive-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0644}
2017-07-10 20:22:41,612 - Directory['/etc/hive/2.6.1.0-129/0/conf.server'] {'owner': 'hive', 'group': 'hadoop', 'create_parents': True, 'mode': 0700}
2017-07-10 20:22:41,612 - XmlConfig['mapred-site.xml'] {'group': 'hadoop', 'conf_dir': '/etc/hive/2.6.1.0-129/0/conf.server', 'mode': 0600, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': ...}
2017-07-10 20:22:41,619 - Generating config: /etc/hive/2.6.1.0-129/0/conf.server/mapred-site.xml
2017-07-10 20:22:41,620 - File['/etc/hive/2.6.1.0-129/0/conf.server/mapred-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,660 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-default.xml.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,661 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-env.sh.template'] {'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,663 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-exec-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,665 - File['/etc/hive/2.6.1.0-129/0/conf.server/hive-log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,666 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks'] {'content': StaticFile('/var/lib/ambari-agent/cred/conf/hive/hive-site.jceks'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0640}
2017-07-10 20:22:41,667 - Writing File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.jceks'] because contents don't match
2017-07-10 20:22:41,667 - XmlConfig['hive-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-metastore/conf/conf.server', 'mode': 0600, 'configuration_attributes': {u'hidden': {u'javax.jdo.option.ConnectionPassword': u'HIVE_CLIENT,WEBHCAT_SERVER,HCAT,CONFIG_DOWNLOAD'}}, 'owner': 'hive', 'configurations': ...}
2017-07-10 20:22:41,675 - Generating config: /usr/hdp/current/hive-metastore/conf/conf.server/hive-site.xml
2017-07-10 20:22:41,676 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,803 - XmlConfig['hivemetastore-site.xml'] {'group': 'hadoop', 'conf_dir': '/usr/hdp/current/hive-metastore/conf/conf.server', 'mode': 0600, 'configuration_attributes': {}, 'owner': 'hive', 'configurations': {u'hive.service.metrics.hadoop2.component': u'hivemetastore', u'hive.metastore.metrics.enabled': u'true', u'hive.service.metrics.reporter': u'HADOOP2'}}
2017-07-10 20:22:41,811 - Generating config: /usr/hdp/current/hive-metastore/conf/conf.server/hivemetastore-site.xml
2017-07-10 20:22:41,811 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hivemetastore-site.xml'] {'owner': 'hive', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0600, 'encoding': 'UTF-8'}
2017-07-10 20:22:41,818 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hive-env.sh'] {'content': InlineTemplate(...), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,818 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2017-07-10 20:22:41,821 - File['/etc/security/limits.d/hive.conf'] {'content': Template('hive.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2017-07-10 20:22:41,822 - File['/usr/lib/ambari-agent/DBConnectionVerification.jar'] {'content': DownloadSource('http://ip-10-0-1-57.ec2.internal:8080/resources/DBConnectionVerification.jar'), 'mode': 0644}
2017-07-10 20:22:41,822 - Not downloading the file from http://ip-10-0-1-57.ec2.internal:8080/resources/DBConnectionVerification.jar, because /var/lib/ambari-agent/tmp/DBConnectionVerification.jar already exists
2017-07-10 20:22:41,825 - File['/usr/hdp/current/hive-metastore/conf/conf.server/hadoop-metrics2-hivemetastore.properties'] {'content': Template('hadoop-metrics2-hivemetastore.properties.j2'), 'owner': 'hive', 'group': 'hadoop', 'mode': 0600}
2017-07-10 20:22:41,826 - File['/var/lib/ambari-agent/tmp/start_metastore_script'] {'content': StaticFile('startMetastore.sh'), 'mode': 0755}
2017-07-10 20:22:41,827 - Directory['/var/run/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2017-07-10 20:22:41,827 - Directory['/var/log/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2017-07-10 20:22:41,828 - Directory['/var/lib/hive'] {'owner': 'hive', 'create_parents': True, 'group': 'hadoop', 'mode': 0755, 'cd_access': 'a'}
2017-07-10 20:22:41,829 - Execute['export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-server2-hive2/bin/schematool -initSchema -dbType mysql -userName hive -passWord [PROTECTED] -verbose'] {'not_if': u"ambari-sudo.sh su hive -l -s /bin/bash -c 'export HIVE_CONF_DIR=/usr/hdp/current/hive-metastore/conf/conf.server ; /usr/hdp/current/hive-server2-hive2/bin/schematool -info -dbType mysql -userName hive -passWord [PROTECTED] -verbose'", 'user': 'hive'}
Command failed after 1 tries
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Metron
07-10-2017
03:27 PM
@Jay SenSharma I changed the password size and it worked. Thanks
... View more
07-10-2017
03:26 PM
@Simon Elliston Ball stderr: /var/lib/ambari-agent/data/errors-583.txt Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/METRON/0.4.0.1.1.0.0/package/scripts/enrichment_master.py", line 113, in <module>
Enrichment().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 314, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/METRON/0.4.0.1.1.0.0/package/scripts/enrichment_master.py", line 74, in start
commands.start_enrichment_topology()
File "/var/lib/ambari-agent/cache/common-services/METRON/0.4.0.1.1.0.0/package/scripts/enrichment_commands.py", line 146, in start_enrichment_topology
user=self.__params.metron_user)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 262, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/hcp/1.1.0.0-71/metron/bin/start_enrichment_topology.sh -s enrichment -z ip-10-0-1-45.ec2.internal:2181' returned 127. /usr/hcp/1.1.0.0-71/metron/bin/start_enrichment_topology.sh: line 22: storm: command not found stdout: /var/lib/ambari-agent/data/output-583.txt 2017-07-10 15:11:58,099 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-07-10 15:11:58,245 - Stack Feature Version Info: stack_version=2.5, version=None, current_cluster_version=None -> 2.5
2017-07-10 15:11:58,252 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
User Group mapping (user_group) is missing in the hostLevelParams
2017-07-10 15:11:58,253 - Group['metron'] {}
2017-07-10 15:11:58,253 - Group['livy'] {}
2017-07-10 15:11:58,254 - Group['elasticsearch'] {}
2017-07-10 15:11:58,254 - Group['spark'] {}
2017-07-10 15:11:58,254 - Group['zeppelin'] {}
2017-07-10 15:11:58,254 - Group['hadoop'] {}
2017-07-10 15:11:58,254 - Group['kibana'] {}
2017-07-10 15:11:58,255 - Group['users'] {}
2017-07-10 15:11:58,255 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,256 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,256 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,257 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,257 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2017-07-10 15:11:58,258 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop']}
2017-07-10 15:11:58,258 - User['metron'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,259 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,259 - User['elasticsearch'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,260 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,260 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}
2017-07-10 15:11:58,261 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,261 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,262 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,262 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,263 - User['kibana'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,263 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,264 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,265 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-10 15:11:58,265 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-10 15:11:58,266 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-07-10 15:11:58,271 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-07-10 15:11:58,271 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-07-10 15:11:58,272 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-10 15:11:58,273 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2017-07-10 15:11:58,277 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2017-07-10 15:11:58,277 - Group['hdfs'] {}
2017-07-10 15:11:58,277 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': [u'hadoop', u'hdfs']}
2017-07-10 15:11:58,278 - FS Type:
2017-07-10 15:11:58,278 - Directory['/etc/hadoop'] {'mode': 0755}
2017-07-10 15:11:58,290 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 15:11:58,291 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2017-07-10 15:11:58,304 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2017-07-10 15:11:58,312 - Skipping Execute[('setenforce', '0')] due to only_if
2017-07-10 15:11:58,312 - Directory['/var/log/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'hadoop', 'mode': 0775, 'cd_access': 'a'}
2017-07-10 15:11:58,314 - Directory['/var/run/hadoop'] {'owner': 'root', 'create_parents': True, 'group': 'root', 'cd_access': 'a'}
2017-07-10 15:11:58,314 - Directory['/tmp/hadoop-hdfs'] {'owner': 'hdfs', 'create_parents': True, 'cd_access': 'a'}
2017-07-10 15:11:58,318 - File['/usr/hdp/current/hadoop-client/conf/commons-logging.properties'] {'content': Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2017-07-10 15:11:58,319 - File['/usr/hdp/current/hadoop-client/conf/health_check'] {'content': Template('health_check.j2'), 'owner': 'hdfs'}
2017-07-10 15:11:58,325 - File['/usr/hdp/current/hadoop-client/conf/log4j.properties'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2017-07-10 15:11:58,334 - File['/usr/hdp/current/hadoop-client/conf/hadoop-metrics2.properties'] {'content': Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 15:11:58,334 - File['/usr/hdp/current/hadoop-client/conf/task-log4j.properties'] {'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2017-07-10 15:11:58,335 - File['/usr/hdp/current/hadoop-client/conf/configuration.xsl'] {'owner': 'hdfs', 'group': 'hadoop'}
2017-07-10 15:11:58,339 - File['/etc/hadoop/conf/topology_mappings.data'] {'owner': 'hdfs', 'content': Template('topology_mappings.data.j2'), 'only_if': 'test -d /etc/hadoop/conf', 'group': 'hadoop'}
2017-07-10 15:11:58,342 - File['/etc/hadoop/conf/topology_script.py'] {'content': StaticFile('topology_script.py'), 'only_if': 'test -d /etc/hadoop/conf', 'mode': 0755}
2017-07-10 15:11:58,514 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2017-07-10 15:11:58,515 - Running enrichment configure
2017-07-10 15:11:58,521 - File['/usr/hcp/1.1.0.0-71/metron/config/enrichment.properties'] {'owner': 'metron', 'content': Template('enrichment.properties.j2'), 'group': 'metron'}
2017-07-10 15:11:58,523 - Calling security setup
2017-07-10 15:11:58,524 - Create Metron Local Config Directory
2017-07-10 15:11:58,524 - Configure Metron global.json
2017-07-10 15:11:58,524 - Directory['/usr/hcp/1.1.0.0-71/metron/config/zookeeper'] {'owner': 'metron', 'group': 'metron', 'mode': 0755}
2017-07-10 15:11:58,526 - File['/usr/hcp/1.1.0.0-71/metron/config/zookeeper/global.json'] {'content': InlineTemplate(...), 'owner': 'metron'}
2017-07-10 15:11:58,528 - File['/usr/hcp/1.1.0.0-71/metron/config/zookeeper/../elasticsearch.properties'] {'content': InlineTemplate(...), 'owner': 'metron'}
2017-07-10 15:11:58,529 - Loading config into ZooKeeper
2017-07-10 15:11:58,530 - Execute['/usr/hcp/1.1.0.0-71/metron/bin/zk_load_configs.sh --mode PUSH -i /usr/hcp/1.1.0.0-71/metron/config/zookeeper -z ip-10-0-1-45.ec2.internal:2181'] {'path': [u'/usr/jdk64/jdk1.8.0_112/bin']}
2017-07-10 15:12:00,695 - Starting Metron enrichment topology: enrichment
2017-07-10 15:12:00,695 - Starting enrichment
2017-07-10 15:12:00,695 - Execute['/usr/hcp/1.1.0.0-71/metron/bin/start_enrichment_topology.sh -s enrichment -z ip-10-0-1-45.ec2.internal:2181'] {'user': 'metron'}
Command failed after 1 tries
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Metron
07-09-2017
02:10 AM
1 Kudo
tderr: /var/lib/ambari-agent/data/errors-41.txt Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 360, in <module>
Master().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 164, in start
self.configure(env, is_starting = True)
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 145, in configure
params.nifi_flow_config_dir, params.nifi_sensitive_props_key, is_starting)
File "/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/scripts/nifi.py", line 298, in encrypt_sensitive_properties
Execute(encrypt_config_script_prefix, user=nifi_user,logoutput=False)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 273, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'JAVA_HOME=/usr/jdk64/jdk1.8.0_77 /var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/files/nifi-toolkit-1.1.0.2.1.2.0-10/bin/encrypt-config.sh -v -b /usr/hdf/current/nifi/conf/bootstrap.conf -n /usr/hdf/current/nifi/conf/nifi.properties -p '[PROTECTED]'' returned 4. 2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: Handling encryption of nifi.properties
2017/07/09 01:58:34 WARN [main] org.apache.nifi.properties.ConfigEncryptionTool: The source nifi.properties and destination nifi.properties are identical [/usr/hdf/current/nifi/conf/nifi.properties] so the original will be overwritten
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: bootstrap.conf: /usr/hdf/current/nifi/conf/bootstrap.conf
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: (src) nifi.properties: /usr/hdf/current/nifi/conf/nifi.properties
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: (dest) nifi.properties: /usr/hdf/current/nifi/conf/nifi.properties
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: (src) login-identity-providers.xml: null
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: (dest) login-identity-providers.xml: null
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: (src) flow.xml.gz: null
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.ConfigEncryptionTool: (dest) flow.xml.gz: null
2017/07/09 01:58:34 INFO [main] org.apache.nifi.properties.NiFiPropertiesLoader: Loaded 116 properties from /usr/hdf/current/nifi/conf/nifi.properties
2017/07/09 01:58:35 ERROR [main] org.apache.nifi.properties.ConfigEncryptionTool: Encountered an error
java.security.KeyException: Cannot derive key from empty/short password -- password must be at least 12 characters
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:80)
at org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:74)
at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:60)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:235)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:247)
at org.apache.nifi.properties.ConfigEncryptionTool.deriveKeyFromPassword(ConfigEncryptionTool.groovy:1042)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite$StaticMetaMethodSiteNoUnwrapNoCoerce.invoke(StaticMetaMethodSite.java:151)
at org.codehaus.groovy.runtime.callsite.StaticMetaMethodSite.callStatic(StaticMetaMethodSite.java:102)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:56)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:194)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:206)
at org.apache.nifi.properties.ConfigEncryptionTool.getKeyInternal(ConfigEncryptionTool.groovy:362)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:210)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:59)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:52)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:154)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:190)
at org.apache.nifi.properties.ConfigEncryptionTool.getKey(ConfigEncryptionTool.groovy:377)
at org.apache.nifi.properties.ConfigEncryptionTool.getKey(ConfigEncryptionTool.groovy:376)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:210)
at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.call(PogoMetaMethodSite.java:71)
at org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:117)
at org.apache.nifi.properties.ConfigEncryptionTool.main(ConfigEncryptionTool.groovy:1105)
Cannot derive key from empty/short password -- password must be at least 12 characters
usage: org.apache.nifi.properties.ConfigEncryptionTool [-A <arg>] [-b <arg>] [-e <arg>] [-f <arg>] [-g <arg>] [-h] [-i <arg>] [-k <arg>] [-l <arg>] [-m] [-n
<arg>] [-o <arg>] [-p <arg>] [-P <arg>] [-r] [-s <arg>] [-v] [-w <arg>] [-x]
This tool reads from a nifi.properties and/or login-identity-providers.xml file with plain sensitive configuration values, prompts the user for a master key,
and encrypts each value. It will replace the plain value with the protected value in the same file (or write to a new file if specified). It can also be used to
migrate already-encrypted values in those files or in flow.xml.gz to be encrypted with a new key.
-A,--newFlowAlgorithm <arg> The algorithm to use to encrypt the sensitive processor properties in flow.xml.gz
-b,--bootstrapConf <arg> The bootstrap.conf file to persist master key
-e,--oldKey <arg> The old raw hexadecimal key to use during key migration
-f,--flowXml <arg> The flow.xml.gz file currently protected with old password (will be overwritten)
-g,--outputFlowXml <arg> The destination flow.xml.gz file containing protected config values (will not modify input flow.xml.gz)
-h,--help Prints this usage message
-i,--outputLoginIdentityProviders <arg> The destination login-identity-providers.xml file containing protected config values (will not modify input
login-identity-providers.xml)
-k,--key <arg> The raw hexadecimal key to use to encrypt the sensitive properties
-l,--loginIdentityProviders <arg> The login-identity-providers.xml file containing unprotected config values (will be overwritten)
-m,--migrate If provided, the nifi.properties and/or login-identity-providers.xml sensitive properties will be re-encrypted with a
new key
-n,--niFiProperties <arg> The nifi.properties file containing unprotected config values (will be overwritten)
-o,--outputNiFiProperties <arg> The destination nifi.properties file containing protected config values (will not modify input nifi.properties)
-p,--password <arg> The password from which to derive the key to use to encrypt the sensitive properties
-P,--newFlowProvider <arg> The security provider to use to encrypt the sensitive processor properties in flow.xml.gz
-r,--useRawKey If provided, the secure console will prompt for the raw key value in hexadecimal form
-s,--propsKey <arg> The password or key to use to encrypt the sensitive processor properties in flow.xml.gz
-v,--verbose Sets verbose mode (default false)
-w,--oldPassword <arg> The old password from which to derive the key during migration
-x,--encryptFlowXmlOnly If provided, the properties in flow.xml.gz will be re-encrypted with a new key but the nifi.properties and/or
login-identity-providers.xml files will not be modified
Java home: /usr/jdk64/jdk1.8.0_77
NiFi Toolkit home: /var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/files/nifi-toolkit-1.1.0.2.1.2.0-10 stdout: /var/lib/ambari-agent/data/output-41.txt 2017-07-09 01:58:28,162 - Group['hadoop'] {}
2017-07-09 01:58:28,198 - Group['nifi'] {}
2017-07-09 01:58:28,198 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-09 01:58:28,199 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-09 01:58:28,199 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-09 01:58:28,200 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-09 01:58:28,200 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-07-09 01:58:28,201 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}
2017-07-09 01:58:28,201 - User['nifi'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'nifi']}
2017-07-09 01:58:28,202 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-07-09 01:58:28,224 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-07-09 01:58:28,324 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-07-09 01:58:28,344 - Execute[('setenforce', '0')] {'not_if': '(! which getenforce ) || (which getenforce && getenforce | grep -q Disabled)', 'sudo': True, 'only_if': 'test -f /selinux/enforce'}
2017-07-09 01:58:28,460 - Skipping Execute[('setenforce', '0')] due to only_if
2017-07-09 01:58:28,890 - Stack Feature Version Info: stack_version=2.1, version=2.1.4.0-5, current_cluster_version=2.1.4.0-5 -> 2.1.4.0-5
2017-07-09 01:58:28,934 - Directory['/var/run/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:28,936 - Directory['/var/log/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:28,949 - Directory['/var/lib/nifi'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,018 - Directory['/var/lib/nifi/database_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,018 - Directory['/var/lib/nifi/flowfile_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,019 - Directory['/var/lib/nifi/content_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,019 - Directory['/var/lib/nifi/provenance_repository'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,020 - Directory['/usr/hdf/current/nifi/conf'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,079 - Directory['/var/lib/nifi/conf'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,079 - Directory['/var/lib/nifi/state/local'] {'owner': 'nifi', 'create_parents': True, 'group': 'nifi', 'recursive_ownership': True}
2017-07-09 01:58:29,080 - Directory['/usr/hdf/current/nifi/lib'] {'owner': 'nifi', 'group': 'nifi', 'create_parents': True, 'recursive_ownership': True}
2017-07-09 01:58:29,226 - Directory['/etc/security/limits.d'] {'owner': 'root', 'create_parents': True, 'group': 'root'}
2017-07-09 01:58:29,282 - File['/etc/security/limits.d/nifi.conf'] {'content': Template('nifi.conf.j2'), 'owner': 'root', 'group': 'root', 'mode': 0644}
2017-07-09 01:58:29,293 - PropertiesFile['/usr/hdf/current/nifi/conf/nifi.properties'] {'owner': 'nifi', 'group': 'nifi', 'mode': 0600, 'properties': ...}
2017-07-09 01:58:29,311 - Generating properties file: /usr/hdf/current/nifi/conf/nifi.properties
2017-07-09 01:58:29,311 - File['/usr/hdf/current/nifi/conf/nifi.properties'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0600}
2017-07-09 01:58:29,482 - Writing File['/usr/hdf/current/nifi/conf/nifi.properties'] because contents don't match
2017-07-09 01:58:29,486 - File['/usr/hdf/current/nifi/conf/bootstrap.conf'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0600}
2017-07-09 01:58:29,501 - File['/usr/hdf/current/nifi/conf/logback.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0400}
2017-07-09 01:58:29,515 - File['/usr/hdf/current/nifi/conf/state-management.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0400}
2017-07-09 01:58:29,532 - File['/usr/hdf/current/nifi/conf/authorizers.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0400}
2017-07-09 01:58:29,552 - File['/usr/hdf/current/nifi/conf/login-identity-providers.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0600}
2017-07-09 01:58:29,564 - File['/usr/hdf/current/nifi/bin/nifi-env.sh'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0755}
2017-07-09 01:58:29,577 - File['/usr/hdf/current/nifi/conf/bootstrap-notification-services.xml'] {'owner': 'nifi', 'content': InlineTemplate(...), 'group': 'nifi', 'mode': 0400}
2017-07-09 01:58:29,588 - Encrypting NiFi sensitive configuration properties
2017-07-09 01:58:29,588 - File['/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/files/nifi-toolkit-1.1.0.2.1.2.0-10/bin/encrypt-config.sh'] {'mode': 0755}
2017-07-09 01:58:29,803 - Execute[(u'JAVA_HOME=/usr/jdk64/jdk1.8.0_77', '/var/lib/ambari-agent/cache/common-services/NIFI/1.0.0/package/files/nifi-toolkit-1.1.0.2.1.2.0-10/bin/encrypt-config.sh', '-v', '-b', u'/usr/hdf/current/nifi/conf/bootstrap.conf', '-n', u'/usr/hdf/current/nifi/conf/nifi.properties', '-p', [PROTECTED])] {'logoutput': False, 'user': 'nifi'}
Command failed after 1 tries That is the error log.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache NiFi
06-26-2017
08:41 PM
Hi I'm also trying to deply metron on AWS. But I'm getting errors. Could you please help me out ?
... View more
06-26-2017
03:47 PM
Follow up question: I used run.sh script in amazon-ec2 guthub repository but getting error : "ERROR! the file_name '/root/playbooks/metron_full_install.yml' does not exist, or is not readable " !! Please help.
... View more