Member since
01-07-2014
7
Posts
1
Kudos Received
0
Solutions
06-29-2017
11:32 AM
Thanks for your help. It turned out that the data nodes did not have the group configured correctly for user1 and that was causing the issue. After that was configured correctly and restarted it worked fine.
... View more
06-28-2017
08:07 PM
1 Kudo
I don't the issue is with Sqoop 1. We have another cluster (with an older version of CDH) where sqoop 1 works with Sentry. Besides, since hive cli doesn't work which maybe the primary reason. Will update the thread with ROLE information.
... View more
06-28-2017
04:17 PM
Yes, I am using -hive-database. Here is the command: sqoop-import --connect jdbc:postgresql://mymachine:5432/db --connection-manager org.apache.sqoop.manager.PGBulkloadManager --table std_clnt_employee --num-mappers 8 --split-by col1 --fields-terminated-by '\t' --target-dir /tmp/sqoop_import --hive-import --create-hive-table --hive-database=default --hive-table=test_pg --direct --verbose -- --schema pg_schema Here is where it fails: 17/06/28 16:12:46 INFO hive.HiveImport: Loading uploaded data into Hive 17/06/28 16:12:46 DEBUG hive.HiveImport: Using in-process Hive instance. 17/06/28 16:12:46 DEBUG util.SubprocessSecurityManager: Installing subprocess security manager 17/06/28 16:12:46 WARN conf.HiveConf: HiveConf of name hive.optimize.mapjoin.mapreduce does not exist 17/06/28 16:12:46 WARN conf.HiveConf: HiveConf of name hive.auto.convert.sortmerge.join.noconditionaltask does not exist 17/06/28 16:12:46 WARN conf.HiveConf: HiveConf of name hive.optimize.mapjoin.mapreduce does not exist 17/06/28 16:12:46 WARN conf.HiveConf: HiveConf of name hive.auto.convert.sortmerge.join.noconditionaltask does not exist Logging initialized using configuration in jar:file:/opt/cloudera/parcels/CDH-5.11.1-1.cdh5.11.1.p0.4/jars/hive-common-1.1.0-cdh5.11.1.jar!/hive-log4j.properties FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:User user1 does not have privileges for CREATETABLE) I can reproduce this error like this: hive> create table test ( a int) ; FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:User user1 does not have privileges for CREATETABLE) However the same command works in beeline : 0: jdbc:hive2://namenode1.corpdom.com:10000/d> create table test ( a int); INFO : Compiling command(queryId=hive_20170628161616_9a2d989d-2abc-468a-862c-47fe6ea630e6): create table test ( a int) INFO : Semantic Analysis Completed INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null) INFO : Completed compiling command(queryId=hive_20170628161616_9a2d989d-2abc-468a-862c-47fe6ea630e6); Time taken: 0.21 seconds INFO : Executing command(queryId=hive_20170628161616_9a2d989d-2abc-468a-862c-47fe6ea630e6): create table test ( a int) INFO : Starting task [Stage-0:DDL] in serial mode INFO : Completed executing command(queryId=hive_20170628161616_9a2d989d-2abc-468a-862c-47fe6ea630e6); Time taken: 0.368 seconds INFO : OK No rows affected (0.807 seconds) We have sentry enabled, but I'm not sure why the permission model would be different.
... View more
06-28-2017
03:32 PM
When importing data from Postgres using Sqoop, I get the following error: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:User user1 does not have privileges for CREATETABLE) However when I use beeline, I am able to create tables using user1. However, if I start the old hive-cli I get the exact same error as above. Is there a way to make sqoop use beeline vs the old hive to create the tables? On CDH 5.11.1, with Sentry enabled.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sqoop