About alpesh_verani_c

alpesh_verani_c · ‎09-07-2018

I am able to create external table on s3 using hive. It is giving above issue only in Hiveserver2/beeline.

alpesh_verani_c · ‎09-07-2018

Hi, We have hortonwork cluster with kerberos and sqlstdautherization. Both security work fine excepts for create table for other users except hive. hive and hdfs are part of admin users. Hive user is able to create all kinds of table but hdfs user not. S3 policy is open for all users. I am able to use hadoop command to see s3 bucket in hdfs user. I am able to create local/external table on hdfs user. but I am not able to create external table on S3 using hdfs user. I am getting below error. Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: Principal [name=hdfs, type=USER] does not have following privileges for operation CREATETABLE [[OBJECT OWNERSHIP] on Object [type=DFS_URI, name=s3a://bucket_name/user/hdfs/TEST]] (state=42000,code=40000)

alpesh_verani_c · ‎03-14-2018

Thanks you very much for your prompt reply. I am able to run map reduce with 300 GB usage. I think i need to look some other parameter. your hint may help me. currently i can not run it but will do it soon.

alpesh_verani_c · ‎03-14-2018

screen-shot-2018-03-14-at-84702-am.png If you see i am able to run 3 TEZ job. but when i run 3 mapred job in hive.execution.engine=mr in hive. it is accepting one at a time despite enough space.

alpesh_verani_c · ‎03-14-2018

screen-shot-2018-03-14-at-83913-am.png See th attached file it is inheriting all the resource and it is 100%.

alpesh_verani_c · ‎03-13-2018

default queue accepting one mr job for hive while tez accepting more than one. default execution engine is Tez. in this case default queue running 3 different query parallely in 3 different session. While i set hive.execution.engine=mr in this case i am able to open multiple hive session but default queue run only one query at a time. My cluster is big and already tried multiple small job parallely for Tez. but setting hive.execution.engine=mr run only one job at a time in default queue.

Online	Offline
Last Visited	‎10-02-2018 09:16 AM

Date Registered	‎02-10-2018 03:53 AM
Last Visited	‎10-02-2018 09:16 AM
Total Messages Posted	21

Re: hdfs user not able to create external table on...

hdfs user not able to create external table on S3

Re: default queue accepting one mr job for hive wh...

Re: default queue accepting one mr job for hive wh...

Re: default queue accepting one mr job for hive wh...

default queue accepting one mr job for hive while ...