Member since
09-29-2014
224
Posts
11
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
719 | 01-24-2024 10:45 PM | |
3653 | 03-30-2022 08:56 PM | |
2932 | 08-12-2021 10:40 AM | |
7061 | 04-28-2021 01:30 AM | |
3571 | 09-27-2016 08:16 PM |
11-10-2018
08:55 AM
HiveServer2 impersonation must be turned off. HiveServer2 impersonation lets users execute queries and access HDFS files as the connected user rather than as the super user. Access policies are applied at the file level using the HDFS permissions specified in ACLs (access control lists). Enabling HiveServer2 impersonation bypasses Sentry from the end-to-end authorization process. Specifically, although Sentry enforces access control policies on tables and views within the Hive warehouse, it does not control access to the HDFS files that underlie the tables. This means that users without Sentry permissions to tables in the warehouse may nonetheless be able to bypass Sentry authorization checks and execute jobs and queries against tables in the warehouse as long as they have permissions on the HDFS files supporting the table.
the above text is from document, i just wonder why "Enabling HiveServer2 impersonation bypasses Sentry from the end-to-end authorization process" ? who can give some advises ? thanks.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Sentry
-
HDFS
06-15-2017
08:21 PM
thanks. my pain point is when i finished a spark , java, hive, sqoop job, i tested it on Linux System , mostly it's normal. then i deploy the job in oozie by Hue, it always throw some errors like Class not found . i know it because some jars missed, then i am going to search which jars is missed, if found , i add this jar file. so i mean i don't know which jar files is needed while i deploy these job in oozie, i need the try and try to found missed jars. this is my pain point. these jobs executed on Linux System model is normal i think it's because the job load all the classpath jar files, so it's no this kind issue.
... View more
06-13-2017
10:24 PM
Hi, everyone when we deploy spark or java , sqoop job in oozie by Hue, mostly we need add jar files to resolve the denpendent jars issue. but sometimes some jobs need many jars , we need to run and run job again to discover the missed jar from oozie log, and add these jars file. i am thinking many times how to become more effient and convenicent. who have a good idea for this ?
... View more
Labels:
- Labels:
-
Apache Oozie
09-27-2016
08:16 PM
it's impossible to streaming from database directly. log extraction tool get log from database and general file or into Kafka, then spark streaming can handle it .
... View more
09-24-2016
11:46 AM
1 Kudo
sorry, i got the root cause. since i run in local mode, it's not supported by zkhots setting, if i run in cluster, it's no problem now, thanks.
... View more
09-24-2016
10:40 AM
HI, Cloudera supporter: CDH 5.8 Kafka , Storm 1.0.2 , these two version can work together or not ? 1. zk can find my topic partitions, but it got NULL while to get partition offset. i can get these offsets by zk command . 2. at the last log, you can see it shows me errors: type : create cxid:0x4 zxid:0x3f txntype:-1 reqpath:n/a Error Path:/storm_znyk/word
... View more
Labels:
01-26-2016
08:38 AM
i know this issue cause i have got this error too. i think this is a bug. there are two kind errors like below; 1) you have fill username and passwd, the errors is like your password is wrong,(in fact it's right passwd) 2) you didn't fill username and passwd, you will got NULLpoint error. how to slove this problem ? change mail server. you can test oozie mail service through third-part mail server ,eg: google
... View more
12-19-2015
02:21 AM
got resolved. just delete hook propery in hive-site.xml
... View more
12-18-2015
09:45 AM
HI, everyone, and Cloudera support after CDH 5.5.1 installation, i am going to test sqoop job in HUE. but it's always failed. the error is below : java.lang.ClassNotFoundException: com.cloudera.navigator.audit.hive.HiveExecHookContext it means missing some jar, i don't know where to find it. after that, i am going to test sqoop job in os level, it's success. who have caught the same issue ? pls give me some advises, thanks very much .
... View more
Labels:
- Labels:
-
Apache Oozie