Member since
02-02-2021
116
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
745 | 08-13-2021 09:44 AM | |
3695 | 04-27-2021 04:23 PM | |
1372 | 04-26-2021 10:47 AM | |
923 | 03-29-2021 06:01 PM | |
2750 | 03-17-2021 04:53 PM |
04-06-2021
09:01 PM
Hello @ryu Please refer below doc for enable ranger Authorization for hive LLAP. https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.0.1/securing-hive/content/hive_secure_llap_in_hiveserver.html
... View more
03-29-2021
06:01 PM
ok sorry I just found the issue. Noticed the LLAP daemons were being run by the user hive whereas the AMs were being run by the user root. Now I have the AM and the daemons both being run by hive and now the Hive LLAP UI is being updated and working.
... View more
03-25-2021
09:05 AM
Thanks @Daming Xue for the response. So i tried installing Hive 2.2 and it worked. Do you know how I can test hive LLAP vs regular hiveserver2 to see the difference? Any good hiveserver2 queries or something so I can test the LLAP setup vs hiveserver2? Thanks,
... View more
03-23-2021
03:50 AM
Please find more about the "pros and cons to having hive jobs run as the hive user or the end user" vs. Ranger in our public Cloudera documentation for CDP: Enabling or disabling impersonation (doas)
... View more
03-23-2021
02:28 AM
To see more on Hive Managed and External tables, please see our public documentation for CDP Hive.
... View more
03-22-2021
11:32 AM
@Shifu thanks for the response. So I resolved the following error by re-installing hive. 0: jdbc:hive2://test.domain.com:218> create table studenta (name STRING); Error: org.apache.hive.service.cli.HiveSQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Exception thrown when executing query : SELECT DISTINCT 'org.apache.hadoop.hive.metastore.model.MTable' AS `NUCLEUS_TYPE`,`A0`.`CREATE_TIME`,`A0`.`LAST_ACCESS_TIME`,`A0`.`OWNER`,`A0`.`RETENTION`,`A0`.`IS_REWRITE_ENABLED`,`A0`.`TBL_NAME`,`A0`.`TBL_TYPE`,`A0`.`TBL_ID` FROM `TBLS` `A0` LEFT OUTER JOIN `DBS` `B0` ON `A0`.`DB_ID` = `B0`.`DB_ID` WHERE `A0`.`TBL_NAME` = ? AND `B0`.`NAME` = ?) But still getting the ranger error. I am able to create tables but when I try to select on the table I just created, I get the ranger error. 0: jdbc:hive2://test.domain.com:218> show tables; +-----------+ | tab_name | +-----------+ | student | | studenta | | studentb | | studentc | +-----------+ 4 rows selected (0.254 seconds) 0: jdbc:hive2://test.domain.com:218> create table studentd (name STRING); No rows affected (0.456 seconds) 0: jdbc:hive2://test.domain.com:218> show tables; +-----------+ | tab_name | +-----------+ | student | | studenta | | studentb | | studentc | | studentd | +-----------+ 5 rows selected (0.254 seconds) 0: jdbc:hive2://test.domain.com:218> select * from studentd; Error: Error running query: java.lang.AbstractMethodError: org.apache.ranger.authorization.hive.authorizer.RangerHiveAuthorizer.needTransform()Z (state=,code=0) Any help is much appreciated. Thanks,
... View more
03-20-2021
11:28 PM
Hello @ryu Good Day. To test/compare Hiveserver2Interactive(LLAP) vs Hiveserver2 you would be required to bring up the LLAP service. I would say the best place to start implementing LLAP is from below article https://community.hortonworks.com/content/kbentry/149486/llap-sizing-and-setup.html Please check the below links to get more insight into LLAP https://community.hortonworks.com/content/kbentry/149894/llap-a-one-page-architecture-overview.html https://community.hortonworks.com/content/kbentry/149892/llap-troubleshooting-and-debugging.html https://community.hortonworks.com/content/kbentry/149896/llap-debugging-overview-logs-uis-etc.html https://community.hortonworks.com/content/kbentry/149900/investigating-when-the-queries-on-llap-are-slow-or.html https://community.hortonworks.com/content/kbentry/149901/investigating-llap-cache-hit-rate.html https://community.hortonworks.com/content/kbentry/149998/map-join-memory-sizing-for-llap.html https://community.hortonworks.com/content/kbentry/170868/running-llap-on-specific-nodes-using-yarn-node-lab.html https://community.cloudera.com/t5/Community-Articles/LLAP-debugging-overview-logs-UIs-etc/ta-p/247445 https://community.cloudera.com/t5/Community-Articles/LLAP-sizing-and-setup/ta-p/247425 Thanks Rajkumar
... View more
03-19-2021
08:12 AM
@isoardi oh this is a cluster that I can use to test upgrades etc. But I did install HDP 2.6.x onto this cluster which is similar to our production environment.
... View more
03-17-2021
04:53 PM
Ok seems like I had hive.security.authoization.enabled to true in the hiveserver2-site.xml but had not enabled the ranger hive plugin yet. Once I set this property to false, I was able to see the hive databases with "show databases".
... View more
03-15-2021
02:03 PM
Thanks @Shelton for the response. I believe I had already tried this. I tried to replace the ambari tez configuration again but still the same error. Also our production cluster currently has the old value, but for some reason the production cluster is working fine.
... View more
- « Previous
- Next »