Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2720 | 11-01-2016 05:43 PM | |
| 9335 | 11-01-2016 05:36 PM | |
| 5072 | 07-01-2016 03:20 PM | |
| 8510 | 05-25-2016 11:36 AM | |
| 4657 | 05-24-2016 05:27 PM |
02-08-2016
04:28 PM
@Gerd Koenig Perfect!!!! 🙂 So...Hue is casuing the trouble?
... View more
02-08-2016
04:20 PM
1 Kudo
HDP 2.3.2 Sandbox hive> CREATE TABLE page_view(viewTime INT, userid BIGINT, > page_url STRING, referrer_url STRING, > ip STRING COMMENT 'IP Address of the User') > COMMENT 'This is the page view table' > PARTITIONED BY(dt STRING, country STRING) > STORED AS SEQUENCEFILE; OK Time taken: 14.39 seconds hive> CREATE VIEW onion_referrers(url COMMENT 'URL of Referring page') > COMMENT 'Referrers to The Onion website' > AS > SELECT DISTINCT referrer_url > FROM page_view > WHERE page_url='http://www.theonion.com'; OK Time taken: 3.484 seconds Ranger policy Restricting access on ip column - Table Restricting access on url column - View 0: jdbc:hive2://localhost:10000> select * from page_view; Error: Error while compiling statement: FAILED: HiveAccessControlException Permission denied: user [hive] does not have [SELECT] privilege on [default/page_view/country,dt,ip,page_url,referrer_url,userid,viewtime] (state=42000,code=40000) 0: jdbc:hive2://localhost:10000> select * from onion_referrers; INFO : Session is already open INFO : INFO : Status: Running (Executing on YARN cluster with App id application_1454947053064_0004) INFO : Map 1: -/-Reducer 2: 0/1 INFO : Map 1: -/-Reducer 2: 0(+1)/1 INFO : Map 1: -/-Reducer 2: 1/1 +----------------------+--+ | onion_referrers.url | +----------------------+--+ +----------------------+--+ No rows selected (3.695 seconds) 0: jdbc:hive2://localhost:10000> @bdurai @sneethiraj @bganesan ****Update**** I added base table column in exclude list and view can access the column
... View more
Labels:
- Labels:
-
Apache Ranger
02-08-2016
03:45 PM
@Gerd Koenig Are you able to access using beeline?
... View more
02-08-2016
03:41 PM
@Gerd Koenig This is great question and personally, I have never worked on this use case. Did you grant access to hive and hbase tables to user pklfsvc in Hive and HBase policies?
... View more
02-08-2016
03:29 PM
@Pradeep kumar I have seen this in my environment. As you can see , it's INFO You have to wait and let the job execute the main processing. Is job failing?
... View more
02-08-2016
12:50 PM
@Pradeep kumar run this $HIVE_HOME/bin/schematool -initSchema -dbType mysql Also, check the link that I shared in my response. It talked about permission issue too
... View more
02-08-2016
12:38 PM
@Prakash Punj 5:12:21,968 ERROR namenode.NameNode (NameNode.java:main(1712)) - Failed to start namenode. java.net.BindException: Port in use: pp-hdp-m:50070 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:919) at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:856) at What is this host, pp-hdp-m?
... View more
02-08-2016
12:16 PM
1 Kudo
@Pradeep kumar You can always add new Hive metastore using Ambari "If you dont want to use existing mysql that you installed" I have experienced this issue in the past and it had to do with the permissions ..see link
... View more
02-08-2016
12:00 PM
@Prakash Punj Here is the problem Your hostname resolves to 192 address add following entry in /etc/hosts and then give it a shot 192.168.25.139 hdp-m.samitsolutions.com
... View more
02-08-2016
11:51 AM
@Nirvana India Please see this link https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-AlterPartition Alter Partition Partitions can be added, renamed, exchanged, dropped, or (un)archived by using the PARTITION clause in an ALTER TABLE statement, as described below. To make the metastore aware of partitions that were added directly to HDFS, you can use the metastore check command (MSCK) or on Amazon EMR you can use the RECOVER PARTITIONS option of ALTER TABLE. See Alter Either Table or Partition below for more ways to alter partitions.
... View more