Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3655 | 05-03-2017 05:13 PM | |
| 3013 | 05-02-2017 08:38 AM | |
| 3274 | 05-02-2017 08:13 AM | |
| 3220 | 04-10-2017 10:51 PM | |
| 1684 | 03-28-2017 02:27 AM |
02-23-2016
02:08 AM
@Rupinder Singh please choose the best answer that helped you as we need to close out this thread.
... View more
02-22-2016
11:05 PM
4 Kudos
@Cristina Lopes the following syntax was tested on sandbox in Hive view, assuming I have a UDF JAR called HiveSimpleUdf-1.0-SNAPSHOT.jar with class name com.hortonworks.hive.SimpleUDFgetRegionUS, # upload JAR file into /tmp/udfs on hdfs, using hdfs dfs -put command or Ambari files view
SELECT "California" as State;
CREATE TEMPORARY FUNCTION getRegionUS AS 'com.hortonworks.hive.SimpleUDFgetRegionUS' USING JAR 'hdfs:///tmp/udfs/HiveSimpleUdf-1.0-SNAPSHOT.jar';
LIST JARS;
SELECT "California" as State, getRegionUS("California") as Region;
DROP FUNCTION getRegionsUS;
CREATE FUNCTION getRegionUS AS 'com.hortonworks.hive.SimpleUDFgetRegionUS' USING JAR 'hdfs:///tmp/udfs/HiveSimpleUdf-1.0-SNAPSHOT.jar';
LIST JARS;
SELECT DISTINCT getRegionUS(split(user.userlocation, ",")[0]) FROM TWEETS;
... View more
02-22-2016
03:47 PM
@Shishir Saxena please post the policy xml and any logs you can provide.
... View more
02-22-2016
03:45 PM
@Margus Kiting the only thing that strikes me is that you're using Centos 7.2 which is not yet supported. What happens if you try this in a different browser?
... View more
02-22-2016
12:58 PM
tey the s3a https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html
... View more
02-22-2016
12:39 PM
oozie logs are not informative, go to Yarn > Resource Manager > job > failed tasked and find your problem there.
... View more
02-22-2016
12:33 PM
Iif you put this machine in a separate config group and remove referencw to the directories used you can keep the machine up. Removing disk and not replacing will mean your data will be writing to OS filesystem. Also do what Benjamin siggests and increase tolerance.
... View more
02-22-2016
01:40 AM
@Enis @Devaraj Das @Josh Elser
... View more
02-22-2016
01:39 AM
3 Kudos
@Sam Mingolelli namespaces have been available since 0.96 and not very well documented. Here's a scenario I was able to dig up to attempt answering your question. Step 1: Superuser (e.g. user hbase) creates namespace foo. create_namespace ‘foo’ Step 2: Admin gives dba-bar full permissions to the namespace: grant ’dba-bar', 'RWXCA', '@foo’ Note: namespaces are prefixed by @. Step 3: dba-bar creates tables within the namespace: create ’foo:t1', 'f1’ Step 4: dba-bar hands out permissions to the tables: grant ‘user-x’, ‘RWXCA’, ‘foo:t1’ Note: All users will be able to see namespaces and tables within namespaces, but not the data. The next best source of information would be the umbrela Jira for namespaces https://issues.apache.org/jira/browse/HBASE-8015. It has a design document in PDF form https://issues.apache.org/jira/secure/attachment/12580245/Namespace%20Design.pdf Outside of that, please feel free to read the namespace source code or unit tests https://github.com/apache/hbase/blob/master/hbase-server/src/test/java/org/apache/hadoop/hbase/TestNamespace.java. Bottom line, to use namespaces see above, to make your current application compliant with namespaces, change the code to point to the tables within namespaces, I already suggested to use Clone Snapshot and Export Snapshot tools or write Mapreduce to export/import into new table within a new namespace. I will escalate this to our docs team to have a better document as it's obvious people are starting to use this. I would've pointed you to our docs if we had that info, that's why I sent you stack overflow link as this question has not come up before. Finally, if at some point you will want to grant authorization to namespaces using Ranger, here's a thread for that https://community.hortonworks.com/questions/17764/ranger-hbase-namespace.html.
... View more