- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Create users in hadoop/HDP 2.5
- Labels:
-
Apache Hadoop
-
Apache Hive
Created ‎09-07-2017 03:29 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I just created users in /home in edge node for users to work on hadoop. But users not able to run hive/Yarn jobs. My cluster is already kerberized. Is there any way to assign users to submit their jobs in edge node.
Do we need to these users in hadoop/hdfs ?
If cluster has kerberos and ranger is there any different way to do it ?
Please suggest me.
Created ‎09-07-2017 07:25 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
When your a cluster integrated with Kerberos security then authenticated user must exist in the every node where the task runs. So create the berlin user on all the hosts and add user berlin to the hadoop group that should resolve the problem.
Please revert
Created ‎09-08-2017 02:41 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You need to create user directories on HDFS for each user.
$ su - hdfs
Because your cluster is kerberized you need to get a token for the hdfs user. Something like this
$ kinit -k -t /etc/security/keytabs/hdfs.service.keytab hdfs/node1.hadoop.com@HADOOP.COM
Now you can create an HDFS directory for your user.
$ hadoop fs -mkdir /user/berlin $ hadoop fs -chown berlin /user/berlin
If you're querying Hive, you could use a desktop tool like Aginity Workbench, which supports Kerberos connections.

- « Previous
-
- 1
- 2
- Next »