question Re: Read/Write on HDP data platform on Windows 21012 R2 in Archives of Support Questions (Read Only)

Read/Write on HDP data platform on Windows 21012 R2

ritjain — Mon, 19 Dec 2016 16:18:56 GMT

I just setup Hortonworks Data Platform2.3.4 on Windows 2012 R2 server and was trying -ls command from Hadoop Command Line but it says "Permission denied: user=ritjain, access=READ_EXECUTE, inode="/user":hadoop:hdfs:drwx...". I understand about permission but not sure how to resolve the issue. Also When I started "Hadoop Name Node Status", browser does not show anything. Kindly suggest..

Re: Read/Write on HDP data platform on Windows 21012 R2

cstanca — Wed, 21 Dec 2016 02:10:05 GMT

@Ritesh jain

Please provide the exact command you executed.

Re: Read/Write on HDP data platform on Windows 21012 R2

ravi1 — Wed, 21 Dec 2016 02:14:38 GMT

If looks like an output on 'hdfs dfs -ls ' which tries to get the user home directory (which points to /user/ritjain) in your case. This is missing here. Use hdfs user to create home directory for the user and change owner to 'ritjain'. Then if you execute it, you should be able to get there.

Regarding namenode status, post a screenshot of what you are looking at on browser. Error from command shows that NN seems to be running fine.

Re: Read/Write on HDP data platform on Windows 21012 R2

cstanca — Wed, 21 Dec 2016 02:16:25 GMT

@Ritesh jain

sudo -u hdfs hadoop fs -ls

Does this work for you?

If it works, then create a home directory for your user (in HDFS) and make sure that your user is member of hadoop or hdfs group.

***

If helped, please vote/accept answer.

For the second question, please create a new question and remove it from the current question. We are trying to build a body of knowledge easy to follow and avoid open-ended questions.

Re: Read/Write on HDP data platform on Windows 21012 R2

ritjain — Wed, 21 Dec 2016 13:24:55 GMT

No. sudo is not working. I am using Azure VM with Windows server 21012 R2. Installed HDP2.3 there.

C:\hdp\hadoop-2.7.1.2.3.4.0-3485>sudo -u hdfs hadoop fs -ls 'sudo' is not recognized as an internal or external command, operable program or batch file.

Re: Read/Write on HDP data platform on Windows 21012 R2

ritjain — Wed, 21 Dec 2016 13:27:26 GMT

Probably need to know how to change the user to hdfs user. I know how to do that in Linux as it is by using sudo command. But I am using Azure VM with Windows server 21012 R2.

Regarding namenode status, when I click on the shortcut which is on desktop (http://ritjainvmws2012:50070/), blank screen opens.

Re: Read/Write on HDP data platform on Windows 21012 R2

ssivachandran — Wed, 21 Dec 2016 19:28:17 GMT

@Ritesh jain

Try following the below steps for windows machine. If helped, please vote/accept answer

1. Switch to a command prompt as the hadoop user For example:

>runas /user:hadoop cmd

2. Navigate to the the hadoop directory. For example:

>cd C:\hdp\hadoop-2.7.1.2.3.4.0-3485\bin

3. From the hadoop directory, create a ritjain user. For example:

>hadoop dfs -mkdir /user/ritjain

4. Change ownership to the ritjain user and add the user to hdfs group.

>hadoop dfs chown -R ritjain:hdfs /user/ritjain

Re: Read/Write on HDP data platform on Windows 21012 R2

ritjain — Wed, 21 Dec 2016 23:22:48 GMT

Thanks. that really helped. I was not aware about switching user in windows. 🙂 I believe, -chown command, as you suggested, would add the user to hdfs group as well. correct?

On a side note - would appreciate if you have any inputs around debugging MR job in windows. I have already posted about the issue at below link -

https://community.hortonworks.com/questions/72672/unable-to-connect-to-the-remote-server-while-conne.html

Thanks in advance..

Re: Read/Write on HDP data platform on Windows 21012 R2

ritjain — Wed, 21 Dec 2016 23:32:00 GMT

posted a new question - https://community.hortonworks.com/questions/73366/blank-name-node-status-in-hdp-on-windows-2012-r2.html

Re: Read/Write on HDP data platform on Windows 21012 R2

ssivachandran — Thu, 22 Dec 2016 19:47:22 GMT

@Ritesh jain Yes, the -chown would add the user ritjain to hdfs group.

If the above suggestion helped you in resolving the issue, kindly vote the suggestion to close this loop.

Re: Read/Write on HDP data platform on Windows 21012 R2

ritjain — Fri, 23 Dec 2016 13:26:06 GMT

Can't vote - getting message - 😞

We're sorry, but this cannot be voted down by you until you have at least 25 reputation

Re: Read/Write on HDP data platform on Windows 21012 R2

ritjain — Wed, 28 Dec 2016 22:13:01 GMT

blank NN issue has been poster at below link. Inputs would be appreciated -

https://community.hortonworks.com/questions/73366/blank-name-node-status-in-hdp-on-windows-2012-r2.html