Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

include file ,exclude file permission clarification

Highlighted

include file ,exclude file permission clarification

Explorer

Hello All 

I am new to hadoop . 

using Hadoop 2.3.0-cdh5.0.0 

 

In the process of  adding and decommission of datanode in multi node cluster .

Read about the steps in the book. 

I really got stuck in the middle as to what permission(user:group) should be set for include and exclude file which should reside on the local system of the namenode running .

Also it will be much helpful if anyone can give me a example as to how include and exclude file will look. 

I assume we just need to add the Network address of the datanode cluster in each of the file.

Correct me if I am wrong.

 

Thanks

 

1 REPLY 1

Re: include file ,exclude file permission clarification

Contributor

Only read access for 'hdfs' and 'yarn' system users are needed. Default permissions are root:hadoop owner, 0644 mode.

 

Of course you need also dfs.hosts, yarn.resourcemanager.nodes.include-path properties (default values are empty, which means permit every host to be a worker node). And dfs.hosts.exclude, yarn.resourcemanager.nodes.exclude-path for the excludes.

 

The content can be hostnames or the network addresses.

Don't have an account?
Coming from Hortonworks? Activate your account here