Reply
New Contributor
Posts: 2
Registered: ‎06-25-2019

hadoop fs command is not authenticated by kerberos

[ Edited ]

I built my cluster with CDH5.7.5 and enabled kerberos. The kerberos service is provided by freeIPA. “hdfs dfs” or “hadoop dfs” works well with the authentication, unauthorized users cannot access this cluster. However, “hadoop fs” command can still access all directories without any user authentication. I am confused since I believe the “hadoop fs” and “hdfs dfs” should work in the same behavior since they all call FsShell class.

Expert Contributor
Posts: 108
Registered: ‎02-23-2018

Re: hadoop fs command is not authenticated by kerberos

Hi @Yongkun,

 

In wich groups are those users?

 

 

Regards,

Manu.

New Contributor
Posts: 2
Registered: ‎06-25-2019

Re: hadoop fs command is not authenticated by kerberos

Hi @manuroman ,

 

Any user in any group can access. I didn't add those users by ipa.

 

Regards,

Yongkun

Posts: 1,116
Topics: 1
Kudos: 287
Solutions: 135
Registered: ‎04-22-2014

Re: hadoop fs command is not authenticated by kerberos

@Yongkun,

 

Please demonstrate, with example, what is "working" and what is "not working?"

Listing each step (including kinit) will help us understand what you are facing.

 

If you cluster has Kerberos Authentication enabled, then in order to access HDFS, you will need to have credentials.  A user without valid kerberos credentials cannot access HDFS so there may be a misunderstanding regarding the test results.

 

Thanks,

 

Ben