question YARN logs + HTTP auth in Archives of Support Questions (Read Only)

YARN logs + HTTP auth

nord_tramper — Mon, 30 Oct 2017 17:33:44 GMT

Hello!

I have HDP 2.5 cluster with KERBEROS enabled, connected to Active Directory.

When I try to switch on HTTP AUTH -

https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.2/bk_security/content/_configuring_http_authentication_for_HDFS_YARN_MapReduce2_HBase_Oozie_Falcon_and_Storm.html

Logs can be retrived using shell

yarn logs -applicationId application_1509115509826_0001

I can't access any logs from YARN UI for example

<YARN-RM-HOST>:19888/jobhistory/logs/<NODE>:45454/container_e56_1509115509826_0001_01_000001/container_e56_1509115509826_0001_01_000001/hive

With following error:

User <MY Active Directory User> is not authorized to view the logs for container_e56_1509115509826_0001_01_000001 in log file [<NODE>_45454_1509118017724]No logs available for container container_e56_1509115509826_0001_01_000001

Re: YARN logs + HTTP auth

jsensharma — Mon, 30 Oct 2017 17:54:58 GMT

@Nikita Kiselev

Can you please check if you have the following configuration in your yarn configs? Also please check the proxy user settings are correct.

yarn.admin.acl=*
yarn.acl.enable=false

Also please share the value of the following property from the core-site : "hadoop.http.staticuser.user"

Have you tried restarting the History Server?

Re: YARN logs + HTTP auth

nord_tramper — Mon, 30 Oct 2017 18:42:32 GMT

Your settings solve the problem.

I have default values

yarn.admin.acl=yarn,dr.who
yarn.acl.enable=true

hadoop.http.staticuser.user = yarn

Re: YARN logs + HTTP auth

nord_tramper — Mon, 30 Oct 2017 19:19:37 GMT

Also works for me after some experiments:

yarn.admin.acl=yarn,dr.who,<AD LOGIN IN UPPERCASE WITHOUT REALM>