question yarn run logs - error getting logs at hostname:8041 in Support Questions

yarn run logs - error getting logs at hostname:8041

yagoaparecidoti — Fri, 26 May 2023 19:36:24 GMT

hello cloudera community,

we have a problem

we are not able to view the execution logs of the jobs that were executed in yarn by the resourcemanager of yarn

when we click on logs it presents the error:

"Error getting logs at hostname:8041"

how can we solve this problem?

we are using cdh express 5.16.2

Re: yarn run logs - error getting logs at hostname:8041

AyazHussain — Wed, 17 Apr 2024 06:55:36 GMT

There could be multiple cause of this issue.
But at first please check the permission of the log directory for that node manager.

The Node Manager enforces that the remote root log directory exists and it has the correct permission settings. A warning is emitted in the Node Manager logs if the folder does not exist or exists but with incorrect permissions (e.g. 1777).

If created, the directory’s owner and the group will be the same user as the Node Manager’s user, and group. The group is configurable, which is useful in scenarios where the Job History Server (or JHS in short) is running in a different UNIX group than the Node Manager that can prevent aggregated logs from being deleted.

Because directly under the filesystem's root, each user has its own directory, everything under the user’s directory is created with 0770 permissions, so that only the specific user and the hadoop group are allowed to access those directories and files.

Each individual aggregated log file will be created with 0640 permissions - providing rw access to the user and read-only access to the hadoop group. Since the directory has 0770 permission, the members of the hadoop group will be able to delete these files, which is important for the automatic deletion

Re: yarn run logs - error getting logs at hostname:8041

AyazHussain — Mon, 22 Apr 2024 05:04:42 GMT

@yagoaparecidoti
If my suggestion helped Please accept it as a solution

Re: yarn run logs - error getting logs at hostname:8041

yagoaparecidoti — Mon, 22 Apr 2024 17:24:08 GMT

hi @AyazHussain

since the problem is old, I don't remember what was done to fix it.

if the problem returns, I will test.

thanks!