Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

In HDP 2.5.3 and knox 1.2 running job (nodemanager ) links from yarn UI is broken

Highlighted

In HDP 2.5.3 and knox 1.2 running job (nodemanager ) links from yarn UI is broken

New Contributor

It only happens for a running jobs since the urls are handled differently by the jobhistory,when you click on running jobs where href=/syslog , href=/syserr , href=/launch_container.sh etc , its not redirecting to correct URL.


Broken links from knox YARN UI:

 directory.info : Total file length is 15046 bytes.
launch_container.sh : Total file length is 7261 bytes.
stderr : Total file length is 1481 bytes.
stdout : Total file length is 0 bytes.
syslog : Total file length is 23901 bytes.

Wrong :

 https://knox.URL:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e164_1558109307523_0101_01_000001/user-name/syslog

should redirect to:

https://knox.URL:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e164_15581093075...

However we appended manually following by (?scheme=http&host=hostname&port=8042) so it works

Later when you access "Showing 4096 bytes. Click here for full log" on syslog URL its not display all bytes of logs its rendering on same page.

I referred below knox bug which related 1.2 version had similar issue, it didn't help me much.

https://issues.apache.org/jira/browse/KNOX-1581

Is there any rewrite rules we should modify on top of knox 1.2 release related to this issue ?

2 REPLIES 2

Re: In HDP 2.5.3 and knox 1.2 running job (nodemanager ) links from yarn UI is broken

New Contributor

Hi @Vipin Rathor


Thanks for your replay !

We have tested on HDP (3.1.1.3.1.0.53-1) and knox 1.2 we are still facing same issue. Its happening only for running jobs where we trying to open below "Local Logs" URL's through knox right after clicking container log URL getting 404 error , details mentioned below.

Local logs:

        container-localizer-syslog : Total file length is 616 bytes.
        directory.info : Total file length is 19709 bytes.
        launch_container.sh : Total file length is 8269 bytes.
        prelaunch.err : Total file length is 0 bytes.
        prelaunch.out : Total file length is 100 bytes.
        stderr : Total file length is 1482 bytes.
        stdout : Total file length is 0 bytes.
        syslog : Total file length is 153374 bytes.


Correct URL:

https://knox.URL:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e164_15581093075...


Wrong redirection URL : (Failing with sorry, got error 404)

https://knox.URL:8443/gateway/default/yarn/nodemanager/node/containerlogs/container_e164_15581093075...


Thanks

Re: In HDP 2.5.3 and knox 1.2 running job (nodemanager ) links from yarn UI is broken

Guru

Hello @Rohan N,

This is a known issue with HDP 2.5.3. Please try with HDP 3.1 and let us know if you still this issue. If the issue persist, you might want to open a Hortonworks Support case and/or Knox bug. Thanks.