Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Accès aux logs Yarn via Knox

avatar
New Contributor

Afin de remonter les erreurs des jobs Spark aux utilisateurs et dans les chaines ControlM, j'ai pas pu accéder aux logs des conteneurs Yarn exposés sur Knox avec mon id_user.

Je reçois toujours une erreur 403, est ce qu'il y a une API permet de récupérer les logs sur https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html ? ou bien il faut ajouter l'API REST du Job History de YARN dans la topologie Kerberos ? si non comment autoriser le user à lire les logs ?  Merci.

2 REPLIES 2

avatar
Community Manager

English Translation: 

 

In order to report Spark job errors to users and in ControlM chains, I could not access the logs of Yarn containers exposed on Knox with my id_user.

I always get a 403 error, is there an API to retrieve the logs on https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html? or should the YARN Job History REST API be added to the Kerberos topology? if not how to authorize the user to read the logs? THANKS.



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Master Collaborator

Hello @ZinaJr  Can you share the URL or a screenshot of how you access the yarn logs?