Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Where map reduce logs are located in Hue

Highlighted

Where map reduce logs are located in Hue

Explorer

I am looking for the logs indicated for this folder on hadoop port 8888

 

/jobbrowser/jobs/job_1466678674264_0028/tasks/task_1466678674264_0028_m_000000/attempts/attempt_1466678674264_0028_m_000000_0/logs

 

But I just can't find the logs for Hue map-reduce process. Where such logs should be ?

 

Best Regards

3 REPLIES 3
Highlighted

Re: Where map reduce logs are located in Hue

Start by looking at the job job_1466678674264_0028 in the Job Browser
Highlighted

Re: Where map reduce logs are located in Hue

Explorer

Ok,

 

But I want to find it on a path where I could grep the log errors for example.

 

The path

 

http://hadoop.server:6666/jobbrowser/jobs/job_1466678674264_0045/tasks/task_1466678674264_0045_m_000...

 

it is not helpfull at all. I cannot find where it is located. So, where by default the jobbrowser path is ?

Highlighted

Re: Where map reduce logs are located in Hue

Super Collaborator

Hi, it depends on your cluster configuration.

 

Per default I think yarn logs get aggregated (at the end of the job) to HDFS under the path /tmp/logs/<something>.

 

During the execution logs are available in the configurated log folders for yarn on the machine executing the current task.

 

They are not located "inside Hue".

Don't have an account?
Coming from Hortonworks? Activate your account here