Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

CDH4 Eclipse how does it work

Solved Go to solution
Highlighted

CDH4 Eclipse how does it work

Explorer

Hi, 

 

Please help me understand what happens when we run word count program in CDH4 Quick start VM. The program runs fine just want to understand what is happening behind scenes 

 

1. Does it start name node, job tracker separately for eclipse ?

 

2. I stopped the NN,JT in the cloudera manager but still the program runs fine that means its using some separate processes but then why those dont show in manager even just during the time program is running?

 

3.Where could I find example programs in the VM? 

 

4. Also when NN and TT are shown running why JPS commod on terminal doesnt show these processes?

 

Thanks 

MRHadoop

1 ACCEPTED SOLUTION

Accepted Solutions

Re: CDH4 Eclipse how does it work

Master Guru
(1) - No, but its possible that your job's running via the LocalJobRunner. See (2).

(2) - This may mean that your Job in the IDE is not specifying the right URLs for FS and MR access, and hence the Job runs in a special default mode called "LocalJobRunner", which runs the job in the same JVM as the Driver, without submitting it anywhere.

(3) - I believe you should be able to find a variety of examples in the Hue Web UI to run/read/follow.

(4) - The daemons run as service usernames. You need to run jps as root to be able to see all the JVMs running on a machine.
2 REPLIES 2

Re: CDH4 Eclipse how does it work

Master Guru
(1) - No, but its possible that your job's running via the LocalJobRunner. See (2).

(2) - This may mean that your Job in the IDE is not specifying the right URLs for FS and MR access, and hence the Job runs in a special default mode called "LocalJobRunner", which runs the job in the same JVM as the Driver, without submitting it anywhere.

(3) - I believe you should be able to find a variety of examples in the Hue Web UI to run/read/follow.

(4) - The daemons run as service usernames. You need to run jps as root to be able to see all the JVMs running on a machine.

Re: CDH4 Eclipse how does it work

Explorer

Thanks Harsh

 

I will try to find out from eclipse project settings if it refers to localjobrunner somewhere in it, any further information from your end will be appreacited.

 

Regards

Don't have an account?
Coming from Hortonworks? Activate your account here