Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

cannot find any hadoop streaming jar

cannot find any hadoop streaming jar

New Contributor

i am trying to do the following after installation:

hadoop jar /usr/lib/hadoop-mapreduce/hadoop-streaming.jar \
   -input /user/cloudera/input \
   -output /user/cloudera/output_new \
   -mapper /home/cloudera/wordcount_mapper.py \
   -reducer /home/cloudera/wordcount_reducer.py

 Not a valid JAR: /usr/lib/hadoop-mapreduce/hadoop-streaming.jar

then 

hdfs dfs -ls

 

returns

No such file or directory

 

How do i do this. 

 

 

3 REPLIES 3
Highlighted

Re: cannot find any hadoop streaming jar

Rising Star

Hello @tommat,

 

How did you install CDH? From Parcel or package?

 

If you are using CDH parcel then it should be here:

 

/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-streaming.jar

 

What is your CDH version?

 

Gabor

Re: cannot find any hadoop streaming jar

New Contributor

Hi there - i'm on hadoop 2.6.0-cdh5.10.0 and I cannot locate the hadoop streaming jar file in all the usual locations... please help!

 

Re: cannot find any hadoop streaming jar

Rising Star

Hi,

 

It should be there. Example:

 

[roczei@host-10-17-102-144 ~]$ ls -ld /opt/cloudera/parcels/CDH

lrwxrwxrwx 1 root root 28 Mar 25 17:18 /opt/cloudera/parcels/CDH -> CDH-5.10.0-1.cdh5.10.0.p0.41

[roczei@host-10-17-102-144 ~]$ find /opt/cloudera/parcels/CDH/lib/ | grep hadoop-streaming.jar

/opt/cloudera/parcels/CDH/lib/oozie/oozie-sharelib-mr1/lib/mapreduce-streaming/hadoop-streaming.jar

/opt/cloudera/parcels/CDH/lib/oozie/oozie-sharelib-yarn/lib/mapreduce-streaming/hadoop-streaming.jar

/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-streaming.jar

[roczei@host-10-17-102-144 ~]$ ls -l /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-streaming.jar

lrwxrwxrwx 1 root root 36 Jan 31 09:00 /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-streaming.jar -> hadoop-streaming-2.6.0-cdh5.10.0.jar

[roczei@host-10-17-102-144 ~]$

 

Please run this command:

 

find /opt/cloudera/parcels/CDH/lib/ | grep hadoop-streaming.jar