question Re: Hadoop streaming jar files in CDH5? in Archives of Support Questions (Read Only)

Hadoop streaming jar files in CDH5?

dr3x — Fri, 16 Sep 2022 09:02:44 GMT

Wanted to try out some python on hadoop in my CDH5 VM but I need the streaming jar file.

According to the documentation here

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/c...

the jar should be at this location:

/usr/lib/hadoop-0.20-mapreduce/contrib/streaming/hadoop-streaming-2.0.0-mr1-cdh<version>.jar

or maybe here

/usr/lib/hadoop-mapreduce/hadoop-streaming.jar

but I don't see it at either place. is there a way to install additional components if they are missing?

Re: Hadoop streaming jar files in CDH5?

ahegazi — Sun, 03 Aug 2014 23:24:49 GMT

Hey,

I guess the one you are looking for shall be located here

/usr/lib/hadoop-mapreduce/hadoop-streaming-2.3.0-cdh5.1.0.jar
/usr/lib/hadoop-mapreduce/hadoop-streaming.jar

Cheers

Re: Hadoop streaming jar files in CDH5?

stefano — Wed, 13 Aug 2014 12:23:59 GMT

It seems that it has been moved to

/opt/cloudera/parcels/CDH/lib/hadoop-mapreduce

Cheers

Re: Hadoop streaming jar files in CDH5?

dr3x — Tue, 14 Jul 2015 18:26:02 GMT

I'm on the 5.3.0 VM now and was able to locate the jar in the folder you identified, thanks

/usr/lib/hadoop-mapreduce/

Re: Hadoop streaming jar files in CDH5?

adityahadoop — Wed, 19 Apr 2017 20:33:05 GMT

Hi,

I have recently downloaded cloudera quick start VM for Virtual Box and I am looking for hadoop streaming jar file so that I can do some python streaming, but I am not able to find it. Please help me to get this jar file.

Thanks

Re: Hadoop streaming jar files in CDH5?

adityahadoop — Thu, 20 Apr 2017 13:26:05 GMT

I found the location, it was the same where dr3x mentioned. My bad, I didn't noticed properly.