Reply
Explorer
Posts: 11
Registered: ‎06-30-2014

CDH 5 source code: Download/Modify/Build

I'm using CDH 5 with CM.

 

1. I'd like to test some changes to CDH 5 that I have in mind. What is the best place to get CDH 5 source code from?

2. After modifying it, what is the best practice developers at Cloudera follow to build and test it ?

3. Can someone provide step by step advice on this?

4. Will the midification to CDH 5 have any effect on CM?

 

I'd really appriciate your help.

 

Thanks,

Kewal

Highlighted
Explorer
Posts: 11
Registered: ‎06-30-2014

Re: CDH 5 source code: Download/Modify/Build

I've downloaded cdh5 tarball. I'd like to use eclipse as my IDE. I'm following the steps mentioned in this blog on cloudera.

 

http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/

 

But, I'm facing some issues while trying yo integrate m2e plugin in eclipse(Kepler).

 

I'd like to know if the setup changes for CDH 5 as the blog is only valid for CDH 4.0?

 

Appreciate your help.

Explorer
Posts: 12
Registered: ‎01-18-2014

Re: CDH 5 source code: Download/Modify/Build

I just can recommend you to use the Cloudera Git Repositories from GitHub (https://github.com/cloudera) if you start too look at the source code. It far better than downloading and extracting versions from tarballs.

 

Had good results with it, since i had to build natives on my own and to downport some patches to CDH4.5.

 

But doing so and rebuild working versions of Hadoop, requires you a lot more to do as mentioned in this Cloudera article about eclipse. You should consider reading:

 

http://wiki.apache.org/hadoop/HowToContribute

http://wiki.apache.org/hadoop/EclipseEnvironment

 

Or this is an excellent article which helped me a lot in my quest:

http://vichargrave.com/create-a-hadoop-build-and-development-environment-for-hadoop/

 

And no, as long as you dont build the correct jars and deploy them on your cluster, nothing will change. Especially the CM itself is not OpenSource, so you cannot change things on your own even if you want to. 

 

Explorer
Posts: 11
Registered: ‎06-30-2014

Re: CDH 5 source code: Download/Modify/Build

Thanks for the response.

 

I've already refered the links you provided and have all the develeopement tools installed.

 

Can you elaborate more on "And no, as long as you dont build the correct jars and deploy them on your cluster, nothing will change."?

 

Appreciate your help.