question I am a newbie to Big Data and Hadoop. in Archives of Support Questions (Read Only)

I am a newbie to Big Data and Hadoop.

musheer_mohamme — Thu, 03 Mar 2016 12:21:31 GMT

I come from a background of C# middleware developer and I also have a intermediate knowledge of Java. I would lke to be a Hadoop developer and would really appreicate if you could guide me what Hadoop components I need to learn first?

Re: I am a newbie to Big Data and Hadoop.

kgopal — Thu, 03 Mar 2016 12:24:02 GMT

Hi Musheer,

You can refer to the link - http://hortonworks.com/training/

Under developer section you will find the course objective which you can use to get started.

Regards,

Karthik Gopal

Re: I am a newbie to Big Data and Hadoop.

divakarreddy_a — Thu, 03 Mar 2016 12:30:21 GMT

@John D.

Here is the link to download HDP Sandbox http://hortonworks.com/hdp/downloads/

Re: I am a newbie to Big Data and Hadoop.

sdutta — Thu, 03 Mar 2016 12:37:01 GMT

@John D

@John D. As Divakar pointed out Hortonworks Products page is a great place to start. It has step by step tutorials and overall about the HDP.

In general if you would like to learn Apache Hadoop is a good place http://hadoop.apache.org/.

As for a book - http://www.amazon.com/Hadoop-Definitive-Guide-Tom-White/dp/1449311520

The above is a very good book. Hortonworks being part of the open source community and the only distribution with 100% open source projects. Hadoop has grown in many breadth and depths. Traditionally lot of work was done on map reduce and now people have moved more towards Hive (SQL Interface) and Spark.

I would say if you are starting of as a developer, start with Spark. Also as you come from C#, picking up Scala will not be bad and you may enjoy working with Spark.

Understanding Map Reduce framwork, HDFS and internals of Yarn is important to be skilled in Hadoop.

I would say best of luck for your journey.

Re: I am a newbie to Big Data and Hadoop.

musheer_mohamme — Thu, 03 Mar 2016 12:40:09 GMT

Those are all paid sites. I am wondering if there are any free resources that I can use...

Re: I am a newbie to Big Data and Hadoop.

KuldeepK — Thu, 03 Mar 2016 12:41:08 GMT

@John D. - Good to see your interest & enthusiasm to learn Hadoop! 🙂 HCC is great place to get your Hadoop questions answered. Please have a look at links provided by @Karthik Gopal & @Divakar Annapureddy

Happy Hadooping!!

Re: I am a newbie to Big Data and Hadoop.

kgopal — Thu, 03 Mar 2016 14:14:21 GMT

You can also use the link below for tutorials using sandbox mentioned by @Divakar Annapureddy

http://hortonworks.com/tutorials/

Regards,

Karthik Gopal

Re: I am a newbie to Big Data and Hadoop.

SK1 — Thu, 03 Mar 2016 20:01:04 GMT

@John D.: HCC provide a very good and handy documents to start with hadoop. Also you can visit to http://www.hadoopadmin.co.in/ to start with hadoop.

Re: I am a newbie to Big Data and Hadoop.

Former Member — Tue, 08 Mar 2016 07:43:19 GMT

@John d

@John D.I would suggest downloading the Sandbox and doing the Hello to HDP tutorial.

This tutorial includes a collection of concepts to review and a series of labs that walks you through the process of loading some data, transforming it, querying and building a report.

If you want to learn spark I would go through these Spark tutorials on the Sandbox.

And if you have a question on a tutorial use the new buttons at the bottom of the tutorials to post a question on HCC. 😃

Re: I am a newbie to Big Data and Hadoop.

musheer_mohamme — Tue, 08 Mar 2016 11:11:07 GMT

I appreciate your suggestions. I do have an Azure subscription and I'd go definitely go ahead and install the sandbox.

Re: I am a newbie to Big Data and Hadoop.

TimothySpann — Tue, 03 May 2016 03:08:20 GMT

After you download the sandbox and HDF. Take a look at these resources

https://dzone.com/articles/getting-started-with-apache-nifi-and-hdf

https://dzone.com/articles/anatomy-of-a-scala-spark-program

https://dzone.com/articles/hortonworks-top-15-links-of-april-2016