question Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow) in Support Questions

differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

haitham_sefi — Thu, 15 Jun 2017 17:43:02 GMT

Hello, I'm new in the domain of Big data and i want to know the main differences between HDF(Hortonworks Data Flow) and HDP (Hortonworks Data Platform). that's means the usecases and the architecture(components) of each one.

Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

jsensharma — Thu, 15 Jun 2017 17:56:05 GMT

@haitham sefi

I am sure that you might have gone through the following links, If not then it might be useful to clear some points.

https://hortonworks.com/products/data-center/hdf/

https://hortonworks.com/webinar/introducing-hortonworks-dataflow/

https://community.hortonworks.com/questions/80005/confusion-with-hdf-and-hdp-and-their-capabilities.html

Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

haitham_sefi — Thu, 15 Jun 2017 18:57:17 GMT

Thank you.

I understood from the last link that :

HDF - is used to handle Data in Motion

HDP - is used to handle Data at Rest

But HDP contains storm (real time message processing) and Kafka ( distributed messaging system ).

So can we say that HDP can be used also to handle data in motion ?

Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

andres_koitmae — Thu, 15 Jun 2017 19:04:29 GMT

Hi,

Yes currently HDP (2.6.x) does contain Kafka and Strom but according to the release notes https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_release-notes/content/deprecated_items.html those components will be removed from HDP starting from version 3.0.0

It means that in near future HDP will not handle data in motion anymore.

Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

haitham_sefi — Thu, 15 Jun 2017 19:18:53 GMT

Thank you @Andres Koitmäe

But according to this link storm and kafka will not be removed from HDP version 3.0.0

Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

andres_koitmae — Fri, 16 Jun 2017 03:15:54 GMT

Yes, they will be moved from HDP starting from HDP 3.0.0.

The following information is taken from release notes:

The following components are marked moving from HDP and will be moved in a future HDP release to an alternative Hortonworks Subscription and Offering:

Component or Capability	Status	Marked Moving as of	Target Release for Move
Apache Accumulo	Moving	HDP 2.6.0	HDP 3.0.0
Apache Kafka	Moving	HDP 2.6.0	HDP 3.0.0
Apache Storm	Moving	HDP 2.6.0	HDP 3.0.0
Cloudbreak	Moving	HDP 2.6.0	HDP 3.0.0

Re: differences between hdp (Hortonworks Data Platform) and hdf (Hortonworks Data flow)

the_best_specia — Tue, 29 May 2018 22:05:44 GMT

What is the reason behind separation into HDP and HDF? It is very often that company needs both real-time data processing and batch processing, why not to make single package?