question Re: Is CDP open source? in Support Questions

Is CDP open source?

datascience_had — Tue, 14 Jan 2020 16:07:24 GMT

I have a simple question, Is CDP (CDH 7.x) open source?

when I try to download the cm7 from this URL https://archive.cloudera.com/p/cm7/

Its ask for password.

I am following this URL https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-configure-repository.html

Thanks

Re: Is CDP open source?

stevenmatison — Mon, 06 Jan 2020 13:41:43 GMT

The newest CDP and HDP releases require a customer username and password.

Anything in the archive.cloudera.com path will require this level of authorization. Here is some specific reference to how to obtain access (for HDP):

Starting with the HDP 3.1.5 release, access to HDP repositories requires authentication. To access the binaries, you must first have the required authentication credentials (username and password).

Authentication credentials for new customers and partners are provided in an email sent from Cloudera to registered support contacts. Existing users can file a non-technical case within the support portal (https://my.cloudera.com) to obtain credentials.

Previously, HDP repositories were located on AWS S3. As of HDP 3.1.5 / Ambari 2.7.5, repositories have been moved to https://archive.cloudera.com

When you obtain your authentication credentials, use them to form the URL where you can access the HDP repository in the HDP archive, as shown below. Insert your username and password at the front of the URL.

Re: Is CDP open source?

kingpin — Mon, 06 Jan 2020 13:49:53 GMT

CDP isn't 100% open source. You may have to purchase the subscription.

Trial can be download from here-

https://www.cloudera.com/downloads.html

"THE TRIAL VERSION INCLUDES ALL FEATURES OF THE FULL PRODUCT AND IS VALID FOR 60 DAYS FROM THE TIME OF INSTALLATION."

Re: Is CDP open source?

GangWar — Mon, 06 Jan 2020 14:11:21 GMT

@datascience_had Yes, this is the Open source but under the AGPL now. For more details on how AGPL works in new Cloudera world see below:

https://blog.cloudera.com/our-commitment-to-open-source-software/

Coming to the repo download issue you should have a valid subscription to download these bits. For more details:

For CDP-DC runtime: https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-runtime-download-information.html

For CDP-DC: https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-cm-download-information.html

But you can always use our trial version of CDP-DC form here by downloading directly.

https://www.cloudera.com/downloads/cdp-data-center-trial.html

For trial installation procedure please follow the doc: https://docs.cloudera.com/cdpdc/7.0/installation/topics/cdpdc-trial-installation.html

Re: Is CDP open source?

datascience_had — Wed, 08 Jan 2020 08:54:19 GMT

Still its not clear, If its open source so why Cloudera is asking for trail version installation. Earlier it was not like that CDH 6 or 5.

At-least we can download the parcles and install as CDH and later we can purchase if we want. Same as CDH.

Its confusing 🙂

Re: Is CDP open source?

MGhareeb — Wed, 08 Jan 2020 11:22:21 GMT

are authentication required for the Cloudera Enterprise version?

Re: Is CDP open source?

stevenmatison — Wed, 08 Jan 2020 12:38:41 GMT

This is a recent change. Based on the amount of feedback it has created just within the Community here, we may expect more changes to the Open Source Model for access to evaluation versions. However, since the Merger, there are many big changes afoot including moving away from mostly Open Source Hortonworks towards new Business Models of Cloudera.

Re: Is CDP open source?

szhem — Thu, 16 Jan 2020 12:33:49 GMT

Could you please shed some light on how to upgrade from CDH 6.x CE to the new versions, e.g. CDH 7.x?

Will CDH 7.x be available as Community Edition for download?

Re: Is CDP open source?

PieterB — Mon, 20 Jan 2020 10:14:33 GMT

I could introduce HDP in the company because getting new stacks/software in a public company requires frame agreements. The "open source" aspect resulted in choosing Hortonworks (vs Cloudera) at that time. Comparision: for products such as RHEL you have alternatives (CentOS)

Like this our team could get experience with HDP for more then one year long after that we had all the possibilities to buy both HDP and HDF : once the paperwork was finished.

Also it is easier for evaluation.

In my opinion a model such as Elasticsearch or Confluent for Kafka uses is better.
Just protect important components for running the stack at 'enterprise' scale, with security, support... (things cloud vendors would 'misuse') by using subscriptions.

"Hiding" the base binary distribution is just utterly stupid (adoption etc)

Also very important is the quality of the documentation. There is a difference....

Re: Is CDP open source?

campi — Tue, 21 Jan 2020 09:52:30 GMT

This is a major change for the HDP distribution at least, which was supposed to remain open source and freely available. Do you actually need to have a paid license/subscription to get access to HDP 3.1.5+ repositories now ?

Re: Is CDP open source?

Tim Armstrong — Tue, 21 Jan 2020 22:16:49 GMT

For what it's worth, from an engineering/R&D point of view, more of us are going to be contributing to open source projects than before.

All of the core development that was done in the context of open source projects (e.g. the many Apache projects we contribute to) will continue as before.
Previously closed source projects are going to be open sourced under the AGPL.

The binary distribution does require a subscription (beyond the trial period), similar to how Red Hat does things.

Re: Is CDP open source?

ask_bill_brooks — Wed, 22 Jan 2020 01:13:09 GMT

Hi @szhem,

Have you by chance watched the Cloudera webinar "From the Edge to AI" from January? The video introduces Cloudera Data Platform (CDP) as well as the support plan and upgrade path for CDH (and HDP as well).

Bill

Re: Is CDP open source?

PieterB — Wed, 22 Jan 2020 08:42:46 GMT

Red Hat is similar, but offers CentOS as a 100% binary compatible distribution.

Not offering openly a binary build can lead to fewer customers and adoption in the end.

Enterprise who want to have support will pay for a support subscription anyway. The others you don't need....

Re: Is CDP open source?

szhem — Wed, 22 Jan 2020 09:28:15 GMT

I have. Unfortunately, it's not clear enough from there how to do it in case of CDH CE.

I feel that it will be necessary to buy a subscription at first (according to this thread) to be able to upgrade to CDP and there is no upgrade path in case of Community Edition.

Re: Is CDP open source?

szhem — Thu, 23 Jan 2020 10:12:28 GMT

Can't agree more. I don't know RedHat products which don't have alternative binaries available without subscriptions.

RHEL -> CentOS

MRG Messaging -> Apache QPID

JBoss EAP -> Wildfly

Data Grid -> Infinispan

Fuse -> ServiceMix

etc.

Re: Is CDP open source?

GangWar — Thu, 23 Jan 2020 17:25:09 GMT

This could be the endless discussion, but the whole thing is Getting Support = Valid Subscription
You can always try the repo for evaluation purpose meant for trial by just registering you email, but at the end of the day in Enterprise if you need support then you will come at same point.

Re: Is CDP open source?

maziyar — Mon, 10 Feb 2020 10:39:26 GMT

True, this could be an endless debate since it's already done! I expected the Cloudera Express edition to be discontinued at least in a major release, not in a minor release! (6.3.3)

https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_633_new_features.html#cdh621_new_features

Well, this is then. Open or close, there is no way to use CDM/CDH for free anymore to build something and then ask for a budget. I am sorry but in public they don't pay these prices just because we tried something for a short period of time. They need actual proof of concept as to why something expensive is good.

Re: Is CDP open source?

datascience_had — Mon, 10 Feb 2020 10:42:01 GMT

We are already in Feb, Are we making CDP (cloudera manager etc) open source? Earlier It was said, It would be open sourced in Feb 2020.

Right now CDP 7.x is only available with trails for 2 months OR its a dead end without Subscription.

Re: Is CDP open source?

anshuman — Fri, 06 Mar 2020 07:46:39 GMT

Yes, can we have pointer to the open source code in March 2020 ?

Re: Is CDP open source?

anshuman — Fri, 06 Mar 2020 07:47:51 GMT

@Tim Armstrong that is great !

Is the source now available ? and the documentation to build the source ?

I am pretty sure the community will simply rally around and build something up with enough pointers.

I agree with @PieterB hiding the base binaries is silly.

Did the HDP model have any failures ?

Enterprises which needed support bought it anyway.

Keeping it free increased adoption.