question Re: How to install spark 1.6 on CDH 5.8 packing environment in Archives of Support Questions (Read Only)

How to install spark 1.6 on CDH 5.8 packing environment

lidaling — Fri, 16 Sep 2022 10:38:56 GMT

I got spark 0.9 parcel in parcel manager page.How to install spark 1.6 parcel？

Anyboy has an idea?

Re: How to install spark 1.6 on CDH 5.8 packing environment

bgooley — Tue, 13 Sep 2016 04:23:25 GMT

Hello,

I am not sure if you are asking how to install Spark via packages or parcels as you mentioned "packing environment" and then refer to parcels.

CDH 5.4.8 parcles include Spark. Please refer to the following matrix:

http://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#concept_yzh_1k4_hw

If you are using parcels, then you can add the service in Cloudera Manager with the following instructions:

http://www.cloudera.com/documentation/enterprise/5-4-x/topics/cm_mc_add_service.html

Regards,

Ben

Re: How to install spark 1.6 on CDH 5.8 packing environment

bgooley — Tue, 13 Sep 2016 04:26:31 GMT

OOPS!

Misread and thought you were using CDH 5.4.8!

The same basic documentation applies for CM/CDH 5.8:

Spark Matrix:

http://www.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#concept_yzh_1k4_hw

Adding a Service via Cloudera Manager:

http://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_add_service.html

Regards,

Ben

Re: How to install spark 1.6 on CDH 5.8 packing environment

lidaling — Tue, 13 Sep 2016 08:08:31 GMT

Thanks.

I am lost when seeing the parcels list page .

There is spark 0.9 version parcel for cdh 4.

Re: How to install spark 1.6 on CDH 5.8 packing environment

bgooley — Tue, 13 Sep 2016 08:12:13 GMT

No worries. We will likely remove that older URL from the parcels defaults at some point. For now, you can remove it from the Administration --> Settings --> Parcels configuration if preferred.

Let us know if you have any more questions or issues.

Thanks,

Ben

Re: How to install spark 1.6 on CDH 5.8 packing environment

lidaling — Tue, 13 Sep 2016 08:34:14 GMT

One more issues.

My spark service 's gateway role all in gray color in instances page.The gateway instance can not be enabled.

Any idea?

spark instance page

Re: How to install spark 1.6 on CDH 5.8 packing environment

matdba — Wed, 14 Sep 2016 19:36:40 GMT

Hello, Gateway is a particular type of role, and it means that is a host that will receive a client configuration. So it's not a service with a process, this is the reason why is gray.

Regards