Reply
Highlighted
New Contributor
Posts: 5
Registered: ‎09-29-2017

CDH_SPARK2_HOME not set

I installed SPARK2 parcel/service (SPARK2-2.1.0.cloudera1-1.cdh5.7.0.p0.120904) on my cluster and made sure my plugin for HBase could use it.

Upgrading to SPARK2-2.1.0.cloudera2-1.cdh5.7.0.p0.171658 broke that configuration, however, as the CDH_SPARK2_HOME enviorment variable was not available in my plugin_env.sh and HBase roles anymore.

That I figured was due to removing "provides" : "cdh-plugin" from SPARK2/meta/parcel.json.

If that change was deliberate, what is now the way to discover SPARK2 from another service (plugin for another service)?

 

 

Announcements