- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Enviornment variables of my parcel are overridden by CDH parcel
Created on ‎08-07-2014 11:43 AM - edited ‎09-16-2022 02:04 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
In my own parcel, I was trying to extend some client jar library into hadoop java classpath.
First, I extend my jar path to "HADOOP_CLASSPATH";
I found even my jar can be shown in "hadoop classpath", when running MR jobs, my jars can't be found;
Then, I manually put my jar into "/opt/cloudera/parcels/CDH-5.1.0-1.cdh5.1.0.p0.53/lib/hadoop-mapreduce"
it works. So I tried to extend jar path to "CDH_MR2_HOME" variable in my parcel.jason
Then I realized that for each service restart,
"CDH_MR2_HOME" variable was first setup by my parcel and then overriden by CDH parcel. It turned out that such enviornment variable path can't be extended in this way.
For MR2, is there any enviornment variables, that can be extended for MR jobs? especially using parcel?
Created ‎08-08-2014 04:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I resolved my problem by finding out this page:https://github.com/cloudera/cm_ext/wiki/Plugin-parcel-environment-variables
Created ‎08-08-2014 04:30 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I resolved my problem by finding out this page:https://github.com/cloudera/cm_ext/wiki/Plugin-parcel-environment-variables
