Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Anaconda parcels - installing new package, using conda?

SOLVED Go to solution

Anaconda parcels - installing new package, using conda?

Explorer

Hi there,

 

I've installed successfullly the anaconda parcel but how do I installed new packages on this distrib  ? I mean, how do I use conda?

Should I add conda to PATH, if so where is by default ? The documentation is not clear :(

 

Thx for help,

Mehdi

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Anaconda parcels - installing new package, using conda?

Explorer

Yeah I already had a look over there.

 

So I solved this by adding to my PATH, the ../cloudera/parcels/Anaconda/bin:$PATH"

After I was able to use conda command and pip install BUT when installing a new package, it doesn't install to the cluster, so need to manually install on each machine...

 

8 REPLIES 8

Re: Anaconda parcels - installing new package, using conda?

Super Guru

Re: Anaconda parcels - installing new package, using conda?

Explorer

Yeah I already had a look over there.

 

So I solved this by adding to my PATH, the ../cloudera/parcels/Anaconda/bin:$PATH"

After I was able to use conda command and pip install BUT when installing a new package, it doesn't install to the cluster, so need to manually install on each machine...

 

Re: Anaconda parcels - installing new package, using conda?

Contributor

Thanks, I have the same problem.

Could anyone explain if it is correct to manually install new packages on every node ?

Is this a functionality you aquire with commercial Anaconda only?

Thanks

Re: Anaconda parcels - installing new package, using conda?

Explorer

I am able to do this by running (or adding this to your ~/.bashrc)

 

export PATH=/opt/cloudera/parcels/Anaconda/bin:$PATH

 

After this conda, pip, and python commands all defaulted to the Anaconda version. 

Re: Anaconda parcels - installing new package, using conda?

New Contributor

Hi,

 

Does this PATH variable need adding to every node in the Cluster where the parcels have been delivered?

Highlighted

Re: Anaconda parcels - installing new package, using conda?

Explorer

Putting Anaconda's bin in front of $PATH is a bit dangerous thing to do. It contains binaries like iconv, curl so you suddenly end calling them instead or original ones ....

Re: Anaconda parcels - installing new package, using conda?

Expert Contributor
Hi,
What do you suggest instead to overcome this issue? I mean being able to use something like ansible and ask all the node to run conda install ... ?

Re: Anaconda parcels - installing new package, using conda?

Explorer

put it at the end of  $PATH  .....