question Anaconda parcels - installing new package, using conda? in Support Questions

Anaconda parcels - installing new package, using conda?

mmgraph — Fri, 20 Jan 2017 16:28:10 GMT

Hi there,

I've installed successfullly the anaconda parcel but how do I installed new packages on this distrib ? I mean, how do I use conda?

Should I add conda to PATH, if so where is by default ? The documentation is not clear 😞

Thx for help,

Mehdi

Re: Anaconda parcels - installing new package, using conda?

bgooley — Fri, 20 Jan 2017 21:12:05 GMT

Hi @mmgraph, not sure, but the following might help:

https://docs.continuum.io/anaconda/cloudera

http://blog.cloudera.com/blog/2016/02/making-python-on-apache-hadoop-easier-with-anaconda-and-cdh/

Ben

Re: Anaconda parcels - installing new package, using conda?

mmgraph — Mon, 23 Jan 2017 09:19:13 GMT

Yeah I already had a look over there.

So I solved this by adding to my PATH, the ../cloudera/parcels/Anaconda/bin:$PATH"

After I was able to use conda command and pip install BUT when installing a new package, it doesn't install to the cluster, so need to manually install on each machine...

Re: Anaconda parcels - installing new package, using conda?

omaritec — Thu, 26 Jan 2017 14:39:00 GMT

Thanks, I have the same problem.

Could anyone explain if it is correct to manually install new packages on every node ?

Is this a functionality you aquire with commercial Anaconda only?

Thanks

Re: Anaconda parcels - installing new package, using conda?

mageru — Tue, 10 Oct 2017 16:03:14 GMT

I am able to do this by running (or adding this to your ~/.bashrc)

export PATH=/opt/cloudera/parcels/Anaconda/bin:$PATH

After this conda, pip, and python commands all defaulted to the Anaconda version.

Re: Anaconda parcels - installing new package, using conda?

paulsylvester — Wed, 29 Nov 2017 11:00:45 GMT

Hi,

Does this PATH variable need adding to every node in the Cluster where the parcels have been delivered?

Re: Anaconda parcels - installing new package, using conda?

NVidak — Thu, 05 Apr 2018 11:24:14 GMT

Putting Anaconda's bin in front of $PATH is a bit dangerous thing to do. It contains binaries like iconv, curl so you suddenly end calling them instead or original ones ....

Re: Anaconda parcels - installing new package, using conda?

maziyar — Thu, 22 Nov 2018 17:00:20 GMT

Hi,
What do you suggest instead to overcome this issue? I mean being able to use something like ansible and ask all the node to run conda install ... ?

Re: Anaconda parcels - installing new package, using conda?

NVidak — Wed, 10 Apr 2019 11:30:38 GMT

put it at the end of $PATH .....