- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Anaconda parcels - installing new package, using conda?
- Labels:
-
Cloudera Manager
Created ‎01-20-2017 08:28 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi there,
I've installed successfullly the anaconda parcel but how do I installed new packages on this distrib ? I mean, how do I use conda?
Should I add conda to PATH, if so where is by default ? The documentation is not clear 😞
Thx for help,
Mehdi
Created ‎01-23-2017 01:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yeah I already had a look over there.
So I solved this by adding to my PATH, the ../cloudera/parcels/Anaconda/bin:$PATH"
After I was able to use conda command and pip install BUT when installing a new package, it doesn't install to the cluster, so need to manually install on each machine...
Created ‎01-20-2017 01:12 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @mmgraph, not sure, but the following might help:
https://docs.continuum.io/anaconda/cloudera
http://blog.cloudera.com/blog/2016/02/making-python-on-apache-hadoop-easier-with-anaconda-and-cdh/
Ben
Created ‎01-23-2017 01:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yeah I already had a look over there.
So I solved this by adding to my PATH, the ../cloudera/parcels/Anaconda/bin:$PATH"
After I was able to use conda command and pip install BUT when installing a new package, it doesn't install to the cluster, so need to manually install on each machine...
Created on ‎01-26-2017 06:38 AM - edited ‎01-26-2017 06:39 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks, I have the same problem.
Could anyone explain if it is correct to manually install new packages on every node ?
Is this a functionality you aquire with commercial Anaconda only?
Thanks
Created ‎10-10-2017 09:03 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am able to do this by running (or adding this to your ~/.bashrc)
export PATH=/opt/cloudera/parcels/Anaconda/bin:$PATH
After this conda, pip, and python commands all defaulted to the Anaconda version.
Created ‎11-29-2017 03:00 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
Does this PATH variable need adding to every node in the Cluster where the parcels have been delivered?
Created ‎04-05-2018 04:24 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Putting Anaconda's bin in front of $PATH is a bit dangerous thing to do. It contains binaries like iconv, curl so you suddenly end calling them instead or original ones ....
Created ‎11-22-2018 09:00 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
What do you suggest instead to overcome this issue? I mean being able to use something like ansible and ask all the node to run conda install ... ?
Created ‎04-10-2019 04:30 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
put it at the end of $PATH .....
