Support Questions
Find answers, ask questions, and share your expertise

Concerns with installing Python 3.X on Hadoop Cluster

Solved Go to solution

Concerns with installing Python 3.X on Hadoop Cluster

Hi All,

I am aware that HDP and Ambari need Python 2.X to run it's services. However are there any concerns with installing Python 3.5.1 to be used for data processing?

Thanks,

Andrew

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Concerns with installing Python 3.X on Hadoop Cluster

Hi @Andrew Watson

As long as it's installed out of the default system paths, and only called by whatever processing scripts or tools you're thinking of, I don't see that being an issue at all.

It'll require careful installation and ongoing care though, just from a security and patching perspective.

View solution in original post

6 REPLIES 6

Re: Concerns with installing Python 3.X on Hadoop Cluster

Hi @Andrew Watson

As long as it's installed out of the default system paths, and only called by whatever processing scripts or tools you're thinking of, I don't see that being an issue at all.

It'll require careful installation and ongoing care though, just from a security and patching perspective.

View solution in original post

Re: Concerns with installing Python 3.X on Hadoop Cluster

Guru

@Andrew Watson

If you are also looking at mutiple python library versions, take a look at virtualenv. This makes managing multiple python environments easier.

Re: Concerns with installing Python 3.X on Hadoop Cluster

Contributor

It is also worth while checking pyenv: https://github.com/yyuu/pyenv

From their home page:

pyenv does...

  • Let you change the global Python version on a per-user basis.
  • Provide support for per-project Python versions.
  • Allow you to override the Python version with an environment variable.
  • Search commands from multiple versions of Python at a time. This may be helpful to test across Python versions with tox.

Re: Concerns with installing Python 3.X on Hadoop Cluster

Explorer

hello andrew,

have you installed the python 3.x version? if so how is it running?

i am also trying to install python 3.x in my HDP. can you guide me in this?

Re: Concerns with installing Python 3.X on Hadoop Cluster

Expert Contributor

@Andrew Watson @Dave Russell

Have you tried to install python 3 on hdp? what did you use to install? virtualenv? conda env? which works better? do you have some instructions? is this advisable to do on production environment?

Re: Concerns with installing Python 3.X on Hadoop Cluster

New Contributor

Hi All,

 

is there specific method to follow for installing ambari on python3..any one installed on python3 base