question Re: Does HDP support installation of TensorFlow? in Archives of Support Questions (Read Only)

Does HDP support installation of TensorFlow?

kgopal — Tue, 01 Mar 2016 14:58:51 GMT

Here are the installation modes for TensorFlow:

https://www.tensorflow.org/versions/r0.7/get_started/os_setup.html

Can any of these installations be automated through Cloudbreak? If not, do you already have a recommended way of installing TensorFlow on HDP?

Re: Does HDP support installation of TensorFlow?

nsabharwal — Tue, 01 Mar 2016 17:59:51 GMT

@Karthik Gopal

I don't see any reference to Hadoop based on the white paper and git code. https://github.com/tensorflow/tensorflow

Re: Does HDP support installation of TensorFlow?

kgopal — Tue, 01 Mar 2016 18:08:55 GMT

@Neeraj Sabharwal I guess there is an article which shows that both Spark and TensorFlow can work together - https://databricks.com/blog/2016/01/25/deep-learning-with-spark-and-tensorflow.html

So wanted to know if there are any recommended ways of installing TensorFlow with HDP

Re: Does HDP support installation of TensorFlow?

nsabharwal — Tue, 01 Mar 2016 18:27:49 GMT

@Karthik Gopal I did see that link but no luck on finding an exact information on Hadoop integration with Tensorflow. Spark can run on HDFS and we can HDP on spark to use Tensorflow. Theoretically, This makes sense.

Do you have access to support?

Re: Does HDP support installation of TensorFlow?

aervits — Tue, 01 Mar 2016 19:43:20 GMT

On sandbox, install pip then follow the instructions for pip install, write an article about you success here, great question.

easy_install pip

Re: Does HDP support installation of TensorFlow?

aervits — Tue, 01 Mar 2016 19:45:14 GMT

Use this to create your own service https://cwiki.apache.org/confluence/display/AMBARI/Stacks+and+Services

Re: Does HDP support installation of TensorFlow?

rdoktorics — Tue, 01 Mar 2016 22:23:42 GMT

@Karthik Gopal you can install anything with recipes. Read more here: http://sequenceiq.com/cloudbreak-docs/latest/recipes/

You just have to write the custom script which install TensorFlow

Re: Does HDP support installation of TensorFlow?

TimothySpann — Wed, 12 Oct 2016 02:54:56 GMT

I have installed it on an HDF 2.0 Node on Centos7 and on an HDP 2.5 Node on Centos 7 on OpenStack. This will even install easier on Ubuntu.

Make sure you have Python 2.7+ and PIP installed.

http://hoolihan.net/blog-tim/2016/03/02/installing-tensorflow-on-centos/

sudo pip install --upgrade https://storage.googleapis.com/tensorflow/linux/cpu/tensorflow-0.7.1-cp27-none-linux_x86_64.whl

Re: Does HDP support installation of TensorFlow?

TimothySpann — Fri, 10 Feb 2017 05:12:59 GMT

See Hadoop here: https://github.com/tensorflow/ecosystem

Re: Does HDP support installation of TensorFlow?

TimothySpann — Wed, 15 Feb 2017 00:54:00 GMT

Tensorflow on Spark by Yahoo http://yahoohadoop.tumblr.com/post/157196317141/open-sourcing-tensorflowonspark-distributed-deep https://github.com/yahoo/TensorFlowOnSpark https://github.com/yahoo/TensorFlowOnSpark/wiki/GetStarted_YARN https://github.com/yahoo/TensorFlowOnSpark/wiki/Conversion https://github.com/yahoo/TensorFlowOnSpark/tree/master/examples/slim https://github.com/tensorflow/models/tree/master/slim