Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created on 06-07-2016 02:34 AM - edited 09-16-2022 03:23 AM
Hi,
I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message
[admin@hostname~]$ ipython notebook --profile=pyspark [TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions. [TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now. [W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect. [I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port. [I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin [I 14:49:14.845 NotebookApp] 0 active kernels [I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/ [I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation). [I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms
Now the problem is it is not recognizing the profile
Unrecognized alias: '--profile=pyspark', it will probably have no effect.
Help me to integrate iPython and Spark
Created 06-10-2016 04:16 AM
Created 06-10-2016 03:46 AM
What Python version you are using.
You may want to refer :
http://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_ipython.html
Created 06-10-2016 04:16 AM