I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message
[admin@hostname~]$ ipython notebook --profile=pyspark [TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions. [TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now. [W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect. [I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port. [I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin [I 14:49:14.845 NotebookApp] 0 active kernels [I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/ [I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation). [I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms
Now the problem is it is not recognizing the profile
Unrecognized alias: '--profile=pyspark', it will probably have no effect.
Help me to integrate iPython and Spark
What Python version you are using.
You may want to refer :