Hi,
I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message
[admin@hostname~]$ ipython notebook --profile=pyspark
[TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions.
[TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now.
[W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect.
[I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port.
[I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin
[I 14:49:14.845 NotebookApp] 0 active kernels
[I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/
[I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms
Now the problem is it is not recognizing the profile
Unrecognized alias: '--profile=pyspark', it will probably have no effect.
Help me to integrate iPython and Spark
