Reply
Highlighted
Expert Contributor
Posts: 82
Registered: ‎02-24-2016
Accepted Solution

Unrecognized alias: '--profile=pyspark'

Hi,

 

I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message

[admin@hostname~]$ ipython notebook --profile=pyspark
[TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions.
[TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now.
[W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect.
[I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port.
[I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin
[I 14:49:14.845 NotebookApp] 0 active kernels
[I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/
[I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms

Now the problem is it is not recognizing the profile 

Unrecognized alias: '--profile=pyspark', it will probably have no effect.

Help me to integrate iPython and Spark

Cloudera Employee
Posts: 35
Registered: ‎04-05-2016

Re: Unrecognized alias: '--profile=pyspark'

What Python version you are using. 

 

You may want to refer :

http://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_ipython.html
Expert Contributor
Posts: 82
Registered: ‎02-24-2016

Re: Unrecognized alias: '--profile=pyspark'

I am using Python 2.7.11 and i followed Version 5.7 same document and it worked..

Thanks