Unrecognized alias: '--profile=pyspark'

kchaitanya — Fri, 16 Sep 2022 10:23:46 GMT

Hi,

I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message

[admin@hostname~]$ ipython notebook --profile=pyspark
[TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions.
[TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now.
[W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect.
[I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port.
[I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin
[I 14:49:14.845 NotebookApp] 0 active kernels
[I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/
[I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms

Now the problem is it is not recognizing the profile

Unrecognized alias: '--profile=pyspark', it will probably have no effect.

Help me to integrate iPython and Spark

Re: Unrecognized alias: '--profile=pyspark'

_Umesh — Fri, 10 Jun 2016 10:46:31 GMT

What Python version you are using.

You may want to refer :

http://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_ipython.html

Re: Unrecognized alias: '--profile=pyspark'

kchaitanya — Fri, 10 Jun 2016 11:16:02 GMT

I am using Python 2.7.11 and i followed Version 5.7 same document and it worked..

Thanks

question Re: Unrecognized alias: '--profile=pyspark' in Archives of Support Questions (Read Only)

Unrecognized alias: '--profile=pyspark'

Re: Unrecognized alias: '--profile=pyspark'

Re: Unrecognized alias: '--profile=pyspark'