Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

Unrecognized alias: '--profile=pyspark'

SOLVED Go to solution

Unrecognized alias: '--profile=pyspark'

Expert Contributor

Hi,

 

I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message

[admin@hostname~]$ ipython notebook --profile=pyspark
[TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions.
[TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now.
[W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect.
[I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port.
[I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin
[I 14:49:14.845 NotebookApp] 0 active kernels
[I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/
[I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms

Now the problem is it is not recognizing the profile 

Unrecognized alias: '--profile=pyspark', it will probably have no effect.

Help me to integrate iPython and Spark

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Unrecognized alias: '--profile=pyspark'

Expert Contributor
I am using Python 2.7.11 and i followed Version 5.7 same document and it worked..

Thanks
2 REPLIES 2

Re: Unrecognized alias: '--profile=pyspark'

Contributor

What Python version you are using. 

 

You may want to refer :

http://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_ipython.html
Highlighted

Re: Unrecognized alias: '--profile=pyspark'

Expert Contributor
I am using Python 2.7.11 and i followed Version 5.7 same document and it worked..

Thanks