Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Unrecognized alias: '--profile=pyspark'

Solved Go to solution

Unrecognized alias: '--profile=pyspark'

Expert Contributor

Hi,

 

I foloowed http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/ post to integrate iPython and Spark. I have followed everything. But its not working, while executing i ma getting below message

[admin@hostname~]$ ipython notebook --profile=pyspark
[TerminalIPythonApp] WARNING | Subcommand `ipython notebook` is deprecated and will be removed in future versions.
[TerminalIPythonApp] WARNING | You likely want to use `jupyter notebook`... continue in 5 sec. Press Ctrl-C to quit now.
[W 14:49:14.602 NotebookApp] Unrecognized alias: '--profile=pyspark', it will probably have no effect.
[I 14:49:14.842 NotebookApp] The port 8888 is already in use, trying another random port.
[I 14:49:14.845 NotebookApp] Serving notebooks from local directory: /home/admin
[I 14:49:14.845 NotebookApp] 0 active kernels
[I 14:49:14.845 NotebookApp] The Jupyter Notebook is running at: http://hostname:8889/
[I 14:49:14.845 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[I 14:51:21.271 NotebookApp] 302 GET / (10.x.x.x) 0.60ms

Now the problem is it is not recognizing the profile 

Unrecognized alias: '--profile=pyspark', it will probably have no effect.

Help me to integrate iPython and Spark

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Unrecognized alias: '--profile=pyspark'

Expert Contributor
I am using Python 2.7.11 and i followed Version 5.7 same document and it worked..

Thanks
2 REPLIES 2
Highlighted

Re: Unrecognized alias: '--profile=pyspark'

Contributor

What Python version you are using. 

 

You may want to refer :

http://www.cloudera.com/documentation/enterprise/5-5-x/topics/spark_ipython.html

Re: Unrecognized alias: '--profile=pyspark'

Expert Contributor
I am using Python 2.7.11 and i followed Version 5.7 same document and it worked..

Thanks
Don't have an account?
Coming from Hortonworks? Activate your account here