Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

How to execute multiple pyspark consoles?

avatar
Contributor

Is there any way to run multiple instances of pyspark consoles using --master yarn-client option?

The second console only start to work after killing the first one.

 

My actual goal is to configure IPython Notebook like described here (http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/), but when I open another notepad, and notebook creates another kernel, this fires another "pyspark console".

I think if I figure out how to solve the first problem, the second (actual problem) will be solved too.

 

Thanks,

Vitor.

Who agreed with this topic