28801
DISCUSSIONS
102184
MEMBERS
3161
ARTICLES
Created 05-28-2015 10:18 AM
Is there any way to run multiple instances of pyspark consoles using --master yarn-client option?
The second console only start to work after killing the first one.
My actual goal is to configure IPython Notebook like described here (http://blog.cloudera.com/blog/2014/08/how-to-use-ipython-notebook-with-apache-spark/), but when I open another notepad, and notebook creates another kernel, this fires another "pyspark console".
I think if I figure out how to solve the first problem, the second (actual problem) will be solved too.
Thanks,
Vitor.