Support Questions
Find answers, ask questions, and share your expertise

when I run python code by python interpreter on zeppelin, is it run on spark engine or not

Highlighted

when I run python code by python interpreter on zeppelin, is it run on spark engine or not

I need to run python code on zeppelin with spark engine and adding python interpreter on zeppelin then run python code but, I dont know, is python code run by spark engine? or not?

if not, how can run python code by spark engine on zeppelin?

3 REPLIES 3
Highlighted

Re: when I run python code by python interpreter on zeppelin, is it run on spark engine or not

Super Collaborator

it is not run in Spark, it will be run directly in Python. You'll need the interpreter %spark or %spark.pyspark Interpreter instead

Highlighted

Re: when I run python code by python interpreter on zeppelin, is it run on spark engine or not

I have python and java codes. is there any way to convert python or java codes to pyspark or spark?

Highlighted

Re: when I run python code by python interpreter on zeppelin, is it run on spark engine or not

Super Collaborator

with pyspark you can execute python code, you might have to check the library pathes. When you use Java, you can use the Spark API 'native', but i don't know if this can be done in Zeppelin.