Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

how to login pyspark from client server

how to login pyspark from client server

New Contributor

I have a HDP cluster of 5 node set up. how can i access pyspark from client server

3 REPLIES 3

Re: how to login pyspark from client server

@kotesh banoth

Make sure you have the spark-client installed on that machine. Then just type "pyspark" and hit enter you should be able to use the pyspark in local mode. if you want to run it in yarn mode, use "pyspark --master yarn-client".

Hope this helps.

Highlighted

Re: how to login pyspark from client server

Just to add, make sure all the configuration files for spark, hdfs, yarn and mapreduce are also in sync. This is needed if the client server is not managed by ambari.

Re: how to login pyspark from client server

@kotesh banoth

Wanted to check if this help in addressing your query?

Don't have an account?
Coming from Hortonworks? Activate your account here