Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Manual installation of spark2-client

avatar

I am manually installing spark2-clients , but i have some of confusion :

yum search spark2

it lists out spark_<version>_<build>-master.noarch : Server for Spark 2 master

spark_<version>_<build>-python.noarch : Python client for Spark 2
spark_<version>_<build>-worker.noarch : Server for Spark 2 worker
spark_<version>_<build>.noarch : Lightning-Fast Cluster Computing

yum install spark2_<version>-master spark_<version>-python

but i want to install spark2-client , I am not sure what to install in order to install spark2-client only . when i run above commands

it do create /usr/hdp/current/spark2-client but i guess it is also installing spark2 server .

1 ACCEPTED SOLUTION

avatar

@Anurag Mishra

Below package should be enough to only install the client libraries.

spark_<version>_<build>.noarch :Lightning-FastClusterComputing

ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch

P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.

View solution in original post

1 REPLY 1

avatar

@Anurag Mishra

Below package should be enough to only install the client libraries.

spark_<version>_<build>.noarch :Lightning-FastClusterComputing

ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch

P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.