Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Manual installation of spark2-client

avatar

I am manually installing spark2-clients , but i have some of confusion :

yum search spark2

it lists out spark_<version>_<build>-master.noarch : Server for Spark 2 master

spark_<version>_<build>-python.noarch : Python client for Spark 2
spark_<version>_<build>-worker.noarch : Server for Spark 2 worker
spark_<version>_<build>.noarch : Lightning-Fast Cluster Computing

yum install spark2_<version>-master spark_<version>-python

but i want to install spark2-client , I am not sure what to install in order to install spark2-client only . when i run above commands

it do create /usr/hdp/current/spark2-client but i guess it is also installing spark2 server .

1 ACCEPTED SOLUTION

avatar

@Anurag Mishra

Below package should be enough to only install the client libraries.

spark_<version>_<build>.noarch :Lightning-FastClusterComputing

ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch

P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.

View solution in original post

1 REPLY 1

avatar

@Anurag Mishra

Below package should be enough to only install the client libraries.

spark_<version>_<build>.noarch :Lightning-FastClusterComputing

ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch

P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.