Manual installation of spark2-client

amol_08 — Tue, 20 Mar 2018 17:35:06 GMT

I am manually installing spark2-clients , but i have some of confusion :

yum search spark2

it lists out spark_<version>_<build>-master.noarch : Server for Spark 2 master

spark_<version>_<build>-python.noarch : Python client for Spark 2
spark_<version>_<build>-worker.noarch : Server for Spark 2 worker
spark_<version>_<build>.noarch : Lightning-Fast Cluster Computing

yum install spark2_<version>-master spark_<version>-python

but i want to install spark2-client , I am not sure what to install in order to install spark2-client only . when i run above commands

it do create /usr/hdp/current/spark2-client but i guess it is also installing spark2 server .

Re: Manual installation of spark2-client

sandyy006 — Thu, 22 Mar 2018 00:46:50 GMT

@Anurag Mishra

Below package should be enough to only install the client libraries.

spark_<version>_<build>.noarch :Lightning-FastClusterComputing

ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch

P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.

question Manual installation of spark2-client in Archives of Support Questions (Read Only)

Manual installation of spark2-client

Re: Manual installation of spark2-client