- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Manual installation of spark2-client
- Labels:
-
Apache Spark
Created ‎03-20-2018 10:35 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am manually installing spark2-clients , but i have some of confusion :
yum search spark2
it lists out spark_<version>_<build>-master.noarch : Server for Spark 2 master
spark_<version>_<build>-python.noarch : Python client for Spark 2 spark_<version>_<build>-worker.noarch : Server for Spark 2 worker spark_<version>_<build>.noarch : Lightning-Fast Cluster Computing
yum install spark2_<version>-master spark_<version>-python
but i want to install spark2-client , I am not sure what to install in order to install spark2-client only . when i run above commands
it do create /usr/hdp/current/spark2-client but i guess it is also installing spark2 server .
Created ‎03-21-2018 05:46 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Below package should be enough to only install the client libraries.
spark_<version>_<build>.noarch :Lightning-FastClusterComputing ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch
P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.
Created ‎03-21-2018 05:46 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Below package should be enough to only install the client libraries.
spark_<version>_<build>.noarch :Lightning-FastClusterComputing ex: spark2_2_6_4_0_91-2.2.0.2.6.4.0-91.noarch
P.S If you are installing the client manually make sure you copy configuration files /etc/spark2/conf/ from the node which is managed by ambari. This way configurations will be same across the cluster.
