I am installing Hadoop using Ambari ,and got error during spark client install (/usr/bin/hdp-select status spark-client invalid Packages ) here is the error Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'spark_2_2_*'' returned 1. Error: Nothing to do 2016-09-13 16:35:38,220 - Could not determine HDP version for component spark-client by calling '/usr/bin/hdp-select status spark-client > /tmp/tmpJxg9F3'. Return Code: 1, Output: ERROR: Invalid package - spark-client Packages: accumulo-client accumulo-gc accumulo-master accumulo-monitor accumulo-tablet accumulo-tracer falcon-client falcon-server flume-server hadoop-client hadoop-hdfs-datanode hadoop-hdfs-journalnode hadoop-hdfs-namenode hadoop-hdfs-nfs3 hadoop-hdfs-portmap hadoop-hdfs-secondarynamenode hadoop-mapreduce-historyserver hadoop-yarn-nodemanager hadoop-yarn-resourcemanager hadoop-yarn-timelineserver hbase-client hbase-master hbase-regionserver hive-metastore hive-server2 hive-webhcat kafka-broker knox-server mahout-client oozie-client oozie-server phoenix-client ranger-admin ranger-usersync slider-client sqoop-client sqoop-server storm-client storm-nimbus storm-slider-client storm-supervisor zookeeper-client zookeeper-server Aliases: accumulo-server all client hadoop-hdfs-server hadoop-mapreduce-server hadoop-yarn-server hive-server .
Try this: (Please replace the version 2.2.x.x.x with your version number there)
rm -r /usr/hdp/current/spark-client ln -s /usr/hdp/2.2.x.x.x/spark /usr/hdp/current/spark-client
So it should look like:
ls -l /usr/hdp/current/spark-client lrwxrwxrwx.1 root root 26Sep1413:04/usr/hdp/current/spark-client ->/usr/hdp/2.2.x.x.x/spark