Created 07-27-2016 09:38 AM
I am using CDH 5.5.7 quick start VM which has Spark 1.6.0 running. I am trying to connect to the spark-sql cli but it fails. According to this link by issuing spark-sql
command I should be able to enter the cli but I get the below error.
[cloudera@quickstart ~]$ spark-sql
-bash: spark-sql: command not found
I have also tried the below and getting the same error
[cloudera@quickstart ~]$ ./bin/spark-sql
-bash: ./bin/spark-sql: No such file or directory
Any help is much appreciated.
Created 07-27-2016 11:01 AM
If spark is not present at location ./bin/spark-sql, just verify the correct folder and run sh. Secondly check the user you are logged into system and have sufficient permission or a Hadoop group member.
Created 07-27-2016 11:22 AM
From the same directory I can fire spark-shell and that works without any hassle. Moreover I am using the VM and I am sure that the use I am using has the root access.
Created 07-27-2016 01:49 PM
If other components are present and working that means someone deleted the file cause in HDP and Biginsight both have no issue and they shipped with all components.
Created 07-27-2016 06:39 PM
I am using the vm version of the distribution in my laptop and hence there is no chance of any file deletion.
Created 08-31-2019 10:17 PM
try spark-shell command