Reply
New Contributor
Posts: 2
Registered: ‎12-18-2018

How to set up spark-sql in Cloudera quickstart vm 5.13

[ Edited ]

Hi,

I am trying to launch spark-sql in Cloudera quickstart vm 5.13. I am getting error message 

 

bash: spark-sql: command not found

 

Can anyone  of you please explain me the steps to set up spark-sql CLI in Cloudera quickstart vm 5.13

 

Thanks in advance

 

Champion
Posts: 760
Registered: ‎05-16-2016

Re: How to set up spark-sql in Cloudera quickstart vm 5.13

Could you please let me know if you have Spark service up and runining in QuickStart.

Check in the Cm web ui . 

http://quickstart.cloudera:7180/cmf/login  - Login Page for Cm .

 

If you dont see Spark , Please click on the QuickStartvm -> add service - > spark / spark2 which ever you want -> place the spark service / gateway role on the host.

 

After all the initial setup -> check in this directory to see if you can see the binary file . 

 

 "/opt/cloudera/parcels/CDH-<version>/lib/spark/bin 

and then try the spark-sql 

New Contributor
Posts: 2
Registered: ‎12-18-2018

Re: How to set up spark-sql in Cloudera quickstart vm 5.13

Thanks for the response. 

I checked Cloudera manager and see that Spark in up and running.

 

I checked the below path and see no files under this directory.

 

/opt/cloudera/parcels

 

When I issue spark-sql command , still see the same issue.

Champion
Posts: 760
Registered: ‎05-16-2016

Re: How to set up spark-sql in Cloudera quickstart vm 5.13

could you share the CM web ui front page .
Announcements