Created on 11-22-2017 12:19 PM - edited 09-16-2022 05:33 AM
I'm interested in learning Spark, but I'm of the impression that it would be better to focus on learning based upon Spark 2, instead of Spark 1.x.
Spark 1.6 is part of the current Quickstart VM (v5.12), but I was wondering if it was possible to install Spark 2 instead? I migrated to Parcels and enabled Cloudera Manager on the Quickstart VM, but I don't see Spark 2.
Is there a way of installing Spark 2 on the Quickstart VM?
Created 11-26-2017 12:07 PM
Created 03-18-2018 09:12 AM
for Cloudera manager, it needs minimum 8GB RAM. Is there any way I can replace current spark 1.6 version to 2 without using parcel so that I can run the VM with less than 8 GB?
Created 11-26-2017 11:02 PM
this is the parcel location to download
http://archive.cloudera.com/beta/spark2/parcels/2.0/
please refer the below url for the walkthrough
https://www.cloudera.com/documentation/spark2/latest/topics/spark2_installing.html
refer the screenshots.
please let me know if you need more information.
Created 11-26-2017 11:10 PM
Created 01-26-2023 03:58 AM
I am not able to download because it is asking for user name and password can you please help me
Created 05-28-2018 10:49 PM
Unfortunately I was never able to get this working. The cluster would crash, things wouldn't work, etc... I'm going to sit this one out for now and just wait until an updated QuickStart VM comes up with Spark 2. I'll just use a different distro. for now for Spark 2.
Created 06-17-2018 12:00 PM
ERROR:
CDH 5.12.0-1.cdh5.12.0.p0.29 conflicts with SPARK2 2.0.0.cloudera.beta2-1.cdh5.7.0.p0.110234.