Update Spark version in Data Engineering for trial account

[#1]

Hello all,

Is it possible to update the Spark version to 3.4.x or later for trial accounts so that Spark Connect can be used? Thanks

[#2]

@Esteban2026, Welcome to our community! To help you get the best possible answer, I have tagged in our Spark experts @haridjh, who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

[#3]

Hello @Esteban2026, 

The Spark version is related to the VC created. 
You should be able to select the version when creating a new VC. 

On the trial, don't you have those options? 

[#4]

Hi @vafs , when I selected the Data Engineering use case for the trial and VC was already created.  It doesn't seem like I have an option to delete the VC or create a new VC.  For example, under the environments in the management console, the delete option button disappears when you try to hover your mouse over it.

Thanks,

Esteban

[#5]

@Esteban2026 Could you please check if you can use CLI options to remove the VCs

https://docs.cloudera.com/cdp-public-cloud/cloud/cli/topics/mc-cli-client-setup.html
https://cloudera.github.io/cdp-dev-docs/cli-docs/de/index.html

[#6]

Hi @haridjh I tried to delete the VC using `cdp de delete-vc --vc-id...  --cluster-id...` and got an error result of auth failed:

(Status Code: 403; Error Code: PERMISSION_DENIED; Service: de; Operation: deleteVc; Request ID: 94ac6721-5242-43d2-963b-c5b907ca030c;)