question Re: Update Spark version in Data Engineering for trial account in Support Questions

Update Spark version in Data Engineering for trial account

Esteban2026 — Tue, 21 Apr 2026 06:11:06 GMT

Hello all,

Is it possible to update the Spark version to 3.4.x or later for trial accounts so that Spark Connect can be used? Thanks

Re: Update Spark version in Data Engineering for trial account

VidyaSargur — Thu, 08 Jan 2026 05:56:45 GMT

@Esteban2026, Welcome to our community! To help you get the best possible answer, I have tagged in our Spark experts @haridjh, who may be able to assist you further.

Please feel free to provide any additional information or details about your query, and we hope that you will find a satisfactory solution to your question.

Re: Update Spark version in Data Engineering for trial account

vafs — Thu, 08 Jan 2026 17:25:21 GMT

Hello @Esteban2026,

The Spark version is related to the VC created.
You should be able to select the version when creating a new VC.

On the trial, don't you have those options?

Re: Update Spark version in Data Engineering for trial account

Esteban2026 — Thu, 08 Jan 2026 18:18:32 GMT

Hi @vafs , when I selected the Data Engineering use case for the trial and VC was already created. It doesn't seem like I have an option to delete the VC or create a new VC. For example, under the environments in the management console, the delete option button disappears when you try to hover your mouse over it.

Thanks,

Esteban

Re: Update Spark version in Data Engineering for trial account

haridjh — Fri, 09 Jan 2026 09:02:26 GMT

@Esteban2026 Could you please check if you can use CLI options to remove the VCs

https://docs.cloudera.com/cdp-public-cloud/cloud/cli/topics/mc-cli-client-setup.html
https://cloudera.github.io/cdp-dev-docs/cli-docs/de/index.html

Re: Update Spark version in Data Engineering for trial account

Esteban2026 — Fri, 09 Jan 2026 21:46:34 GMT

Hi @haridjh I tried to delete the VC using `cdp de delete-vc --vc-id... --cluster-id...` and got an error result of auth failed:

(Status Code: 403; Error Code: PERMISSION_DENIED; Service: de; Operation: deleteVc; Request ID: 94ac6721-5242-43d2-963b-c5b907ca030c;)