question Re: Error during spark on yarn installation in Support Questions

Error during spark on yarn installation

petibonvm — Fri, 16 Sep 2022 09:39:19 GMT

Hi,

When i'm trying to add "spark on yarn" service with Cloudera Manager 5.4.3, i have the following messages :

javax.persistence.PersistenceException:org.hibernate.exception.ConstraintViolationException: could not perform addBatch
at AbstractEntityManagerImpl.java line 1387
in org.hibernate.ejb.AbstractEntityManagerImpl convert()

Caused by: java.sql.BatchUpdateException:Batch entry 0 insert into SERVICES (OPTIMISTIC_LOCK_VERSION, NAME, DISPLAY_NAME, SERVICE_TYPE, MAINTENANCE_COUNT, GENERATION, CLUSTER_ID, SERVICE_ID) values ('0', 'spark_on_yarn', 'Spark', 'SPARK_ON_YARN', '0', '1', '2', '55') was aborted. Call getNextException to see the cause.
at AbstractJdbc2Statement.java line 2598
in org.postgresql.jdbc2.AbstractJdbc2Statement$BatchResultHandler handleError()

Any idea ?

regards,

Re: Error during spark on yarn installation

GautamG — Wed, 26 Aug 2015 23:25:53 GMT

Do you have the Standalone Spark service also present in the cluster? If so, please change the name of the existing SPARK service to say "SPARK standalone" before attempting to add SPARK on YARN using "Add A Service"

Re: Error during spark on yarn installation

petibonvm — Thu, 03 Sep 2015 12:18:23 GMT

works !

I have a old cdh version (5.2) upgrading to 5.4.4 last week.

In my db, spark use the following name :

After deleting spark standalone and installing spark on yarn, the table has been updated :

regrads,