Hi,   When i'm trying to add "spark on yarn" service with Cloudera Manager 5.4.3, i have the following messages :   javax.persistence.PersistenceException:org.hibernate.exception.ConstraintViolationException: could not perform addBatch at AbstractEntityManagerImpl.java line 1387 in org.hibernate.ejb.AbstractEntityManagerImpl convert()   Caused by: java.sql.BatchUpdateException:Batch entry 0 insert into SERVICES (OPTIMISTIC_LOCK_VERSION, NAME, DISPLAY_NAME, SERVICE_TYPE, MAINTENANCE_COUNT, GENERATION, CLUSTER_ID, SERVICE_ID) values ('0', 'spark_on_yarn', 'Spark', 'SPARK_ON_YARN', '0', '1', '2', '55') was aborted. Call getNextException to see the cause. at AbstractJdbc2Statement.java line 2598 in org.postgresql.jdbc2.AbstractJdbc2Statement$BatchResultHandler handleError()   Any idea ?   regards, ... View more

Hi,   Since i performed the cloudera upgrade from CDH 5.3.2 to 5.4.5, i have an issue with the spark history server.   I found a similar problem on https://github.com/apache/spark/pull/4848   When application is finished running abnormally (Ctrl + c for example), the history event log file is still ends with .inprogress suffix. And the application state can not be showed on webUI, User can only see "Application history not foud xxxx, Application xxx is still in progress".   Any idea ?   regards,   ... View more

Hi,   Since kerberos (AD) is activated, impala services are down (catalogserver and daemoin), except Impala StateStore.   ----------------------------------------------------------------------------------------------------------------- From impala catalog server log :   9:52:23.336 AM     INFO     status.cc:44      Couldn't open transport for ESLT35020.edc.carrefour.com:24000(No more data to read.)     @           0x74d01d  (unknown)     @           0xa0139a  (unknown)     @           0xa0145b  (unknown)     @           0x8e121c  (unknown)     @           0x8e1886  (unknown)     @           0x937bed  (unknown)     @           0x938613  (unknown)     @           0x72409c  (unknown)     @           0x71e833  (unknown)     @       0x374dc1ed1d  (unknown)     @           0x71e489  (unknown) 9:52:23.336 AM     INFO     thrift-client.cc:53      Unable to connect to ESLT35020.edc.carrefour.com:24000 9:52:23.336 AM     INFO     thrift-client.cc:59      (Attempt 1 of 10) 9:52:26.337 AM     INFO     status.cc:44      No more data to read.     @           0x74d01d  (unknown)     @           0x937ce8  (unknown)     @           0x938613  (unknown)     @           0x72409c  (unknown)     @           0x71e833  (unknown)     @       0x374dc1ed1d  (unknown)     @           0x71e489  (unknown) 9:52:26.337 AM     INFO     statestore-subscriber.cc:190      statestore registration unsuccessful: No more data to read. 9:52:26.337 AM     ERROR     catalogd-main.cc:72      No more data to read.   --------------------------------------------------------------------------------------   Could you please help me ?   regards,   ... View more

Hi,   Since kerberos is activated, spark history server doesn't start.   9:33:47.771 AM WARN org.apache.hadoop.ipc.Client Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate ailed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] 9:33:47.771 AM WARN org.apache.hadoop.security.UserGroupInformation PriviledgedActionException as:spark (auth:KERBEROS) cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]   All other services are OK.   Someone has already had the same error ?   ... View more