I have a custom CSD with a gateway service role that runs a control script command at deploy client config.   when the control script fails (script returns non-zero), the UI reports failure but the command seems to be retried infinitely (did a ps auxf on any host that has the gateway role).  Furthermore, i cannot investigate the logs in the ccdeploy directory since the directory is constantly wiped.    Are these retries intended or can i signal no retry with a specific exit code?   thanks ... View more

Hi,   after upgrading Cloudera Manager from 5.5 to 5.7 our custom role failed to start due to the following error: Role failed to start due to error java.lang.IllegalStateException: The archive already contains log4j.properties. here is a log message in the cloudera-scm-server log:   2016-05-06 10:41:42,024 INFO CommandPusher:com.cloudera.cmf.service.GenericBring UpRoleCommand: BringUp command (2866) has finished on service test for role 55/test-MASTER-1d1313da90923719ced954c04b73e153, with status FAI LURE and message MessageWithArgs{messageId=message.command.role.bringUp.failedTo Start, args=[java.lang.IllegalStateException: The archive already contains log4j .properties]} 2016-05-06 10:41   I have a second role that starts correctly. The above role uses the following logging instruction: "logging" : { "dir" : "/var/log/test", "filename" : "all.log", "modifiable" : true, "configName" : "log.dir", "loggingType" : "log4j" }, thanks,   ... View more

The Spark guide mentions that CDH Spark lacks some features such as Spark SQL for Pyspark and the new spark.ml API. Where can i find more information on the changes that Cloudera made to Apache Spark for CDH 5.6? What is the base version of Spark being used (CDH 5.5.2 uses Spark 1.5.0 afaik).   thanks,   Peter ... View more