Hello,   I am trying to install Spark 2.3.0 release 4, but after placing csd (jar file) to /opt/cloudera/csd i cannot add it from service.  I checked on this url http:xyz:7180/cmf/csd/refreshand got the following error:   placeholderHandlers":[],"invalidCsds":{"/opt/cloudera/csd/SPARK2_ON_YARN-2.3.0.cloudera4.jar":["Failed to load CSD from /opt/cloudera/csd/SPARK2_ON_YARN-2.3.0.cloudera4.jar, Error: CSD bundle data directory or Jar file doesn't exist"]},"repoEnabled":true}} I followed these steps: a. Download the spark 2.3.0 jar  b. Upload the CSD to /opt/cloudera/csd in the Cloudera Manager server. c. Change the owner and group for the JAR d. restart cloudera scm server and management service   Can anyone help ? I have CDH release 5.16.1-1.cdh5.16.1.p0.3 ... View more

Hello everyone,   I am running into an issue, the dfs/dn is consuming all the disk space in a distributed cluster. My cluster has four nodes with each of 100HDD disk space. Apparently on Cloudera manager the consumed space is 200 GBs but when i check on HDFS only 50 gbs is consumed. Can any one help me cleaning up the directories ? or if cleaning is not an option how do you compress it without the need to scale up ?   Thanks ... View more