I actually ran into this same issue when integrating Hitachi HCP with Cloudera 5.12. It was super frustrating at first, but I finally got it working while I was studying for some cloud certifications and practicing with sample questions. Here's what worked for me: The problem you're seeing (PKIX path building failed) is related to SSL certificate validation. HCP’s certificate might not be recognized by your Java truststore, so Java blocks the connection. Here’s what I did to fix it: Download the SSL certificate from your HCP endpoint. Import that certificate into your Java truststore using the keytool command: sudo keytool -import -alias hcp-cert -keystore $JAVA_HOME/jre/lib/security/cacerts -file /path/to/hcp-cert.pem 3. Restart the Cloudera services after the import. Also, in case you're just trying things out, you could disable SSL validation temporarily (not for production though) by adding this parameter: -Dfs.s3a.connection.ssl.enabled=false Honestly, working through similar practice scenarios on Study4Exam really helped me get a grip on these types of configurations. They have questions that dive deep into AWS, S3, and related security settings. Hope that helps! ... View more

@Venkatesh12, Welcome to the Cloudera Community! As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

@StefanSs As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks. ... View more

I run into same issue after deploying cdp 7.1.7. Is there workaround for this issue ?   ... View more

1) Remember all data nodes should be healthy to perform this activity, if any disk failure is there, it will throw error like this; ERROR tools.DiskBalancerCLI: java.lang.IllegalArgumentException 2) ERROR tools.DiskBalancerCLI: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.diskbalancer.DiskBalancerException): Disk Balancer is not enabled. add property in HDFS configuration >> dfs.disk.balancer.enabled << under HDFS Service Advanced Configuration Snippet (Safety Valve) for hdfs-site.xml, value = true 3) ERROR tools.DiskBalancerCLI: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied. login through datanode keytab; cd /var/run/cloudera-scm-agent/process && find . -type f -iname "hdfs.keytab" kinit -k -t ./52821-hdfs-DATANODE/hdfs.keytab -p hdfs/hostname@SOME_REALM.COM ... View more

Hello @xgxshtc    We observed you have posted the concerned ask in a New Post [1] as the concerned Post is ~4Years Old. While the Current Post is Unresolved, We shall wait on your Team's review on [1] before confirming the Solution on the Current Post as well.   Regards, Smarak   [1] https://community.cloudera.com/t5/Support-Questions/Hbase-regionserver-shutdown-after-few-hours/m-p/330070/highlight/false#M230589   ... View more

it worked for me ... View more

Yarn resourcemanager keeps writing status of each running/finished application in the statestore. Statestore usually are managed in either zookeeper or in localFS based on our configurations.    When the RM turns from standby to active it looks for the latest commits made by the other RM and loads them. If this information is lost at any given point, RM will fail to load the application information. ... View more

Yes, you can download the hdfs client configuration from Cloudera Manager, but this is not possible always, when you are working on different department or any bureaucratic issue... And if you make any change HDFS configuration, you must download this configuration again. Is not a scalable solution in a big environments, the best solution is working on the same cluster (gateway if is possible), but if you have an external Flume Agents, there no exist a properly and scalable solution I think. ... View more

that output comes after the reduce function not map ... View more