Member since
07-28-2023
2
Posts
0
Kudos Received
0
Solutions
07-31-2023
12:24 AM
Hi @RangaReddy Thanks for your information about the SHS HA feature in future release. Let me rephrase your answer SHS is not required for a sucessful execution of any spark application. What I am missing now is the information if this states also for Yarn JHS or not?
... View more
07-28-2023
01:09 AM
Hello everyone, we are currently working on automaticlly patching the operating system of our CDP Private Cloud Base cluster. We enabled/configured our cluster to be HA, but for two components (YARN Job History Server and Spark History Server) we couldn't find any solution. We designed our automation to be split over the timespan of three days. Starting at 8 PM each day we update one of the master nodes, one of the edge nodes (e.g. know) and one third of the worker nodes in sequential order. Our problem is how to handle an unexpected failure. Is it possible to wait until the next day or is the availabilty in danger if one server (with the mentioned compontens) isn't booting up etc. How important are the YARN Job History Server and Spark History Server for the successful execution. As far as I understand both are only required for storing/providing logs for executed applications. Do I miss anything here?
... View more