What's New @ Cloudera

Find the latest Cloudera product news
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Data Engineering HA template for Data Hub on AWS delivers end-to-end resiliency

avatar
Cloudera Employee

The Data Engineering HA template has graduated from Preview status to GA on AWS today, with the release of Cloudera Runtime 7.2.9. It now supports fault-tolerant access to all cluster web UIs and end-to-end reliability for more workload types. 

 

The addition of a load balanced, highly available Apache Knox gateway service configured for transparent failover provides this additional resiliency for end users accessing web interfaces of the cluster and for scheduled or ad hoc workloads.  Specifically, Hive workloads submitted to HiveServer2 via the Knox gateway and workloads that access WebHDFS through Knox can seamlessly tolerate instance failures of master nodes running the Knox gateway.  This capability is thanks to the recent addition of an external load balancer to the cluster, and adds to the highly available HDFS, YARN and HiveServer 2 services offered in earlier versions.

 

Future releases of Data Engineering  HA will support highly available Oozie and Cloudera Manager services, ensuring that nearly all workload types can seamlessly tolerate failures of any once instance in the cluster.

 

To learn more, visit the documentation about Data Engineering HA.