Hi @yanseoi , what you are encountering is the same issue discussed in flink community: https://lists.apache.org/thread/07d46txb6vttw7c8oyr6z4n676vgqh28 it is due to : https://issues.apache.org/jira/browse/FLINK-29978 https://issues.apache.org/jira/browse/FLINK-29977 And fixed with a kafka client version upgrade in: https://issues.apache.org/jira/browse/FLINK-31599 the same change should have been included in CSA 1.12.0, please try: https://docs.cloudera.com/csa/1.12.0/installation/topics/csa-upgrade-artifacts.html ... View more

Officially, CDP 7.1.7 ( GA, SP1, SP2) supports CDS 3.2 (Apache spark 3.2.3 based) : https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/cds-3/topics/spark-3-requirements.html - CDP 7.1.8 supports CDS 3.3 (apache spark 3.3.0 based) https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/cds-3/topics/spark-3-requirements.html - CDP 7.1.9 supports CDS 3.3 (apache spark 3.3.2 based) https://docs.cloudera.com/cdp-private-cloud-base/7.1.9/cds-3/topics/spark-3-requirements.html There's basically a 1:1 mapping between CDS spark3 version support with a CDP 7.1.{7,8,9} version. ... View more

Hi There's similar feature in CDP as the time based scheduling rules in CDH, called "Dynamic Queue Scheduling". But it is Tech Preview in CDP 717 and GA in CDP 718, please refer to below docs: https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/yarn-allocate-resources/topics/yarn-dynamic-queue-scheduling.html   https://docs.cloudera.com/cdp-private-cloud-base/7.1.8/yarn-allocate-resources/topics/yarn-dynamic-queue-scheduling.html   Hope this helps. ... View more

You may can achive the goal with YARN node label feature. See the detailed explaination on the following Hortonworks post:   https://community.hortonworks.com/articles/72450/node-labels-configuration-on-yarn.html   Current Cloudera CDH distribution does not officially support Node Label, we are working on release a uniform version of CDH + HDP. We will have a new Cloudera Data Platform (CDP) release later this year. If you are our subscruption customer, please feel free to contact cloudera support to enqury the state of this feature, also the state of the new CDP release.   Thanks. ... View more

You can use the Spark Action in Oozie to submit any spark applications: https://archive.cloudera.com/cdh5/cdh/5/oozie/DG_SparkActionExtension.html#Spark_Action   If you are more familar with spark-submit tool,  you can try to use oozie shell action as well: https://archive.cloudera.com/cdh5/cdh/5/oozie/DG_ShellActionExtension.html   You may need to make sure the spark gateway role is deployed on the oozie server and node manager nodes, so that the runtime env always have the depencies available. ... View more