We recently upgraded to CDE 1.20.3. After the upgrade we encountered issues related to resource allocation. I suspect that the yunikorn is not properly functionining because jobs are waiting time even if there are available resources to distribute to the spark jobs. Is there a yunikorn UI available from the CDE where we can access to monitor so we can easily monitor the yunikorn pods? ... View more

We are planning to automate our hive schema changes as part of our CI/CD deployment. Currently we are using Gitlab to manage our repo and execute deployment pipeline. One of the tools we're considering is Liquibase. This blog detailed out the way to implement this https://docs.liquibase.com/install/tutorials/impala-hive.html. It explains that in order to use Liquibase with Hive, it needs an impala/hive extensions. This approach seems promising. However I'm concerned that the extension is outdated and may impose security risk in our system since the last update of it was 5 years ago (https://github.com/eselyavka/liquibase-impala).   I was wondering if anyone here have the same use case. What approach/options did you choose to implement the solution? I appreciate any comments or suggestion from this groups.   Thank you! ... View more

Hi Everyone,   I am quite new to CDP platform and I would just like to know if spark jobs running in CDE can possibly connect in Oracle database deployed on-prem in order to extract data? I appreciate any input.    Thanks, Glenn  ... View more