Hello @dk_srini ,   it is a great question! Have you seen this section of the Cloudera Doc about Redaction of Sensitive Information from Diagnostic Bundles, please?   If it covers your enquiry, please mark this answer as a solution. Best regards: Ferenc ... View more

Hi @Sriparna , thank you for reaching out to Cloudera Community. I understand that you would like to consume from Kafka topic to Hive table using Structured Streaming and you run into some issues.   I've found a Community Article that looks related. Have you seen this?   Please note, if you consider using Continuous Processing, it is not supported as it is still in an experimental state.   Hope these pointers take you closer to a solution! Best regards: Ferenc ... View more

Hello @Tomek ,   the exception is coming from Podium Data. Please reach out to Qlik Support, as based on the stack trace, the issue occurs in the Podium Data code, hence we do not have access to its sourcecode.   Kind regards: Ferenc ... View more

Hello @someguy ,   Thank you for raising the question of how to set up a limit and configure alerts on CDP Public Cloud Usage spending.   Because of the nature of how billing and metering work, best of my knowledge it is not possible. Please read the "Cloud Usage Pricing and Billing Terms" and the "Cloudera Data Platform (CDP) Public Cloud service rates", so you can calculate an estimate on the spending in advance.   Hope it helps! Best regards: Ferenc   ... View more

Hello @michael_boulter ,   the issue you hit looks like YARN-10295. It occurs when the CapacityScheduler Asynchronous scheduling is enabled.   The workaround for this issue is to set yarn.scheduler.capacity.schedule-asynchronously.enable to false in YARN's advanced scheduler configurations.   Hope it helps!   Kind regards: Ferenc ... View more

Hi @apedroso ,   thank you for starting this thread.   In this reply, I will focus on how the YARN RM stores data about historical applications, which can be accessed via the RM Web UI.   The RM keeps data about the applications in its state store [1]. It can be LeveldbRMStateStore, FileSystemRMStateStore or ZKRMStateStore.   We recommend using ZKRMStateStore (this is what we use in YARN HA as well), because it is a more robust implementation. For example, you can migrate in RM HA standby RM while the active RM is still running and keep the state-store intact.   Because the RM Web UI is reading the data from the state-store, it is independent of the presence or lack of YARN Application Logs.   What are your exact migration steps? Do I understand correctly that you upgrade your cluster to CDP or do you need to move services to a new cluster, please?   [1] Please read section for "yarn.resourcemanager.store.class" in https://hadoop.apache.org/docs/r3.1.2/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html ... View more