Hi @DigitalPlumber  - Yes it is Public Cloud. I use NiPyAPI on HDF where I was able to add any variable etc using that library.    In CDP, I want to get the current processor ID. It can be via expression language or by API. How can I achieve that? For example, I want to fetch all the PutS3 processors ID then how can I get that?    ... View more

I have also tested the same with Apache Nifi 1.15.3 (open-source/community) and it works. It did not work though when testing with Apache Nifi 1.13.2 (open-source/community) it still fails with the same error message. ... View more

This sounds a Spring boot specific issue, a quick googling was leading me to  https://stackoverflow.com/questions/42073194/unable-to-detect-database-type please check if the suggestions in that discussion helps. ... View more

Thanks for the advise. I will try that ... View more

Hi @gizelly    Have you tried above solution and its worked? If yes, please accept as Solution. It will useful to other members. ... View more

How frequently is this occurring? It is worth checking network drops or you might consider increasing the timeouts on both sides ie. Resource Manager and Zookeeper. ... View more

@wffger2 @cotopaul  The InstanceIdentifier was introduced when NiFi switched from using the flow.xml.gz to the flow.josn.gz for flow persistence.  It is also currently being written to the flows stored in the NiFi-Registry.  I say "currently" because this jira exist and is still open: https://issues.apache.org/jira/browse/NIFI-11321 So as @cotopaul points out, the "instanceIdentifier" will be unique for each instantiation of the flow definition, but the "identifier" will be the same.  Downside here is every time you want to do a comparison, you'll need to download latest flow definition from DEV and UAT environments and compare for difference based on the Identifiers. Thanks, Matt ... View more

Hi @Albap    Based on the logs, i can see you have created streaming application. By default streaming application will run 24*7, it will stop only when we kill or some interrupted event happen at the system level.    Better way to kill/shutdown the spark streaming applications is by using graceful shutdown.   If you need further help, please raise an cloudera case we will work on.    ... View more

I assume you meant NVL function returns 0 or 1 if a null is found, or the specified expression in the argument - when using Hive. With Impala and NVL2 you would still need to have the outer query to "sum" up all the 1 values what we have mapped from the column value (from their real value to 0 or to 1). It would just be a bit nicer, but no real change. ... View more

Closing the connection while the query is still executing is generally not good practice. Think of it as taking ownership for the query you've executed, sort of like turning the lights off before you leave a room. If you're going to close the session (leave the room), you need to first cancel the query that's consuming resources (turn off the lights you turned on). The normal expectation is that an executing query will have an associated active session. ... View more