I am trying to read a json field from mySQL using executeSQLRecord and insert into snowflake VARIANT field type using PutDataBaseRecord in NiFi 2.6.0. its giving me this error " 03:20:05 UTC ERROR 1695731e-9b6f-3cb8-5a9a-98ab38589597 PutDatabaseRecord[id=1695731e-9b6f-3cb8-5a9a-98ab38589597] Failed to put Records to database for FlowFile[filename=c6087904-71a5-479c-9301-2c99883f5f59]. Routing to failure.: net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error: Expression type does not match column data type, expecting VARIANT but got VARCHAR(2) for column JSON_STORE " how do I fix this?  ... View more

Hi,   I am connecting to ADLS from NiFi using PutAzureDataLakeStorage 1.21.0   How do I create a directory using this processor? The document says a directory will be created if it dont exist. https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-azure-nar/1.12.0/org.apache.nifi.processors.azure.storage.PutAzureDataLakeStorage/index.html   But my processor is not creating the directory but its failing with error. I am providing the directory as "devfolder" "PutAzureDataLakeStorage PutAzureDataLakeStorage[id=ac451284-0924-383a-9840-06131cd20808] Failed to create file on Azure Data Lake Storage reactor.core.Exceptions$ReactiveException: io.netty.channel.ConnectTimeoutException: connection timed out:"   do I have to do something special to create directories.   Also, if I set the directory to empty string the file gets created in the root of my ADLS container.   Regards.   ... View more

Hi ,   we are consuming and publishing from MQ. Consumer is fast enough, the publisher is slow and it’s builds a lot of back pressure.   we have a 4 node 20 core each * 4 total 80 cores. memory 16GB each 64GB total.   publish is running at 200 concurrency. I did system diagnostics cores and memory are free, then what is causing the slow publish and build back pressure.   I wanted to try and increase run duration to increase the throughput but this processor don’t seem to have the option to modify run duration.   what other option there to increase throughput.   let me know if you need more information .   Regards ... View more

Hi Team,   We have a 4 node cluster with 64 cores. but when we do system diagnostics we see only average usage of 5 cores.  also the data is queuing up and processing slowly.   regards, samyan ... View more