At moment you can not run  stored procedure using ExecuteSQL, however, you can use ExecureScript to do the same with stored procedure wrapped in script with MySQL engine or any other client you can use please refer :  https://community.cloudera.com/t5/Support-Questions/Does-ExecuteSQL-processor-allow-to-execute-stored-procedure/m-p/158922   If you found this response assisted with your issue, please take a moment to login and click on "Accept as Solution" below this post. Thank you     ... View more

ExtractText processor can help you grab needed information from json content and store in the flow file attribute for reuse after InvokeHTTP.    Thank You  ... View more

I suggest you have a technical support case opened with the Cloudera Technical Support team so we can dive further.   Thank You. ... View more

I per MS SQL docs I found this  example String connectionUrl = "jdbc:sqlserver://localhost:1433;" + "databaseName=AdventureWorks;integratedSecurity=true;" + "encrypt=true; trustServerCertificate=false;" + "trustStore=storeName;trustStorePassword=storePassword";  Can you please check ? also the URL which you have used works outside of nifi ? ... View more

How you are passing SSL details in  DBCPConnectionPool used by ConvertJSONToSQL?  in configured JDBC URL? ... View more

Ok, so you got the copy file in NiFi using List/FetchFile then you changed the new directory location where it has to be written using UpdateAttribute then you have used  DuplicateFlowFile to create duplicates, till now what is happening since ListFile is running on Primary node (And it should be running on Primary ) rest all downstream flow will be processed/computed on Primary that why you see DuplicateFlowFile creating duplicated on node which is Primary in NiFi Cluster. I do not see any issue here. If you wish to have flow files on All NiFi nodes redistributed after DuplicateFlowFile then you need to set Load Balancing at queue connection on the connection "Round Robin " between DuplicateFlowFile & PutFile, by doing this duplicates flow files will be distributed among nifi nods in round-robin manner one by one and will be written by PutFile back on each nifi nodes where files got distributed after  DuplicateFlowFile.  Now one question you mention 7 HDFS data nodes, does that means you have  NiFi service running as well on the same 7 data nodes ? and having 7 node nifi cluster? in that case, only all 7 nodes will receive each file copy. I see  ... View more

Please refer answer posted by MattB on UTC time,https://stackoverflow.com/questions/65620632/why-do-executesqlrecord-and-csvrecordsetwriter-updated-the-time-zone-of-datetime.   Thank You.     ... View more

Sorry some confusion here ,so you saying The file is placed by a third party onto an SFTP location on one node?  so the file is on SFTP server at this stage but only on node ? and then you fetch the file into NiFi using List/FetchSFTP processor running on Primary node only ? then ? what is the end goal "we want the file to be available on all nodes so that the receiving team can access it". What do you mean by All nodes is these NiFi nodes or SFTP nodes ?  ... View more

Why do you want to do that ? NiFi cluster is not like HDFS where data will be replicated across nodes NiFi is not a storage system.  What NiFi provides as , let's say you have 3 node cluster and you receive 100 files on one node assuming Processor which one is receiving file running on Primary node,now you want to processor these all 100 files in distributed manner using all 3 nodes , then you need to use Load Balancing at queue connection to distribute 100 file on 3 nodes , 33/33/34 files on each node then rest further downstream processing will be done on all 3 nodes.  Example flow design flow be, ListSFTP (Primary)-->Connection set to LB at queue tion --> FetchSFTP, in this use case ListSFTP will list the file details on Primary node then FetchSFTP will fetch the file from SFTP server on All 3 nodes in a distributed manner.   Thanks    ... View more

Please make sure SSL certificates are created with the following settings https://docs.cloudera.com/cfm/2.1.4/cfm-security/topics/cfm-security-tls-certificate-requirements-recommendations.html ... View more

I believe MergeContent Merging Strategy is set to Defragment ? If it is set to  Defragment then MergeContent will wait to receive all flow file part of fragment.count. so what happened to the remaining 2 flow files? which r elationships they move? failure?  and terminated on Processor itself assuming as per screenshot . If you wish to merge with reamaning 8 then Merging Strategy needs to be changed but that could be lead to case where all 8 records can not be merged together all the time since there is no correlation, or if you just want to merge all records irrespective of failure or success , then you need to have failure or success both relationships configured for MergeContent .   Was your question answered? Please take some time to click on "Accept as Solution" below this post. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

Have you tested ListenFTP without setting SSLContextService? just to make sure supplied username and password is correct?   ... View more

It seems you misunderstood the usage of  UpdateCounter, UpdateCounter is only used for debugging purposes, when you use UpdateCounter in flow then counter option at NiFi--Humburgenr Menu will give you the counter details.. you can not reuse or call these details on any other processor.      ... View more

There are two aspects of your question " How do you configure a PutMongo NiFi Processor  "   1. Connection details:   Connection URL, User Auth, Wire encryption (SSL ) 2. Actual Query: make sure query syntax is correct.   If you can post an error snipped and snap from the processor config to be able to isolate if this query issue or connection issue. Assume if this is with query-related issue , then you can verify if the same query works from the generic mongo db client? if not then same query will not work from nifi:PutMongo as well.    Thank You.       ... View more

NiFi  as a service alone can not autoscale irrespective of the type public/private cloud provided until it is customized and managed by different automation and scaling applications over the public cloud.   But Cloudera offers NiFi as Data flow Expreinace in the public cloud which does support autoscaling Please check https://docs.cloudera.com/dataflow/cloud/release-notes/topics/cdf-whats-new.html for more info.   Thank You. ... View more

also, you mentioned " Processor doesn't read saved attribute" Which specific processor you are complaining about ?  ... View more

trying to understand your flow pipeline with respect to your use case explanations, You have two upstream queued for InvokeHTTP , in one  using  ExtractText you are extracting text , which will be stored in flow file as an attribute then running HTTP Method from InvokeHTTP and configured Attributes to Send for the attributed which is created by ExtractText ?  What GenreateFlowFile os doing in this flow?  what evaluation is configured with EvaluateJsonPath ? Please provide more details   ... View more