Hi, I think something is happening when nifi is trying to interpret the correct data type in python. to make it work make the current_date string as follows: current_date= str(datetime.today().date()) and let the python engine do the conversion to the correct datetime type when you set the date_filter as follows: date_filter = str(datetime.strptime(current_date,'%Y-%m-%d').replace(day =11))   Not sure if this is a bug in Nifi, but at least this should be a work around. Hope that helps.                 ... View more

Hi, Not sure if this is a bug or what. I have tried the same flow with version 1.16 and got the same behavior. As an alternative I would suggest to use ControlRate Processor where you can set the properties as follows: Rate Control Criteria: flowfile count Maximum Rate : Set to the maximum value that you can have in the queue before nifi applies back pressure. Default value for one node is 10K. Time Duration: 24 hours.   Hope that helps.   ... View more

In this case I would suggest you write custom code through ExecuteScript processor to see if you can retrieve such error message. Not sure what else you can do. sorry ... View more

Hi, Since you are looking for the DB auto generated ID for the City , your best option is to use the LookupRecord Processor , so the flow if your datapipeline will look something like this:   GetFile Processor (To the content of the CSV) SplitRecord ( to split Records in the CSV) [Insert the City Info to the DB First] LookupRecord ( to get the ID of the City and enrich you CSV with ID. The Lookup Service should be DB Lookup Service that points to the City Table and Use City Name as Key) [Finally Insert the Person Information with City ID added to the original csv record]   To Learn more about LookupRecord, you can watch this video: https://www.youtube.com/watch?v=bSJ5reO8AA4     To learn more about the L ... View more

Hi, After some research I found in order to avoid getting the 403 error, you need to provide the User-Agent to the header as explained by the FAQ under the same domain (scroll below until you find 403 error): https://weather-gov.github.io/api/general-faqs To solve your problem you need to set the UserAgent Property on the invokeHttp processor. It can be something like: nifi/version 1.16.0 Hope that helps, if it does please accept solution. Thanks ... View more