About anton123

anton123 · ‎03-16-2023

My question is more about How to write SQL query to filter it out? My current query: SELECT * FROM FLOWFILE WHERE Customer_AccountID = ${value}

anton123 · ‎03-16-2023

I'm trying to using NIFI dynamically filter flow Files in JSON format and keep only those values that are present is one SQL table. I'm using QueryRecord processor, with query like: SELECT * FROM FLOWFILE WHERE ${key} = ${value} only those values that are present in QueryDatabaseTable variables should be kept. Flow Files to be filtered looks like these: [ { "CustomerID" : 1, "OrderNbr" : "12", "Amount":100 } ] CustomerID field is the one to check and filter data. My current NIFI flow: anton123_0-1678958327810.png

anton123 · ‎12-20-2022

Hi Matt, My flow is basically reading big file and loading it into a SQL DB. I'm simply looking to wait until insert statement is fully completed and after that move to some other task. My current flow ( doesn't work as expected right now): anton123_0-1671531005572.png Convert SQL processor: anton123_1-1671531034160.png Execute SQL processor: anton123_2-1671531061189.png Wait processor: anton123_3-1671531081230.png My question is how to properly configure wait processor to fill success queue only once full insert statement is done? Full flow: anton123_0-1671531587818.png

anton123 · ‎12-19-2022

I wanted to wait until 'ExecuteSQL' processor finishes inserting big file into SQL database (table: bu_service_template), then move to other section. 'ExecuteSQL' processor inserts row by row content of a file. I wanted to wait until file is fully inserted and then move to a next file. My current flow: wait nifi3.PNG nifi2.PNG flow

Online	Offline
Last Visited	‎03-24-2023 04:36 AM

Member Since	‎10-07-2022 05:55 AM
Last Visited	‎03-24-2023 04:36 AM
Posts	8

Cloudera Community

Re: Dynamically filter flowFiles based on data fro...

Dynamically filter flowFiles based on data from ta...

Re: Apache NIFI - How to wait for SQL Insert full ...

Apache NIFI - How to wait for SQL Insert full comp...