Member since
06-23-2025
4
Posts
0
Kudos Received
0
Solutions
06-30-2025
07:01 AM
How can I ensure NiFi runs the correct Python script for each processor? Is there a proper way to structure and load multiple Python processors in NiFi? Any tip to debug or force NiFi to pick the updated script?
... View more
Labels:
- Labels:
-
Apache NiFi
06-27-2025
12:22 AM
Hi all, I've been working with NiFi and observed an issue with the MergeContent processor. After running several experiments, I noticed that regardless of how many FlowFiles I send in, only the first one that enters the processor is included in the merged output. The rest seem to be ignored. My use case involves merging two FlowFiles and passing them into a custom Python script. However, since only one file is getting through, the processing is incomplete. I’ve verified that the incoming queue has both FlowFiles and that the processor settings appear standard. Has anyone encountered this? Could it be related to Merge Strategy or correlation attribute configuration? Are there specific settings required to ensure multiple FlowFiles are merged? Any guidance or suggestions would be appreciated. Thanks!
... View more
Labels:
- Labels:
-
Apache NiFi
06-25-2025
06:01 AM
I'm using the QueryRecord processor in Apache NiFi to perform a LEFT JOIN between two sets of records within a single FlowFile. The records are distinguished by a field m, where m = 'a' represents one dataset and m = 'b' represents the other. Here is the SQL query I'm using: SELECT * FROM ( SELECT * FROM FLOWFILE WHERE m = 'a' ) file1 LEFT JOIN ( SELECT * FROM FLOWFILE WHERE m = 'b' ) file2 ON file1.ID = file2.rapid_id However, the result only includes records from the m = 'a' side. When I switch the inner queries (i.e., use m = 'b' as the left side), I only get records from that side instead. It seems the LEFT JOIN is not functioning as expected — it behaves more like an INNER JOIN. Has anyone encountered this behavior with QueryRecord? Is there a limitation in how it handles subqueries or joins within a single FlowFile? Any guidance or workaround would be appreciated. Thanks in advance!
... View more
06-23-2025
10:02 AM
https://medium.com/@surajnagendra/merge-csv-files-apache-nifi-21ba44e1b719 I tried this approach but it didn't worked well
... View more
Labels:
- Labels:
-
Apache NiFi