Member since
05-30-2025
4
Posts
0
Kudos Received
0
Solutions
06-05-2025
12:18 PM
I need to copy a MS SQL table with about 9 million records to a Clickhouse database. I did setup a QueryDatabaseTable processor to pull the table from the SQL database and a PutDatabaseRecord processor to push the records to Clickhouse db. As long as the flowfile from the QueryDatabaseTable processor has less records than the setting of Batch Size in the PutDatabaseRecord everything works fine. But when I have more records the PutDatabaseRecord creates multiple batches. When I pull 30.000 records from my source table and the Batch Size is set to 10.000 I end up with 60.000 records in the destination. Taking a look at the debug information from the PutDatabaseRecord it shows 1 insert and 3 insert batches. When I pull all 9.5 million records I end up with 650 million records in the destination. Any idea ?
... View more
Labels:
- Labels:
-
Apache NiFi
06-01-2025
01:10 PM
When I create a new Windows Forms App project in c# a file called Resources.resx is added automatically to the project properties. I added an image to this file. But how do I access this resource ? It doesn't seem to be included in the publish solution. What do I need to do to have the resources in my application and how can I access the image in this file ?
... View more
Labels:
- Labels:
-
Training
05-31-2025
03:04 AM
This indeed fixed the issue. Thanks a lot !
... View more
05-30-2025
11:05 AM
I want to filter rows of a CSV file based on a regular expression, but so far I didn't get any row as a match. CSV: F;0;00003;;;SA;30012025;012025;;0456;3790;4940;0;0;150.00;"- Sachbezug (sonstiger)";;;EUR F;0;00003;;;SA;30012025;012025;;0461;3790;4949;0;0;50.00;"- Abzug Gutschein stfr.";;;EUR G;0;00003;;;SA;30012025;012025;;0486;3790;3725;0;0;970.00;"- sonstiger Abzug";;;EUR G;0;00003;;;SA;30012025;012025;;0487;3790;6301;0;0;50.00;"- Abzug Arbeitskleidung";;;EUR F;0;00003;;;SA;30012025;012025;;1160;3790;6010;0;0;-25.91;"Ausgl. Zuschl.b.Krankheit";;;EUR F;0;00003;;;SA;30012025;012025;;1161;3790;6010;0;0;-63.36;"Ausgl. Zuschl. Feiertag";;;EUR Nifi-Workflow: Because I don't have any permission to upload images I need to describe what the workflow looks like - sorry. I have a GetFile processor to read the CSV file. This processor is connected directly with the 'RouteText' processor. This processor is connected via the 'unmatches' output to a disabled 'Wait' processor. An output called 'MatchedG' has been created as another property of the 'RouteText' processor. This output is connected to another disabled 'Wait' processor. I use the disabled 'Wait' processors and to get the queues between the nodes. The 'MatchedG' property has been created with the RegEx '^(G;)'. The Matching Strategy has been set to 'Matches Regular Expression. All other settings are default. I expect the two lines with the G in the first column to get routed to the 'MatchedG' output and the others to the 'unmatch' output. Unfortunately no record matches my regular expression. Any idea what could be the issue here ?
... View more
Labels:
- Labels:
-
Apache NiFi