Hi,   I have a nifi flow which has 1000's of flow files. Each of the flow file has an impala/hive statement and each of them have different execution times. How do i use control rate processor to trigger next flow file only if the previous flow file has been processed (success/failure of the flow file doesn't matter)? ... View more

Hi,   Is there any processor to add some text/characters to each line in the flowfile in Nifi. Replace text seems to be more complicated given that the partiton value keeps changing.   compute incremental stats mydb.mytable partition (date=2023-07-21); compute incremental stats mydb.mytable partition (name=abc); to compute incremental stats mydb.mytable partition (date='2023-07-21'); compute incremental stats mydb.mytable partition (name='abc');   Note: date=2023-07-21 comes as a complete string from the sys.partitions.part_name table in hive. We will need to add '' to the date. ... View more

I have a flowfiles that contains few impala statements and are executed through ExecuteSQL processor in Nifi. When i the flowfile has one statement, it goes fine but when there are multiple statements, nifi processor errors out with invalid syntax. An example of the flow file with multiple statements is below. Is execute sql the right processor for my requirement?     compute incremental stats raw_db.source_table (ingest_date=2022-12-13); compute incremental stats raw_db.source_table (ingest_date=2023-01-09); compute incremental stats raw_db.source_table (ingest_date=2023-01-10); compute incremental stats raw_db.source_table (ingest_date=2023-01-13); compute incremental stats raw_db.source_table (ingest_date=2023-01-14); compute incremental stats raw_db.source_table (ingest_date=2023-01-18); compute incremental stats raw_db.source_table (ingest_date=2023-01-19); compute incremental stats raw_db.source_table (ingest_date=2023-01-20); compute incremental stats raw_db.source_table (ingest_date=2023-01-22); compute incremental stats raw_db.source_table (ingest_date=2023-01-23); compute incremental stats raw_db.source_table (ingest_date=2023-05-09); compute incremental stats raw_db.source_table (ingest_date=2023-01-11); compute incremental stats raw_db.source_table (ingest_date=2023-01-12); compute incremental stats raw_db.source_table (ingest_date=2023-01-15); compute incremental stats raw_db.source_table (ingest_date=2023-01-16); compute incremental stats raw_db.source_table (ingest_date=2023-01-17); compute incremental stats raw_db.source_table (ingest_date=2023-01-24); compute incremental stats raw_db.source_table (ingest_date=2023-01-25); compute incremental stats raw_db.source_table (ingest_date=2023-01-26); compute incremental stats raw_db.source_table (ingest_date=2023-05-11); compute incremental stats raw_db.source_table (ingest_date=2023-05-12); compute incremental stats raw_db.source_table (ingest_date=2023-05-15); compute incremental stats raw_db.source_table (ingest_date=2023-05-16); ... View more