Hi, I have two NIFI instance running and i am sending data. Both the nodes receives the data in random order.   when i kill one of NIFI instances(first instance), all the data is processed by other NIFI instance(Second instance). And again when i bring back the other NIFI instance which was killed , the data is distributed among them in random order.   Here there is no data loss observed, but we are observing some log messages are missing in the nifi-app.log as part of this restart. For example, during this testing if i have sent 100 messages, i see only log messages for 97 messages.   Is this expected in NIFI or is there a way we can fix this issue? Is it related to gracefully shutting down the NIFI?   Any help would be appreciated.   Thanks ... View more

Hi, I am using NIFI to consume and publish data using kafka.   I have some queries on offset commit to ensure there is no data loss.   Currently as per NIFI logs, the consumerconfig shows that "enable.auto.commit= false", this means that the offset are committed manually. Internal are these commits happening synchronously or asynchronously in NIFI? how to check this?   And also in offset we have two types in kafka   1. current offset (Sent records)- This is used to avoid resending same records again to the same          consumer 2. committed offset (processed records) - It is used to avoid resending same records to a new consumer in the event of partition rebalance.   Regarding committed offset, This is kind of a indication sent back to kafka broker by consumer stating  that the messages are consumed successfully? is my understanding right?   Any help would be appreciated.   ... View more

Hi, I am observing that kafka publish is failing in NIFI when i send one success and failure data alternatively.   The scenario we are testing is, i am sending one success data and other one failure data. when i say failure data, i have removed the permission for the topic so that publish fails.   for success data , topic is - svc_123 for failure data , topic is - svc_456   i removed publish permission for topic "svc_456" so that publish fails and goes to retry flow. i am sending data alternatively for  topic "svc_123" and "svc_456".    In this scenario, i see that even for topic "svc_123" the publish is failing. Not sure why the publish is failing for topic "svc_123" even though all permissions are given.   And this scenario is seen when we send one success and one failure data as i have explained above.   From NIFI logs no much info on why publish fails for "svc_123".   To add on, when i send 3 messages for svc_123 followed by 3 messages for svc_456 , its working as expected, the issue is seen when data is sent alternatively   Any help would be appreciated   Thanks           ... View more

Currently i am observing that there is size limit on the maximum characters on "log prefix" property in logAttribute nifi processor.   is there a way i can increase the log prefix size? ... View more