Hi, i want to use the volatile content repository but I´m always facing IO out of memory exceptions, even though i have enough free memory on the system. Specs: - System 16GB RAM - JVM heap max 4GB I have tried to get rid of that by changing the nifi.volatile.content.repository.max.size value to another (100MB, 500MB, 1G, 2G, 3G) but this also doesn´t have any effect. The only thing that changes is that the error occurs later if the max.size is higher. My opinion was that the GC should automatically clean up processed flow files latest when the max.size is reached? Does anybody have an idea? Thank you ... View more

Hi Alvin, As stated above, I cannot indicate prioritization or scheduling of feature delivery. I am eager to develop this feature, as I am sure many users would like it to be available as well. You can always monitor activity on the Apache NiFi Jira and the mailing lists. ... View more

Thank you @anarasimham You made a good point on "turn off the first processor in the flow before turning off the whole flow" ... View more

Awesome! Thanks. ... View more

Kubernetes(K8s) is a tool to deploy and manage Docker containers. I'd like to manage NiFi docker containers in Kubernetes cluster. I will create another topic for this. Thanks. ... View more

I see. Thanks. ... View more

This was answered in another question, but posting here for redundancy... In Apache NiFi 1.3.0 this is not possible, you are publishing regular Avro with an embedded schema, and then trying to consume Avro that is expected to be in Confluent schema format. In the master branch of Apache NiFi there is integration with Confluent schema registry, and also a new option in the "Schema Write Strategy" on the AvroRecordSetWriter - "Confluent Schema Registry Reference". When using PublishKafkaRecord_0_10 with an AvroRecordSetWriter that is configured with "Confluent Schema Registry Reference" you should be publishing Avro that can then be deserialized using the Confluent deserializer. ... View more

How would I use this with a literal letter in my timestamp format? My timestamp format looks like this: yyyy-mm-dd'T'HH:mm:ss.SSS ... View more

What you described is exactly what I need. PublishKafka processor doesn't support Schema Registry. That's why I don't use it. Otherwise, it looks good to me. Thanks. ... View more

@Alvin Jin Also, I know you already implemented a custom service, but there is also some work here by one of the Apache NiFi committers: https://github.com/apache/nifi/pull/1938 ... View more