@Shu Thank you so much for your answer and for taking time to prepare an environment to test my PoC. I really appreciate that. My problem was that I was trying to read the Json with "JsonPathReader" service. Changing to "JsonTreeReader" made the trick. Anyway, I went forward with the PoC and now I'm sending the converted Avro data to a Kafka cluster and I'm trying to deserialize it after consuming. For all this, I'm using the Hortonworks schema-registry which works fine in Nifi but I can't get it to work in Java. I've tryied the example here but I'm getting an error at the time of declaring the deserializedObject. Here you can see the code: public void runAvroSerDesApis(byte[] serializedData, String name) throws IOException { this.serializedData = serializedData; this.name = name; //using builtin avro serializer/deserializer /*AvroSnapshotSerializer avroSnapshotSerializer = new AvroSnapshotSerializer(); avroSnapshotSerializer.init(config);*/ AvroSnapshotDeserializer deserializer = schemaRegistryClient.getDefaultDeserializer(AvroSchemaProvider.TYPE); deserializer.init(config); Object deviceObject = createGenericRecordForDevice(name); SchemaMetadata schemaMetadata = createSchemaMetadata("avro-serializer-schema-" + System.currentTimeMillis()); //byte[] serializedData = avroSnapshotSerializer.serialize(deviceObject, schemaMetadata); Object deserializedObj = deserializer.deserialize(new ByteArrayInputStream(serializedData), schemaMetadata, null); LOG.info("Serialized and deserialized objects are equal: [{}] ", deviceObject.equals(deserializedObj)); } The line retrieving the error is "Object deserializedObj = deserializer.deserialize(new ByteArrayInputStream(serializedData), schemaMetadata, null);" and it says more or less that "actual and format argument lists differ in lenght" Is there any example someone could provide about how to deserialize an Avro message in Java using Hortonworks Schema-Registry? I'm using v0.2.1. Thanks in advance. ... View more

Hi @Matt Clarke, Thank you. So, how about cleaning this cache eventually? Is it possible to clean it whenever a duplicate is found? I'm trying with the Eviction Strategy Property but no getting anything so far... I would like to clean the cache whenever a duplicate is found. Thanks! ... View more

So, I've accomplished the comparisson of two flowfiles. Trying to complicate this a bit more, what about if I have more than two flowfiles to compare? Is there any processor for this? Other option would be to "play" with the DetectDuplicate and create different levels of comparisson... but I don't like it so much thus the DetectDuplicate itself is very clean. Any idea @Matt Clarke, @Rob ? Thanks! ... View more

Hi @Matt Clarke, That processor made the trick. It's exactly what I was looking for. Thank you so much. Best, Jon ... View more

Yes, I've tried to use RouteOnAttribute but the thing is that I want to compare two different flowfiles attributes... and as far as I understand, RouteOnAttribute doesn't allow this kind of comparison... tell me if I'm wrong! ... View more

Hi @Matt Clarke, I just want to compare some attributes from both flowfiles... I'll try with that processor and I'll be back! ... View more

Hi, New question added here: https://community.hortonworks.com/questions/135939/compare-attributes-of-different-flowfiles.html Hope you can help me. Jon ... View more

Hello, Is it possible to compare the attributes of two different flowfiles and only pass one if the comparisson results matched? Thank you, Jon ... View more