If you are using Nifi 1.16 or higher I would also refer you  to the ForEnrichment & JoinEnrichment processors that can help you with what you are trying to do. I think you can use those processor regardless if you read the lookup dataset  directly from HTTP or after you loaded into the DistributedMapCache: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.12.1/org.apache.nifi.processors.standard.JoinEnrichment/additionalDetails.html Hope that helps. ... View more

Hi,   There are multiple ways you can resolve this issue without having to do all processors you mentioned above. Some options: 1- QueryRecord 2- UpdateRecord 3- JsonJoltTransformation. If you elect to use QueryRecord which is what is been suggested for such anti-pattern , then you can create new dynamic property on the QueryRecord to represent the new relationship which will have the result of the select statement with new Key field as follows : The select query syntax for the "AddKeyRel": select *,airport||'/'||runway as key from FlowFile The || symbol is used for concatenation in such query and processor.   The JsonTreeReader and the JsonRecordSetWriter are configured as follows:     If the helps please accept solution. Thanks       ... View more

Hi , I think the right  syntax will be : ${field.value:raplace('a', 'i'):replace('e', 'u'):replace(...)} Hope that helps. Thanks ... View more

Hi, I was able to obtain the required result using the following processor:   1- SplitText : this is to help you split each json record into its own flowfile 2- UpdateRecord: This is used to update the dates fields and convert to the required format using Json Record Reader\Writer:   The value used to convert the time for each field : ${field.value:toDate("yyyy-MM-dd'T'HH:mm:ss.SSS'Z'"):format("yyyy-MM-dd HH:mm:ss.SSS")}   More info on UpdateRecord: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-standard-nar/1.7.1/org.apache.nifi.processors.standard.UpdateRecord/additionalDetails.html   Note: The only problem I noticed is that null values will be converted to "" . Not sure if that will cause you a problem but you can use replace text or json jolt to convert the values back to null. If you need the records to be merged back together before inserting into Hive, you can use MergeRecord processor.   If that helps please accept solution. Thanks             ... View more