Created 09-18-2017 10:49 AM
Here's how i configured the ExtractHL7Attributes processor,
The attributes after parsing a sample hl7 file seen from data provenance of ExtractHL7Attributes processor,
How can i get these attribute values and process it ?
Do i need to add another processor, use expression language in properties of a processor ?
Created 09-21-2017 09:01 PM
There are many processors you can use to continue your NiFi flow. I mocked up your scenario and was able to use the AttributesToJSON processor to convert all of the data into a JSON format. In that processor, you can optionally specify which columns of data inside the FlowFile you want to keep. This is one such example - you can research and experiment with many of the other processors to do data filtering and processing.
My mock NiFi flow read from a Kafka stream, used the ExtractHL7Attributes processor, converted to JSON using the AttributesToJSON processor, and wrote that data to HDFS. Let me know if I can help you out with any specific part of that chain.
Created 09-22-2017 06:19 AM
@anarasimham Thanks for the great answer.
I've used AttributesToJSON to convert it to JSON format. But i wasn't able to manipulate it to desired structure(when i used JoltTransformJSON). You can view my another question related to that in this link (https://community.hortonworks.com/questions/138833/need-to-format-values-fromin-attributestojson-proc.html?childToView=138061#answer-138061)
In between if you can share the knowledge on how to use a kafka and HDFS in NiFi, it would be really helpful.
Created 09-22-2017 09:37 PM
Sure - I wrote an article since others may want to know this information. You can check it out here:
https://community.hortonworks.com/articles/138249/nifi-in-healthcare-ingesting-hl7-data-in-nifi.html
Let me know if you have any other questions, happy to answer.