Is there a NiFi processor for mainframe VSAM ingest?

[#1]

Is there a processor to ingest a mainframe VSAM file? If not, is anyone aware of work in progress for this?

[#2 · Accepted solution]

@gkeys, in short no. There's nothing out of the box for integrated mainframe offload/ingest. That said there are several options that people have been pursuing for mainframe data movement using Apache NiFi (I've seen/talked to people doing all of these):

• Text flat file export with List/FetchSFTP and SplitText
• Binary flat file export with custom processors for record processing (e.g., using JRecord or 100% homegrown code)
• 3rd party mainframe offload/ETL tools like Syncsort

While dumping the data out in other formats or writing a custom processor works well, in scenarios with large numbers of record formats this doesn't scale in terms of processor or data flow development. That's when you should turn to products whose sole purpose is handling mainframe data.

[#3]

SYNCSORT Ironstream is the best option in this case.