Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Is there a NiFi processor for mainframe VSAM ingest?

avatar
Guru

Is there a processor to ingest a mainframe VSAM file? If not, is anyone aware of work in progress for this?

1 ACCEPTED SOLUTION

avatar

@gkeys, in short no. There's nothing out of the box for integrated mainframe offload/ingest. That said there are several options that people have been pursuing for mainframe data movement using Apache NiFi (I've seen/talked to people doing all of these):

  • Text flat file export with List/FetchSFTP and SplitText
  • Binary flat file export with custom processors for record processing (e.g., using JRecord or 100% homegrown code)
  • 3rd party mainframe offload/ETL tools like Syncsort

While dumping the data out in other formats or writing a custom processor works well, in scenarios with large numbers of record formats this doesn't scale in terms of processor or data flow development. That's when you should turn to products whose sole purpose is handling mainframe data.

View solution in original post

2 REPLIES 2

avatar

@gkeys, in short no. There's nothing out of the box for integrated mainframe offload/ingest. That said there are several options that people have been pursuing for mainframe data movement using Apache NiFi (I've seen/talked to people doing all of these):

  • Text flat file export with List/FetchSFTP and SplitText
  • Binary flat file export with custom processors for record processing (e.g., using JRecord or 100% homegrown code)
  • 3rd party mainframe offload/ETL tools like Syncsort

While dumping the data out in other formats or writing a custom processor works well, in scenarios with large numbers of record formats this doesn't scale in terms of processor or data flow development. That's when you should turn to products whose sole purpose is handling mainframe data.

avatar
Contributor

SYNCSORT Ironstream is the best option in this case.