Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is there a NiFi processor for mainframe VSAM ingest?

SOLVED Go to solution
Highlighted

Is there a NiFi processor for mainframe VSAM ingest?

Guru

Is there a processor to ingest a mainframe VSAM file? If not, is anyone aware of work in progress for this?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Is there a NiFi processor for mainframe VSAM ingest?

@gkeys, in short no. There's nothing out of the box for integrated mainframe offload/ingest. That said there are several options that people have been pursuing for mainframe data movement using Apache NiFi (I've seen/talked to people doing all of these):

  • Text flat file export with List/FetchSFTP and SplitText
  • Binary flat file export with custom processors for record processing (e.g., using JRecord or 100% homegrown code)
  • 3rd party mainframe offload/ETL tools like Syncsort

While dumping the data out in other formats or writing a custom processor works well, in scenarios with large numbers of record formats this doesn't scale in terms of processor or data flow development. That's when you should turn to products whose sole purpose is handling mainframe data.

2 REPLIES 2

Re: Is there a NiFi processor for mainframe VSAM ingest?

@gkeys, in short no. There's nothing out of the box for integrated mainframe offload/ingest. That said there are several options that people have been pursuing for mainframe data movement using Apache NiFi (I've seen/talked to people doing all of these):

  • Text flat file export with List/FetchSFTP and SplitText
  • Binary flat file export with custom processors for record processing (e.g., using JRecord or 100% homegrown code)
  • 3rd party mainframe offload/ETL tools like Syncsort

While dumping the data out in other formats or writing a custom processor works well, in scenarios with large numbers of record formats this doesn't scale in terms of processor or data flow development. That's when you should turn to products whose sole purpose is handling mainframe data.

Re: Is there a NiFi processor for mainframe VSAM ingest?

New Contributor

SYNCSORT Ironstream is the best option in this case.