https://community.cloudera.com/t5/Archives-of-Support-Questions/We-have-a-requirement-to-process-MVS-EBCEDIC-file-and-add/m-p/212119#M60048 <A rel="user" href="https://community.cloudera.com/users/17724/bhagsiri.html" nodeid="17724">@Bhagyashree Chandrashekhar </A><P>NiFi at its core is aligned with any specific data format. NiFi can ingest data of any format (it is just treated as binary) The data is controlled in NiFi via a NiFi FlowFile. A FlowFile consist of Metadata about the actual content and the content itself. It si this FlowFile metadata that is the unit of transfer between processor components in a NiFi dataflow. </P><P>When it comes to different available processor components, they may care about the content format if their job is to manipulate that content in anyway. I a m not familiar with EBCEDIC data, but form what i have read of EBCEDIC legacy file format is that it can be either EBCEDIC-Binary or EBCEDIC-ASCII. If the format is ASCII, you may be able to use processors like ReplaceText to manipulate the actual content.</P><P>If it is binary, you may need to write your own custom NiFi processor component that would be able to process that data type. Or you might be able to use a one of NiFi's Scripting processors to use an external script to convert the format of these files to ASCII where you would then be able to modify them with existing processors.</P><P>There are no EBCEDIC specific processor in NIFi as of now.</P><P>Thank you,</P><P>Matt</P> Wed, 26 Apr 2017 21:20:25 GMT MattWho 2017-04-26T21:20:25Z https://community.cloudera.com/t5/Archives-of-Support-Questions/We-have-a-requirement-to-process-MVS-EBCEDIC-file-and-add/m-p/212118#M60047 <P>We have a requirement where we need to pick an MVS file from a server and add two new indicator fields. We are using nifi tool to process the data. Is this requirement achievable using nifi tool? If yes, what options are available?</P> Wed, 26 Apr 2017 15:53:53 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/We-have-a-requirement-to-process-MVS-EBCEDIC-file-and-add/m-p/212118#M60047 bhagsiri 2017-04-26T15:53:53Z https://community.cloudera.com/t5/Archives-of-Support-Questions/We-have-a-requirement-to-process-MVS-EBCEDIC-file-and-add/m-p/212119#M60048 <A rel="user" href="https://community.cloudera.com/users/17724/bhagsiri.html" nodeid="17724">@Bhagyashree Chandrashekhar </A><P>NiFi at its core is aligned with any specific data format. NiFi can ingest data of any format (it is just treated as binary) The data is controlled in NiFi via a NiFi FlowFile. A FlowFile consist of Metadata about the actual content and the content itself. It si this FlowFile metadata that is the unit of transfer between processor components in a NiFi dataflow. </P><P>When it comes to different available processor components, they may care about the content format if their job is to manipulate that content in anyway. I a m not familiar with EBCEDIC data, but form what i have read of EBCEDIC legacy file format is that it can be either EBCEDIC-Binary or EBCEDIC-ASCII. If the format is ASCII, you may be able to use processors like ReplaceText to manipulate the actual content.</P><P>If it is binary, you may need to write your own custom NiFi processor component that would be able to process that data type. Or you might be able to use a one of NiFi's Scripting processors to use an external script to convert the format of these files to ASCII where you would then be able to modify them with existing processors.</P><P>There are no EBCEDIC specific processor in NIFi as of now.</P><P>Thank you,</P><P>Matt</P> Wed, 26 Apr 2017 21:20:25 GMT https://community.cloudera.com/t5/Archives-of-Support-Questions/We-have-a-requirement-to-process-MVS-EBCEDIC-file-and-add/m-p/212119#M60048 MattWho 2017-04-26T21:20:25Z