- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How to delete a row/drop a column in nifi
- Labels:
-
Apache NiFi
Created ‎11-14-2016 06:57 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am new to Apache Nifi and trying to evaluate the tool according to the business requirement, and stuck with few scenarios.
I ingested csv files using ListFile and FetchFile Processor, now i want to perform below task on the ingested data:
1. Delete one single row from ingested data depending on any given condition.
2. Drop any one column, i can specify the name of the column too.
3. Can i transform null values present within the ingested csv?
Thanks in Advance!
Created ‎11-14-2016 06:33 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Garima Verma , you can use RouteOnAttribute Processor to filter out the records based on the condition. One way to drop the column is to use ExtractText processor that assigns the columns to attributes using regular expression and in ReplaceText processor, you can drop that attribute from the FlowFile content. You can transform your null values by using ReplaceText processor which uses Nifi Expression language.
I would recommend you to go through Nifi Processors and Nifi Expression language. Here is the link:
https://nifi.apache.org/docs.html
You can go through all processors and expression language guide here.
Created ‎11-14-2016 06:33 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Garima Verma , you can use RouteOnAttribute Processor to filter out the records based on the condition. One way to drop the column is to use ExtractText processor that assigns the columns to attributes using regular expression and in ReplaceText processor, you can drop that attribute from the FlowFile content. You can transform your null values by using ReplaceText processor which uses Nifi Expression language.
I would recommend you to go through Nifi Processors and Nifi Expression language. Here is the link:
https://nifi.apache.org/docs.html
You can go through all processors and expression language guide here.
