Created 06-14-2018 12:07 PM
I'm using the ConvertExcelToCSVProcessor (1.5.0.3.1.0.0-564) to do what it's name describes, but it appears that my flow attributes are being dropped in the output flow. The processor correctly writes new attributes such as sheetname and numrows, but drops the existing attributes that I added earlier in the flow.
Is this universal behaviour (i.e. not just my config/data), and if so is it expected? I can provide more details if it's not happening for other folks.
Created 06-14-2018 12:42 PM
Yep,I'm able to reproduce the same scenario in NiFi-1.5 but not in NiFi-1.6.
In NiFi-1.6 attributes are not dropping after ConvertExcelToCSV processor.
As you can upgrade the NiFi version to 1.6 (or) contact support team to get a patch (or) As a workaround to fix this issue in NiFi-1.5 please refer to this link and implement the same logic to store all the attributes in DistributedCache and Fetch them from DistributedMapCache after ConvertExcelToCsv processor.
-
Click on Accept button below to accept the answer, if the answer helped to resolve your issue..!!
Created 06-14-2018 12:42 PM
Yep,I'm able to reproduce the same scenario in NiFi-1.5 but not in NiFi-1.6.
In NiFi-1.6 attributes are not dropping after ConvertExcelToCSV processor.
As you can upgrade the NiFi version to 1.6 (or) contact support team to get a patch (or) As a workaround to fix this issue in NiFi-1.5 please refer to this link and implement the same logic to store all the attributes in DistributedCache and Fetch them from DistributedMapCache after ConvertExcelToCsv processor.
-
Click on Accept button below to accept the answer, if the answer helped to resolve your issue..!!
Created 06-19-2018 11:42 AM
Thanks @Shu - upgrading to 1.6 is not an option right now so I'm implemented the DistributedMapCache workaround you linked. Edit: Seems I'd misunderstood how the PutDistributedMapCache processor works. It appears to place the flow content into the cache, but in my case the content is the spreadsheet I'm trying to convert, so replacing that with the flow attributes so I can cache them results in losing the spreadsheet in the process. The example you linked doesn't hydrate the flow content with "real" data until after the caching has taken place, so that works fine.
Created 06-21-2018 04:41 PM
I ended up compiling the source code for the 1.6 processor and deploying that, it seems to play nicely with the 1.5 NiFi framework.