Support Questions

Find answers, ask questions, and share your expertise
Announcements
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

NiFi: CSVRecordLookupService - Mapping Not Found

Explorer

If you have ideas for me on how to solve this problem, thanks in  advance - johndcal.

 

I am using a NiFi flow to create single flowfile from two input files. This flow involves the LookupRecord processor, which requires several controller services.  The controller service that is failing is CSVRecordLookupService - it cannot establish the [very simple] mapping; the error reported is below:

johndcal_0-1589912802028.png

 

The first file is a file of ML baseball players - the second column is Loc_ID, which is a 3-letter code for the team's city.  The second file contains the Loc_ID (city) and associated state name.  The first file does not contain the name of the state - the goal is to perform the lookup and create an output flowfile that contains the name of the state.

 

The file schemas and CSVRecordLookupService controller service configuration are shown below.  Samples of the top of the input files, and the process flow, are shown at the bottom of this message.

 

  • baseball player input file schema:

johndcal_1-1589912802034.png

 

  • output file schema (state field added):

johndcal_2-1589912802040.png

 

  • How CSVRecordLookupService is configured:

johndcal_3-1589912802044.png

  • Baseball player input file:

johndcal_4-1589912998083.png

  • [State] lookup file:

johndcal_5-1589913052226.png

  • Process flow:

johndcal_6-1589913123706.png

 

 

1 REPLY 1

Super Collaborator

I just tried to test this and did not manage to reproduce the issue you seem to be facing.

I tested a slightly simpler situation (only lookup to see if the value is in the list, and did not use any of the result) but I did use a (single line) CSV as input record and a multiline CSV as reference table.

 

Below are screenshots of my flow and controller services and here is the actual flow: https://github.com/dennisjaheruddin/linked-content/blob/master/csvlookup.xml

 

DennisJaheruddi_0-1597321117927.png

DennisJaheruddi_1-1597321155103.png

 

---

 

Looking more deeply would likely require an actual flow to review.


- Dennis Jaheruddin

If this answer helped, please mark it as 'solved' and/or if it is valuable for future readers please apply 'kudos'.
Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.