Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Data Ingestion using Nifi

Highlighted

Data Ingestion using Nifi

New Contributor

Hello Friends, am very new to Nifi and have a following question.

I will have to read content file (have 25 columns) and 10 columns in this file are numeric columns and have to go into 10 different lookup file to get the descriptions.. have to concatenate all the description columns and have to load into a Hive table.

for example 3rd column in the content file have value 25 and have to look for country description in country lookup file and have to write country name along with other columns (that i have read from content file).

please advice with examples.

2 REPLIES 2
Highlighted

Re: Data Ingestion using Nifi

Super Guru

Lookup tables are a bit of work.

It may be best to load into Hive as ORC and then

https://community.hortonworks.com/content/kbentry/99861/ingesting-ibeacon-data-via-ble-to-mqtt-wifi-...

This is another option: https://community.hortonworks.com/questions/63960/etl-lookup-transformation-equivalent-in-nifi.html

Are the lookup tables in Hive or elsewhere?

Highlighted

Re: Data Ingestion using Nifi

New Contributor

lookup's are files, have to get the description from lookup file and will have to load HIVE table along with content file data.

Don't have an account?
Coming from Hortonworks? Activate your account here