- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Reference table lookup using NiFi
- Labels:
-
Apache Hive
-
Apache NiFi
-
HDFS
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
We are loading data from oracle table to Hive using NiFi. At the time of loading we will need to do some reference table lookup.
(e.g Customer data has Country_code = IN in Oracle, while loading Customer data in HDFS,
lookup using Country_code=In will be looked up in reference table and new column with value Country_detail = INDIA will be populated in Customer data).
Could you please guide me how it can be done?
Created 03-03-2020 09:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Use LookupRecord processor
it can use JDBC sources
Created 03-03-2020 09:18 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Use LookupRecord processor
it can use JDBC sources
Created 03-03-2020 09:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
That is an HBase example, just use a different one.
We also teach how to do the lookup / update record processors in our CDF Workshop roadshow
