Member since
08-27-2019
1
Post
0
Kudos Received
0
Solutions
08-27-2019
08:13 PM
Hi,
I am trying to see how to map different fields names (for same data) due to data is from various sources, but ingest to same hive table.
Ex: Table1 with name "Users", Columns {"firstName", "lastName", "street","city","zip","country"} Table2 with name "UserDetails", Columns {"fName","lName","street","city","pincode","country","contact"} Table3 with name "User", Columns {"firstName","lastname","address1","address2", "city","state", "pin", "country"}
Target Hive Table: "Users" with columns {"firstName","lastName", "address1", "address2", "city", "state", "zip", "country", "contact"}
firstName, fName maps to firstName lastName, lName maps to lastName street and address1 maps to address1 address2 maps to address2 zip, pincode maps to zip ...so on.
What is the best way to map these different column headers to same hive columns in nifi? Appreciate any thoughts. If there is a way I can create only one flow template to handle these that would be great as well.
Appreciate your help.
Thanks,
Ravi
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
-
NiFi Registry