- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
CSV file to Hive using Nifi
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
Created on ‎09-21-2022 02:22 AM - edited ‎09-21-2022 02:23 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I want to send my csv file to hive external table, i'm using this processor
InferAvroSchema -> UpdateAttribute (with add properties 'inferred.avro.schema') -> ConvertCSVToAvro -> PutHDFS -> UpdateHive3Table
but when in UpdateHive3Table the processor just read 8kb and in my table just 1 row.
How can i do to fix this?
Created ‎10-10-2022 10:43 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Perhaps the connection you set between PutHDFS and UpdateHive3Table doesn't send the original file? I am a bit confused by your flow in general.. why convert to avro? Where are you reading files from? Why do you PutHDFS and then UpdateHiveTable instead of just using PutHiveQL?
