Oracle to Hive table

[#1]

Hi I'm new to Nifi,

I'm trying to do a simple data migration from oracle database to Hive table using Nifi. I'm using Nifi 1.4 version.

I have also read some tutorial from here and some other thread from this forum. Any pointer, thanks.

[#2]

Your PutHDFS processor is placing the data into Hadoop (in ORC format after ConvertAvroToORC) for use by Hive, so you don't also need to send an INSERT statement to PutHiveQL. Rather with the pattern you're using, you should have ReplaceText setting the content to a Hive DDL statement to create a table on top of the ORC file(s) location, or a LOAD DATA INPATH to load from the HDFS location into an existing Hive table.

[#3]

Thanks Matt for the pointer. I have change the replacetext with "Load data inpath..". Now I'm having issue that the Nifi using anonymous user and access denied to move the file.

error-permission-denied.png

[#4 · Accepted solution]

I got it fix the write permission. Now the orc file able to load to hive table but only into one column only. The source data contain 8 column and 14 row only. The result into hive table only into one column and it is in loop.

[#5]

What does your CREATE TABLE statement look like, and does it match the schema of the file(s) (Avro/ORC) you're sending to the external location?

[#6]

It works fine now I change within the replacetext to ${hive.ddl} location '${absolute.hdfs.path}'