Skip to main content
Gil
Gil
Gold ⭐️
December 1, 2021
Solved

loading data using nifi to impala table

Hey, 

 

I am using nifi to load data from hdfs to impala table.

 

I am using ExecuteSQL with the following command:

 

LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year=${year:toString()}, month=${month:toString()}, day=${day:toString()})

 

And I am getting the following error:

AnalysisException: Value of partition spec (column=year) has incompatible type: 'SMALLINT'. Expected type: 'STRING'

 

Anyone can help?

 

 

Gil
GilAnswer
Gold ⭐️
December 1, 2021

I managed to fix the problem. 

 

I needed to add quotes around the attributes like this:

 

 LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year="${year}", month="${month}", day="${day}")

View in thread

1 reply

Gil
GilAuthorAnswer
Gold ⭐️
December 1, 2021

I managed to fix the problem. 

 

I needed to add quotes around the attributes like this:

 

 LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year="${year}", month="${month}", day="${day}")

Translate
Terms & ConditionsAccessibility statement