loading data using nifi to impala table

Gil — Wed, 01 Dec 2021 10:48:29 GMT

Hey,

I am using nifi to load data from hdfs to impala table.

I am using ExecuteSQL with the following command:

LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year=${year:toString()}, month=${month:toString()}, day=${day:toString()})

And I am getting the following error:

AnalysisException: Value of partition spec (column=year) has incompatible type: 'SMALLINT'. Expected type: 'STRING'

Anyone can help?

Re: loading data using nifi to impala table

Gil — Wed, 01 Dec 2021 11:53:46 GMT

I managed to fix the problem.

I needed to add quotes around the attributes like this:

LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year="${year}", month="${month}", day="${day}")

question loading data using nifi to impala table in Support Questions

loading data using nifi to impala table

Re: loading data using nifi to impala table