- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
loading data using nifi to impala table
- Labels:
-
Apache Impala
-
Apache NiFi
-
HDFS
Created ‎12-01-2021 02:48 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hey,
I am using nifi to load data from hdfs to impala table.
I am using ExecuteSQL with the following command:
LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year=${year:toString()}, month=${month:toString()}, day=${day:toString()})
And I am getting the following error:
AnalysisException: Value of partition spec (column=year) has incompatible type: 'SMALLINT'. Expected type: 'STRING'
Anyone can help?
Created ‎12-01-2021 03:53 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I managed to fix the problem.
I needed to add quotes around the attributes like this:
LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year="${year}", month="${month}", day="${day}")
Created ‎12-01-2021 03:53 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I managed to fix the problem.
I needed to add quotes around the attributes like this:
LOAD DATA INPATH '/user/nifi/20211115_nifi_test' INTO TABLE arcsight.`20211130_nifi_test` PARTITION (year="${year}", month="${month}", day="${day}")
