question Re: Can't create table with encoding iso-8859-1 in Archives of Support Questions (Read Only)

Can't create table with encoding iso-8859-1

markus_baettig — Sun, 18 Aug 2019 07:15:31 GMT

Hi guys

I'm struggling to create an Hive table, in which I can store german city names like München.

I create the table in the follwoing way:

CREATE external TABLE marketing.town ( lang String, town String) stored AS orc LOCATION'hdfs://xx/xx/xx/xx/xx/marketing/town' tblproperties ("orc.compress"="SNAPPY", 'store.charset'='ISO-8859-1', 'retrieve.charset'= 'ISO-8859-1') ; ALTER TABLE marketing.town SET serdeproperties ('serialization.encoding'='ISO-8859-1');

When i now fill the table:

insert into marketing.town values ('german', 'München'); insert into marketing.town values ('english', 'Munich');

I get the follwoing output:

Can you give me a hint, I'm lost...

Best Markus

Re: Can't create table with encoding iso-8859-1

ssubhas — Tue, 25 Jul 2017 18:21:37 GMT

@Markus Baettig

This is known issue related to insert into statements with unicode characters and Hive Jiras HIVE-11721 and HIVE-12207 are reported for the same.

Contact Hortonworks support for HOTFIX or workaround is to create the external table on existing file with unicode characters.

Re: Can't create table with encoding iso-8859-1

markus_baettig — Tue, 25 Jul 2017 18:47:49 GMT

@Sindhu Thanks!

Re: Can't create table with encoding iso-8859-1

chuarkai — Fri, 18 May 2018 10:32:00 GMT

Any permanent fix on this iso8859 issue

Re: Can't create table with encoding iso-8859-1

oudaysaada — Sat, 06 Jun 2020 10:16:45 GMT

do you have any idea about creating hive table in arabic language (hdp 3.1) , is not a valid table name .

there should be a way to let hive metadata accept utf-8 for creating tables ?

Re: Can't create table with encoding iso-8859-1

VidyaSargur — Mon, 08 Jun 2020 06:36:20 GMT

@oudaysaada As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.