Can't create table with encoding iso-8859-1

[#1]

Hi guys

I'm struggling to create an Hive table, in which I can store german city names like München.

I create the table in the follwoing way:

CREATE external TABLE marketing.town ( lang String, town String) stored AS orc LOCATION'hdfs://xx/xx/xx/xx/xx/marketing/town' tblproperties ("orc.compress"="SNAPPY", 'store.charset'='ISO-8859-1', 'retrieve.charset'= 'ISO-8859-1') ; ALTER TABLE marketing.town SET serdeproperties ('serialization.encoding'='ISO-8859-1');

When i now fill the table:

insert into marketing.town values ('german', 'München'); insert into marketing.town values ('english', 'Munich');

I get the follwoing output:

Can you give me a hint, I'm lost...

Best Markus

[#2 · Accepted solution]

@Markus Baettig

This is known issue related to insert into statements with unicode characters and Hive Jiras HIVE-11721 and HIVE-12207 are reported for the same.

Contact Hortonworks support for HOTFIX or workaround is to create the external table on existing file with unicode characters.

[#3]

do you have any idea about creating hive table in arabic language (hdp 3.1) , is not a valid table name .

there should be a way to let hive metadata accept utf-8 for creating tables ?

[#4]

@oudaysaada As this is an older post you would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question. 

[#5]

@Sindhu Thanks!

[#6]

Any permanent fix on this iso8859 issue