question Hive Insert overwrite directory producing junk characters. in Archives of Support Questions (Read Only)

Hive Insert overwrite directory producing junk characters.

vinayraghava198 — Fri, 16 Sep 2022 11:33:56 GMT

Hi All,

I am seeing a strange issue with Hortonworks hive, the below HQL statement is producing a file with junk characters. Do you think I have missed something? Same query is producing readable data in Cloudera cluster. Can someone please suggest.

INSERT OVERWRITE LOCAL DIRECTORY '<Local Linux Directory>' ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' STORED AS TEXTFILE SELECT col1,col2 FROM table1;

Re: Hive Insert overwrite directory producing junk characters.

balavignesh_nag — Fri, 05 May 2017 13:19:17 GMT

Hi @Vinay R

What is the format that table1 in hive? Is it stored in any other format apart from TEXTFILE? If so the data might be compressed if you have enabled the compression in your table property.

Execute this and try exporting it. set hive.exec.compress.output=false;

Re: Hive Insert overwrite directory producing junk characters.

vinayraghava198 — Fri, 05 May 2017 13:58:05 GMT

@Bala Vignesh N V Thank you very much , the table I am querying was compressed and the above suggestion did help.

Re: Hive Insert overwrite directory producing junk characters.

balavignesh_nag — Fri, 05 May 2017 14:06:14 GMT

@Vinay R Glad it helped you. If you think it solves your problem then please accept the answer.