question Re: HIve not loading escape character (\) in Archives of Support Questions (Read Only)

HIve not loading escape character (\)

jpasswaters — Mon, 14 Mar 2016 21:14:19 GMT

We have some data that has a backslash (\) and noticed that when loading into Hive, it treats it as an escape character. Is there a way to get around it treating this as an escape character?

I have tried replacing a single backslash with 2 backslashes and it still give me the same result.

The only other thing i could think of doing is just replacing the backslash with the encoded version of that value.

Re: HIve not loading escape character (\)

shishir_saxena4 — Mon, 14 Mar 2016 21:31:25 GMT

@Jesse Passwaters

How are you loading your data to Hive ? If you are using Sqoop, then you need to take a look at

https://sqoop.apache.org/docs/1.4.0-incubating/SqoopUserGuide.html#id1765770

Re: HIve not loading escape character (\)

jpasswaters — Mon, 14 Mar 2016 21:48:28 GMT

@Shishir Saxena

We are loading the data from an external table via the CSVSerde. In the temp table we can view the backslashes, but once we load it into the ORC format via the CSVSerde the backslashes, no matter how many there are, they disappear.

Re: HIve not loading escape character (\)

jpasswaters — Mon, 14 Mar 2016 22:16:53 GMT

Let me clarify - the external table is using the CSVSerde to read the data and then we are loading an ORC table which uses the OrcSerde

Re: HIve not loading escape character (\)

tsaito — Tue, 15 Mar 2016 00:34:39 GMT

Can you use ESCAPED BY '\' when you create an ORC table and load from the external table?

Re: HIve not loading escape character (\)

jpasswaters — Tue, 15 Mar 2016 01:15:38 GMT

@Takahiko Saito

I've seen where you can do that with the CSVSerde, but haven't found anything that states that you could use that with the OrcSerde. Do you have any examples?

Re: HIve not loading escape character (\)

shishir_saxena4 — Tue, 15 Mar 2016 05:54:57 GMT

@Jesse Passwaters @Takahiko Saito Please take a look at

https://documentation.altiscale.com/using-csv-serde-with-hive It has example of how to use a different escape character.

Re: HIve not loading escape character (\)

jpasswaters — Wed, 16 Mar 2016 20:57:45 GMT

@Shishir Saxena - That worked! I previously saw that but just didn't think that would solve it.

Re: HIve not loading escape character (\)

sahithi_477 — Fri, 18 May 2018 12:58:39 GMT

I was not able to open the link :https://documentation.altiscale.com/using-csv-serde-with-hive

Could you p[lease provide the correct link or provide me the solution which would be helpful.

Re: HIve not loading escape character (\)

sujai7519 — Wed, 13 Jun 2018 03:16:45 GMT

@Shishir Saxena: This link is not working

https://documentation.altiscale.com/using-csv-serde-with-hive It has example of how to use a different escape character.

Can you post the contents of the above link here? or give a different link that works?