Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Solved
Go to solution
Hive ORC or AVRO format with field delimiters
Labels:
- Labels:
-
Apache Hive
Expert Contributor
Created 05-13-2016 01:53 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
What does it mean for a hive table with ORC or Avro format to have the Field delimiter specified? Does hive ignore even if its specified?
For example,
CREATE TABLE if not exists T (
C1 STRING ,
C2 STRING )
ROW FORMAT DELIMITED
FIELDS TERMINATED BY '\001'
STORED AS ORC tblproperties ("orc.compress"="SNAPPY")
1 ACCEPTED SOLUTION
Guru
Created 05-13-2016 07:21 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes. Once you specific STORED AS ORC, OrcSerde is what is used which ignores those. Your SerDe can decide which of them in create table script can be used.
1 REPLY 1
Guru
Created 05-13-2016 07:21 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Yes. Once you specific STORED AS ORC, OrcSerde is what is used which ignores those. Your SerDe can decide which of them in create table script can be used.
