question Re: Tutorial for writing directly to ORC files with Java in Archives of Support Questions (Read Only)

Tutorial for writing directly to ORC files with Java

myoung — Wed, 14 Dec 2016 01:09:25 GMT

Are there any current or recent tutorials that cover writing data directly to ORC files via a Java application? The ORC files will be used by Hive.

I've seen this: http://hortonworks.com/blog/using-orcfile-cascading-apache-crunch/ but it is a little dated. Is there anything newer or more detailed? This is a similar link: https://codecheese.wordpress.com/2016/04/20/writing-an-orc-file-using-java/.

Also are there any reasons to /not/ write directly to ORC files?

Re: Tutorial for writing directly to ORC files with Java

egarelnabi — Wed, 14 Dec 2016 01:24:56 GMT

@Michael Young

The example in the second link you provided is good. I would also recommend taking a look at the examples in the link below for different kinds of manipulations/actions you can do to/with ORC files through java.

http://www.programcreek.com/java-api-examples/index.php?api=org.apache.hadoop.hive.ql.io.orc.OrcFile

Re: Tutorial for writing directly to ORC files with Java

mqureshi — Wed, 14 Dec 2016 01:26:38 GMT

@Michael Young

I am reasonably sure you are aware of the core-java api of Apache ORC. Is this link not enough?

https://orc.apache.org/docs/core-java.html

Re: Tutorial for writing directly to ORC files with Java

myoung — Wed, 14 Dec 2016 01:37:27 GMT

Thank you.

This question is on behalf of someone else. I'm not sure if they are aware of that or not. I'll pass the information along.

Re: Tutorial for writing directly to ORC files with Java

myoung — Wed, 14 Dec 2016 01:39:06 GMT

Thank you. This is a handy link.

Re: Tutorial for writing directly to ORC files with Java

TimothySpann — Wed, 14 Dec 2016 02:09:47 GMT

https://orc.apache.org/docs/core-java.html

https://codecheese.wordpress.com/2016/04/20/writing-an-orc-file-using-java/

https://github.com/apache/orc/tree/master/examples

Re: Tutorial for writing directly to ORC files with Java

TimothySpann — Wed, 14 Dec 2016 02:09:48 GMT

https://orc.apache.org/docs/core-java.html

https://codecheese.wordpress.com/2016/04/20/writing-an-orc-file-using-java/

https://github.com/apache/orc/tree/master/examples

Re: Tutorial for writing directly to ORC files with Java

myoung — Wed, 14 Dec 2016 05:13:50 GMT

Customer indicated this link was the most useful for them.

Re: Tutorial for writing directly to ORC files with Java

karthik1 — Fri, 03 Mar 2017 21:32:59 GMT

I just built and release a 1.0 version of an Apache licensed java library to create ORC files from optionally annotated classes. I'd appreciate people trying it out and suggesting features to add. The library is available at github