Reply
Highlighted
New Contributor
Posts: 5
Registered: ‎05-04-2016

Stream Kafka to Parquet with complex data types

We want to stream Kafka and injest data into HDFS using Parquet format. The data has complex types like arrays, struct and maps. We're using Apache Apex to stream which uses plain old java. Can I use Kite-SDK in my java code to write Parquet files ? Is there any alternative ?

 

newbie

Announcements
The Kite SDK is a collection of docs, sample code, APIs, and tools to make Hadoop application development faster. Learn more at http://kitesdk.org.