Support Questions
Find answers, ask questions, and share your expertise

Hive Streaming in Spark

Hive Streaming in Spark

Is it a valid scenario to use hive-streaming inside a spark program. I have seen examples of hive streaming as standalone program and spark streaming for writing to hive. Never seen any program where hive-streaming is used inside a spark application and submitted to cluster. Does hive streaming work inside a spark application or is this a totally wrong usage. Please share your thoughts.

4 REPLIES 4

Re: Hive Streaming in Spark

Explorer

Better option would be to use Nifi for hive-streaming, Nifi has pre-built processor for streaming data into Hive, check out the post below for an example

https://community.hortonworks.com/articles/52856/stream-data-into-hive-like-a-king-using-nifi.html

Re: Hive Streaming in Spark

Anybody has used hive-streaming inside spark and deployed in a cluster ? Is this something correct or wrong usage

Re: Hive Streaming in Spark

Anybody has used hive-streaming inside spark and deployed in a cluster ? Is this something correct or wrong usage. Is there any url that shows using hive-streaming inside spark program in cluster mode.

Re: Hive Streaming in Spark

Expert Contributor

Hive streaming API is a Java library so it should be possible to use it from any Java process.