New Contributor
Posts: 2
Registered: ‎01-18-2016

Is there and ETA for Pig On Spark?

[ Edited ]

I know that Cloudera is keen to replace classic Map-Reduce with Spark and that this will require that Pig supports Spark as a valid execution mode. I've read other pages in the Cloudera website that this is going to be supported, but I find any dates or version number telling me when this is going to happen. Any ideas?

Posts: 1,903
Kudos: 435
Solutions: 307
Registered: ‎07-31-2013

Re: Is there and ETA for Pig On Spark?

The feature will likely debut in supported mode sometime after Hive-on-Spark is stabilised and supported.

I don't have a hard ETA at the moment.