Created on 09-28-2016 11:41 AM - edited 09-16-2022 03:42 AM
Many of us Cloudera Enterprise users love Apache Pig because it makes it easy to build powerful and complex data transformation and integration pipelines that run as fault-tolerant batch jobs. However, we are afraid that Cloudera may be abandoning our beloved Pig because CDH has not kept up with any of the latest versions of Pig, which offer many new helpful capabilities. What can you tell us about Cloudera's plans for Pig?
Hortonworks HDP 2.5 contains Pig 0.16
MapR 5.2.0 contains Pig 0.15
IBM BigInsights 4.2.0 contains Pig 0.15
Cloudera CDH 5.8.0 contains Pig 0.12
Created 10-12-2016 02:47 PM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 10-09-2016 04:10 PM
Hi Humana,
Rebasing to a higher version of Pig is on our roadmap. Unfortunately I can't provide specific guidance as to which release this will be included in and/or when that will be happening, however work is actively in progress. Rest assured however that we haven't given up on Pig!
Thanks,
MJ
Created 10-12-2016 02:47 PM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated on 10-12-2016 02:55 PM - edited 10-12-2016 02:58 PM
Santosh, thank you kindly for your reply. I am sure that it is a relief for many of us to hear your good news.
Since you are the Product Manager for Pig at Cloudera, can you also please give us an update on your team's effort to make Pig run on Spark instead of MapReduce?
Created 06-15-2017 05:03 AM
Created 08-29-2017 12:25 AM
Created 11-10-2018 10:25 PM
While some time has passed, for those who subsquently find this thread, Pig 0.17.0 has been included in CDH 6: