question Re: Does spork work on hdp 2.4 in Archives of Support Questions (Read Only)

Does spork work on hdp 2.4

TimothySpann — Sat, 18 Jun 2016 08:39:59 GMT

Does hdp 2.4 support pig on spark spprk

Re: Does spork work on hdp 2.4

xin_wang_sam — Sat, 18 Jun 2016 09:47:54 GMT

Do you mean Spark? You can install Spark on any HDP 2.3.x and 2.4 cluster.

Re: Does spork work on hdp 2.4

divakarreddy_a — Sat, 18 Jun 2016 09:57:06 GMT

@Timothy Spann

I don't think HDP supporting Pig on Spark

http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_spark-guide/content/ch_introduction-spark.html

Re: Does spork work on hdp 2.4

TimothySpann — Sun, 19 Jun 2016 01:53:17 GMT

Spork is pig on spark prpject

Re: Does spork work on hdp 2.4

pminovic — Sun, 19 Jun 2016 17:29:09 GMT

Pig on Spark appears to be still under development, as PIG-4059, with more than 80% of sub-tasks completed. The source code is here. On the other hand Spork appears to be abandoned.