question Re: Can pig load data into HAWQ? in Archives of Support Questions (Read Only)

Can pig load data into HAWQ?

sunile_manjee — Fri, 01 Apr 2016 01:17:51 GMT

Can pig load data into HAWQ?

Re: Can pig load data into HAWQ?

aervits — Fri, 01 Apr 2016 01:25:34 GMT

great question man, apparently yes http://pivotal-field-engineering.github.io/pmr-common/pmr/apidocs/index.html?com/gopivotal/pig/HawqLoader.html

Re: Can pig load data into HAWQ?

sunile_manjee — Thu, 07 Apr 2016 04:08:03 GMT

straight out of the docs:

SET pig.splitCombination false; A = LOAD 'hawq://mdw1:5432/gpadmin' USING com.gopivotal.pig.HawqLoader('retail_demo.products_dim', 'gpadmin'); DESCRIBE A; A: {product_id: int,category_id: int,price: bigdecimal,product_name: chararray} B = LOAD 'hawq://mdw1:5432/gpadmin' USING com.gopivotal.pig.HawqLoader('retail_demo.vinyl_counts', 'gpadmin'); DESCRIBE B; B: {category_id: int,count: int} C = JOIN A BY category_id, B by category_id USING 'replicated'; STORE C INTO '$output';

Re: Can pig load data into HAWQ?

TimothySpann — Mon, 23 May 2016 22:07:21 GMT

With PXF, you can do anything. Not sure PIG + HAWQ is the best combo though

Re: Can pig load data into HAWQ?

sunile_manjee — Fri, 27 May 2016 08:40:08 GMT

@Timothy Spann @Artem Ervits I got confirmation Pig CAN NOT load directly into HAWQ. it is not supported.

Re: Can pig load data into HAWQ?

aervits — Fri, 27 May 2016 09:24:31 GMT

Not supported and not possible is two different things. Docs have a clear example.