Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can pig load data into HAWQ?

Solved Go to solution
Highlighted

Can pig load data into HAWQ?

Super Guru

Can pig load data into HAWQ?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Can pig load data into HAWQ?

Mentor
5 REPLIES 5

Re: Can pig load data into HAWQ?

Mentor

Re: Can pig load data into HAWQ?

Super Guru

straight out of the docs:

SET pig.splitCombination false; A = LOAD 'hawq://mdw1:5432/gpadmin' USING com.gopivotal.pig.HawqLoader('retail_demo.products_dim', 'gpadmin'); DESCRIBE A; A: {product_id: int,category_id: int,price: bigdecimal,product_name: chararray} B = LOAD 'hawq://mdw1:5432/gpadmin' USING com.gopivotal.pig.HawqLoader('retail_demo.vinyl_counts', 'gpadmin'); DESCRIBE B; B: {category_id: int,count: int} C = JOIN A BY category_id, B by category_id USING 'replicated'; STORE C INTO '$output';

Re: Can pig load data into HAWQ?

Super Guru

With PXF, you can do anything. Not sure PIG + HAWQ is the best combo though

Re: Can pig load data into HAWQ?

Super Guru

@Timothy Spann @Artem Ervits I got confirmation Pig CAN NOT load directly into HAWQ. it is not supported.

Re: Can pig load data into HAWQ?

Mentor

Not supported and not possible is two different things. Docs have a clear example.

Don't have an account?
Coming from Hortonworks? Activate your account here