question Re: Data Flow Language-PIG in Archives of Support Questions (Read Only)

Data Flow Language-PIG

Geek007 — Fri, 16 Sep 2022 11:40:09 GMT

Hello Everyone,

Why is PIG called a data flow language?

Thank you.

csguna — Sun, 28 May 2017 02:04:23 GMT

As you said yes it is a data folow language rather than a query language .

because you write series declaritive of statement that defines relations

where each relations performs new set of data transformation.

To put simple it like how to reterive data rather how you want data - like more of query optimizer (example)

Mainly used in ETL to ingest external data into Hadoop.

hope this suffice

Geek007 — Fri, 16 Jun 2017 20:13:47 GMT

Hello csguna,

Thanks for your response. Could you please explain it with one example. That will be much better.

csguna — Sat, 17 Jun 2017 01:20:56 GMT

in other words

in SQL We say “what” is to be accomplished

in Pig, we mention “how” a task is to be performed.

when to go for Pig - When we want to process larget set of unorganized, unstructured and decentralized data

Pig doesnt need to have a schema , it will consume unstructured data with delimiters .

please look in to this example .

let me know if this suffice