I have few question about PIG_HEAPSIZE, Is anyone can please help me to understand.
Is this PIG_HEAPSIZE can be changed globally? if so where we need to change?
Is there will be problem if we increase or decrease this PIG_HEAPSIZE? If so what are those?
Yes, it can be change globally by adding it in the Oozie properties.
My suggestion of making change global for one job failure is not a good reason because it unnecessarily take some memory even though it's not required in each execution.
Thanks for the reply.
Would you please share more info how to configure this on oozie and are there any more downside effects increasing or decreasing PIG_HEAPSIZE. Any best practices ? would you please share.
Also PIG actually takes configured heap memory or just allow memory to be taken as needed up to that limit? Anyone can explain this please.