Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to maintain state of custom object in spark?

Highlighted

How to maintain state of custom object in spark?

Rising Star

Hi all,

We are performing foreach operation on rdd , within it parsing each line of rdd to validate the schema of input.

Along with this functionality i want to keep on update the custom java object to maintain the metadata of validation.

Remember that ,we are expecting to make visible same custom object to other executors.

Thanks in advance.

Don't have an account?
Coming from Hortonworks? Activate your account here