Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

While processing on big data set spark returning "Size exceeds Integer.MAX_VALUE" error

Highlighted

While processing on big data set spark returning "Size exceeds Integer.MAX_VALUE" error

New Contributor

I am reading 2 HBase table through Phoenix API. One of the tables have huge data volume approximately 400 GB. while doing join between the small tables 40 GB. Spark thronging "Size exceeds Integer.MAX_VALUE" error.


Please help me out solve this issue ASAP.