Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

What does it mean, Spark persist call on its own does not force evaluation.?

avatar
Rising Star

I was recollecing few information about spark in documentation and crossed the below point

 

" Spark persist call on its own does not force evaluation.?"

1 ACCEPTED SOLUTION

avatar
Master Collaborator

If you call persist() on an RDD, it means that the data in the RDD will be persisted but only later when something causes it to be computed for the first time. It is not immediately evaluated.

View solution in original post

1 REPLY 1

avatar
Master Collaborator

If you call persist() on an RDD, it means that the data in the RDD will be persisted but only later when something causes it to be computed for the first time. It is not immediately evaluated.