Support Questions
Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Advanced Search
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Is there any case to prefer RDD instead of DataFrame/Dataset/SparkSQL in Spark 2.3.0 or later?

Is there any case to prefer RDD instead of DataFrame/Dataset/SparkSQL in Spark 2.3.0 or later?

Labels:
toide
Contributor

Created ‎01-24-2019 06:32 AM

Is there any case to prefer RDD instead of DataFrame/Dataset/SparkSQLin Spark 2.3.0 or later?

AFAIK, using DataFrame/Dataset/SparkSQL has a lot of merits. For example, simpler coding and Optimization by Catalyst.

If there's some concrete example that should be written with RDD, let me know!

Thanks,

Reply
150 Views
0 Kudos
Don't have an account?
Register
Coming from Hortonworks? Activate your account here