- last edited on
Is there a way to reduce load on RDBMS while using sparkSQl as each time we need to query from database?
In general, any query being on the same source, like a table should be cached for you to avoid unnecessary IO and you can cache the using -
If this is not relevant, you can maintain a cache of all the results in memory using your constructs, which is also easily done using different cache libraries you can pick off the shelf.
Hope it helps.