I have two dataframes. One with 131 rows and another with 54 million rows. I need join the first one with the second and thereby generating 6 billion rows.
Its taking forever even doing a broadcast hash join along with executor/memory tuning trials.
I need help with the syntax.