i have a scenario like follows, need to split and save my data frame in to multiple partitions based on date and when writing i need to take recorrd count.
is there any option to take record count when writing Dataframe pls comment.
Does dataframe.count() your requirement? This can be called before writing the dataframe.
Hi @Sandeep Nemuri,
I think i found the answer from Stackoverflow site. Tanx for you info.