Support Questions
Find answers, ask questions, and share your expertise

How to take record count when writing as ORC file.

How to take record count when writing as ORC file.

Contributor

Hi All,

i have a scenario like follows, need to split and save my data frame in to multiple partitions based on date and when writing i need to take recorrd count.

is there any option to take record count when writing Dataframe pls comment.

2 REPLIES 2

Re: How to take record count when writing as ORC file.

@Manikandan Jeyabal

Does dataframe.count() your requirement? This can be called before writing the dataframe.

Re: How to take record count when writing as ORC file.

Contributor

Hi @Sandeep Nemuri,

I think i found the answer from Stackoverflow site. Tanx for you info.