Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to take record count when writing as ORC file.

How to take record count when writing as ORC file.

Contributor

Hi All,

i have a scenario like follows, need to split and save my data frame in to multiple partitions based on date and when writing i need to take recorrd count.

is there any option to take record count when writing Dataframe pls comment.

2 REPLIES 2
Highlighted

Re: How to take record count when writing as ORC file.

@Manikandan Jeyabal

Does dataframe.count() your requirement? This can be called before writing the dataframe.

Highlighted

Re: How to take record count when writing as ORC file.

Contributor

Hi @Sandeep Nemuri,

I think i found the answer from Stackoverflow site. Tanx for you info.

Don't have an account?
Coming from Hortonworks? Activate your account here