Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to find the number of partition created for a particular batch job run.

How to find the number of partition created for a particular batch job run.

Rising Star

I have overnight batch job, which loads the data into a hive table and the loading of data is done through dynamic partitions. Is there any way to find the number of paritions created by each batch job run ? 

1 REPLY 1
Highlighted

Re: How to find the number of partition created for a particular batch job run.

Super Collaborator

In the log of the job (at the end) you should see the list of partition created / modified.

If you can capture that ouput and use it, you should be able to do what you want.