Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to use wait and notify for trigger when a certain number of flow files are reached

How to use wait and notify for trigger when a certain number of flow files are reached

New Contributor

Hello Community,

I'm working on a requirement where I'm injesting near real time data into HBase (every 5 mins). Apart from main table I have created one more HBase table which has a rowkey as timemodified and it stores current processed time with now function. I'm using this mainly for maintenance purpose so that I can look into the table for last processed time. Since I'm using fixed row key my value is overwritten always. My problem is that this table is updated for every flow file which makes my entire flow very slow. Is there a way to use wait and notify processors in this scenario ?

Or may be there is a different way to store last processed time.