Reply
Highlighted
Explorer
Posts: 28
Registered: ‎03-25-2017

Real time processing and reporting tool

Hi,

 
I have a requirement where I have all transactional data injestion into hadoop in real time and before storing the data into hadoop, process it to validate the data. If the data failed to pass validation process , it will not be stored into hadoop. The validation process also make use of historical data which is stored in hadoop. I am thinking to make Nifi --> Kafka --> storm model for  real time processing and then storing into HBase.So, can you suggest any better model for this use case and also I would like to know best open source reporting tools available.
 
 
Any suggestions will be a great help for me.


Warm Regards
Sidharth Kumar
Announcements