08-10-2015 09:30 PM
I have created solr collections to create solr documents from hbase tables and enabled NRT using Key-Value store indexer service. I have populated the hbase table with data and using NRT, the solr documents are created and I could query them from solr server. All the setup is good.
Next, I'm working on data retention of solr documents. My expectation was, if I enable TTL on hbase table, the data purges from hbase table after x minutes and solr NRT will pickup those delta changes from hbase table and remove the corresponding solr documents. But, I found that my expectation was wrong. I don't see a cleanup happening on solr documents when hbase table data is cleared using TTL feature.
Please let me know how to resolve this issue (or) clarify me how to setup a data retention policy on solr documents to exactly match with HBase's TTL feature.
I'm using HBase Version 0.98.6-cdh5.3.0
09-09-2015 04:00 AM
Thanks for confirming Wolfgang,
Is this featuer enabled in any higher versions of CDH? If not, could you please help me to setup similar feature (TTL) on solr documentation? How to delete the solr documents older than xx days?