https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142285#M104878 <P>Solr also supports TTL, although I think if the docs are deleted from HBase they should be deleted in Solr automatically.</P><P>In case you are interested in the Solr TTL feature, it's done through an UpdateRequestProcessor (URP). It's currently only documented in Solr's Javadocs: <A href="http://lucene.apache.org/solr/6_4_0/solr-core/org/apache/solr/update/processor/DocExpirationUpdateProcessorFactory.html" target="_blank">http://lucene.apache.org/solr/6_4_0/solr-core/org/apache/solr/update/processor/DocExpirationUpdateProcessorFactory.html</A> (replace the '6_4_0' part of that URL to get to the javadocs for your version; this URP has existed since Solr 4.8.0).</P> Wed, 08 Mar 2017 02:57:20 GMT cassandra 2017-03-08T02:57:20Z https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142283#M104876 <P>Hi,</P><P>Im using NiFi here and the data flow is running every minute. Im fetching csvs from a web service and put it in hdfs.</P><P>Now every file inserted in HDFS, i need to save it to HBASE. But I need to delete rows that is over 2 hours ago. For example the time now is 11:03AM and i have a records/rows that is inserted at 9:03 AM, when the time became 11:04AM i need to delete the records that was insert at 9:03AM. This process of deleting records should also run every minute. And this deleted records also need to be deleted in SOLR+Banana UI.</P><P>Is this possible?</P><P>Thanks.</P> Tue, 07 Mar 2017 15:00:03 GMT https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142283#M104876 regie_canada 2017-03-07T15:00:03Z https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142284#M104877 <P>Deleting rows in HBase is a heavy operation, instead of managing deletions yourself, let HBase handle it via TTL. Basically you can set expiration on a row or alternatively cell and it will be marked as deleted once time to live expires, time is in UTC. <A href="https://hbase.apache.org/book.html#ttl" target="_blank">https://hbase.apache.org/book.html#ttl</A></P><P>Once row has a delete market it will be cleaned up by a standard compaction mechanism.</P> Tue, 07 Mar 2017 20:29:01 GMT https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142284#M104877 aervits 2017-03-07T20:29:01Z https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142285#M104878 <P>Solr also supports TTL, although I think if the docs are deleted from HBase they should be deleted in Solr automatically.</P><P>In case you are interested in the Solr TTL feature, it's done through an UpdateRequestProcessor (URP). It's currently only documented in Solr's Javadocs: <A href="http://lucene.apache.org/solr/6_4_0/solr-core/org/apache/solr/update/processor/DocExpirationUpdateProcessorFactory.html" target="_blank">http://lucene.apache.org/solr/6_4_0/solr-core/org/apache/solr/update/processor/DocExpirationUpdateProcessorFactory.html</A> (replace the '6_4_0' part of that URL to get to the javadocs for your version; this URP has existed since Solr 4.8.0).</P> Wed, 08 Mar 2017 02:57:20 GMT https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142285#M104878 cassandra 2017-03-08T02:57:20Z https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142286#M104879 <P>Thanks sir <A rel="user" href="https://community.cloudera.com/users/393/aervits.html" nodeid="393">@Artem Ervits</A> i'll try this one.</P> Wed, 08 Mar 2017 11:02:53 GMT https://community.cloudera.com/t5/Support-Questions/How-can-I-delete-Records-in-Hbase-and-SolR-that-is-2-hours/m-p/142286#M104879 regie_canada 2017-03-08T11:02:53Z