@steven-matison  I have been trying to get ifElse working for me but the below gives me an empty string > "" And this gives me null as a string > "null" is there a way to return null not as a string?    ... View more

Hi @steven-matison    Here is a flow file example, as you can see the date field is only present in the array some of the time, what I want to achieve is, if the date is present I need it in epoch. If the date is not present for the field to be 'null,' (not "null" as a sting/in brackets) or ignored altogether.   { "example": "cloudera", "risk_rating": "low", "observed" false, "sources": [ { "date": "2020-06-12T12:00:00.000Z", "unique_id": "some_value", "source_name": "cloudera", "url": "https://www.cloudera.com", "description": "example_log", },{ "unique_id": "some_other_value", "source_name": "google", "url": "https://www.google.com", "description": "example_log_without_date" }], "report_confidence": "confirmed", "base_score" 7.8, "authentication": "none" } ... View more

Hi @Fredi  Can you send a screenshot of the advanced tab rules if possible, I'm a little confused as to what you are wanting to achieve.   Cheers ... View more

@nramanaiah have been able to run further testing and confirm that my partitions are purging as expected! thanks again for the assistance! ... View more

@nramanaiah I haven't had a chance to do further testing yet, I will let you know ASAP. Thanks again for the help. ... View more

@nramanaiah I'm still experiencing some issues with this, I have applied metastore.msck.repair.enable.partition.retention=true and restarted, all looks good as below. I have applied the ALTER table statements to set the retention of 1 day to a test table without error, but when I do a SELECT statement in Beeline I can still see data from last week? Any idea what I'm missing?   ... View more

@nramanaiah thanks very much for the help! ... View more