Created 02-08-2018 01:40 PM
Hello everyone!
As a student working on a big data project, i wanted to ask you about purging data with HIVE SHELL.
We can for instance use that command: DELETE * FROM TableA WHERE (date < 02/02/2018)
My question is: Is it possible to make with HIVE a log file, that reports, after the query is completed :
-the date of the query
-starting hour of the query
-ending hour
-amount of data deleted
-...
Thank you very much for your help !
Created 02-09-2018 03:24 AM
Try to below parameter in you shell and run the query. It will provide you all the stats.
set hive.server2.logging.operation.level=PERFORMANCE;
Hope this helps you.
Created 04-29-2019 01:16 PM
Yes you are right, Thanks for sharing this.