Member since
01-04-2017
2
Posts
0
Kudos Received
0
Solutions
01-05-2017
06:43 PM
Thanks for taking your time to answer my question. I did a test and it seems it updates the transient_lastDdlTime value when an insert is made. However, it doesn't update the value when the data file of the table is replaced (which I am doing). Is there some settings in metadata tables or in hive that needs to be turned on for the table have this kind of metadata updated? Also, the value of transient_lastDdlTime is in something like '1483631785'. How do I change this to reflect a regular date time? Thank you.
... View more
01-04-2017
05:27 PM
Hello, we are still in the process of implementing Hortonworks in our institution. I have a hive database with hive managed tables and I refresh the data every night from the source (Oracle, Sql Server) by replacing the old data file with new file. I wanted to get last update time (which would be the last refresh date time). Does hive store that info in the metadata table? I do see 'transient_lastDdlTime' when I run 'describe formatted table_name' command. Is that the one that is storing the information I am looking for? Does that get updated anytime table data is updated (in my case replaced?) How do I query that as it doesn't seem to be in a different date time format? Any help would be greatly appreciated.
... View more
Labels:
- Labels:
-
Apache Hive