Member since
12-09-2015
106
Posts
40
Kudos Received
20
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2124 | 12-26-2018 08:07 PM | |
1580 | 08-17-2018 06:12 PM | |
894 | 08-09-2018 08:35 PM | |
9527 | 01-03-2018 12:31 AM | |
613 | 11-07-2017 05:53 PM |
01-02-2019
10:23 PM
1 Kudo
are the statistics up to date on the tables? It should be able to do a semi join reduction. Updating stats may help: https://cwiki.apache.org/confluence/display/Hive/Column%2BStatistics%2Bin%2BHive
... View more
01-02-2019
07:24 PM
From the directory listing, your table must have "transactional=true" property, i.e. it's an ACID table. That means that Insert Overwrite will create a base_x directory where it will put the result of the insert (new data) there. Any data that existed before, will remain in the table but will not be visible to readers that start after Insert Overwrite finished. Old data will be physically removed once Compaction runs over this table/partition.
... View more
12-26-2018
08:07 PM
1 Kudo
You can use the Export Table command https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport#LanguageManualImportExport-ExportSyntax
... View more
12-18-2018
01:41 AM
The contents of a managed table should be manage by Hive, you cannot just write files there. To do that you have to use External table. To add data to a managed table you should use Insert or Load Data or some other Hive command, but not just drop files there.
... View more
12-14-2018
10:04 PM
Is this a managed or external table? If managed, do you have any files in the table that don't match 0000_0, 0000_0_copy_1 or bucket_0 pattern?
... View more
10-16-2018
06:57 PM
Have you considered SQL Merge statement?
... View more
09-23-2018
09:49 PM
1 Kudo
Hive metastore is a service. That may run in embedded mode and in stand alone mode. You can have several instances running in your cluster, all instances must share the same backend RDMBS. This should help: https://cwiki.apache.org/confluence/display/Hive/AdminManual+MetastoreAdmin#AdminManualMetastoreAdmin-RemoteMetastoreServer
... View more
09-23-2018
04:51 PM
Do you have the standalone metastore running? that is where compaction jobs are actually generated and submitted.
... View more
09-12-2018
09:23 PM
desc formatted <table> <column> https://cwiki.apache.org/confluence/display/Hive/StatsDev#StatsDev-Examples
... View more