Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Solved
Go to solution
List hive tables based on storage format
Labels:
- Labels:
-
Apache Hive
Rising Star
Created on ‎05-27-2016 12:45 AM - edited ‎09-16-2022 03:22 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Is it possible to list hive tables based on the storage format? We want to implement a standard format for tables; before that we want to list down existing tables based on storage and identify which are not in standard format
1 ACCEPTED SOLUTION
Mentor
Created ‎06-02-2016 04:49 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There's no direct way to filter that out via a simple statement.
You can either use JDBC to fetch catalog data and iterate through the descriptors, or run iterative "DESCRIBE (FORMATTED|EXTENDED) <TABLENAME>" and grep out the Storage and Format related information.
If this is a one-off, you can also explore querying the underlying HMS DB, but do not make something persistently reliant on that as the schema is subject to change between releases.
You can either use JDBC to fetch catalog data and iterate through the descriptors, or run iterative "DESCRIBE (FORMATTED|EXTENDED) <TABLENAME>" and grep out the Storage and Format related information.
If this is a one-off, you can also explore querying the underlying HMS DB, but do not make something persistently reliant on that as the schema is subject to change between releases.
2 REPLIES 2
Mentor
Created ‎06-02-2016 04:49 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
There's no direct way to filter that out via a simple statement.
You can either use JDBC to fetch catalog data and iterate through the descriptors, or run iterative "DESCRIBE (FORMATTED|EXTENDED) <TABLENAME>" and grep out the Storage and Format related information.
If this is a one-off, you can also explore querying the underlying HMS DB, but do not make something persistently reliant on that as the schema is subject to change between releases.
You can either use JDBC to fetch catalog data and iterate through the descriptors, or run iterative "DESCRIBE (FORMATTED|EXTENDED) <TABLENAME>" and grep out the Storage and Format related information.
If this is a one-off, you can also explore querying the underlying HMS DB, but do not make something persistently reliant on that as the schema is subject to change between releases.
Rising Star
Created ‎07-25-2016 02:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thx Harsh , i will explore
