Member since
01-02-2022
8
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 5378 | 03-16-2022 12:58 PM |
11-21-2023
06:10 AM
In Hive, metadata related to tables and columns is typically stored in the 'hive' database, specifically within the 'TBLS' and 'COLUMNS_V2' tables in the 'metastore' database. It is not recommended for users to query the metadata directly. Instead, users can leverage the 'sys' database tables. Here is a modified query that utilizes the 'hive' database tables: sql USE sys;
-- Get the count of columns for all tables
SELECT
t.tbl_name AS TABLE_NAME,
COUNT(c.column_name) AS COLUMN_COUNT
FROM
tbls t
JOIN
columns_v2 c
ON
t.tbl_id = c.cd_id
GROUP BY
t.tbl_name; Explanation: The 'sys.tbls' table contains information about tables, while the 'sys.columns_v2' table contains information about columns. We join these tables on the 'TBL_ID' and 'CD_ID' columns to retrieve information about columns for each table. The 'COUNT(c.COLUMN_NAME)' expression calculates the count of columns for each table. This query provides a list of tables along with the count of columns for each table, using the 'sys' database tables."
... View more
03-27-2022
11:07 PM
Hi @araujo Many thanks for the explanation, please note M1 doesn't have Virtual box that is the reason i have chosen Docker from the 2nd link you provided do you have any other alternate solution instead of Virtual box ? 1st option - no since its trail 60 days
... View more
03-24-2022
12:07 AM
@BigDataAvengers, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
03-16-2022
12:58 PM
@steven-matison Thanks for the response i have setup CDP is working fine ,since the image which i have installed is 6 year old image and it is missing KUDU/Kafka/Nifi and so...on i thought of using the HDP sandbox since it is having the latest necessary applications compared to the once i have tested the image https://hub.docker.com/r/cloudera/quickstart/ which is a 6 years old image and i have installed successfully ,however during the installation i did noticed encountered a warning but the installation went fine and i have tested some examples working fine as expected in MAC M1 , So my confusion over here is how come Horton works sandbox images is not working in MAC m1 in docker ,what i also noticed is the script which i mentioned is some thing different when compared agains the 6 year old images which i have tested. anyways things are getting complicated ,to keep it short i will stick to the 6 year old images ,sicne it is open source (free) , i don't want to touch anything which is limited trail/ asking me to provide card details (cloud(aws/gcp/cloudera cloud version).....
... View more
01-03-2022
03:32 AM
@bdworld2 Take a look of this doc which can help about the Maven use. https://docs.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh5_maven_repo.html
... View more