question Re: MD5 value of a table in Support Questions

MD5 value of a table

Kiddo — Fri, 17 Sep 2021 04:00:43 GMT

How can we get 1 MD5 value for a hive table? Do not need a MD5 value for each record in the table. Is there a way to query the MD5() at a table level. Thanks

Re: MD5 value of a table

Shifu — Fri, 17 Sep 2021 13:44:36 GMT

Hi @Kiddo

Could you check whether the below link helps your query?

https://community.cloudera.com/t5/Support-Questions/Hive-Do-we-have-checksum-in-hive/td-p/104490
https://community.cloudera.com/t5/Support-Questions/Hive-Can-t-get-the-md5-value/m-p/117696
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF

If you are happy with the reply, mark it Accept as Solution

Re: MD5 value of a table

smruti — Sun, 19 Sep 2021 13:03:54 GMT

@Kiddo you either need to get the md5 of all the records or you could collect it for the concatenated form of all the column names in a table.

e.g.

select md5(concat(col1,col2)) from table1;

or.

select md5(concat(*)) from (SELECT collect_list(column_name) as col_name from information_schema.columns where table_schema='db1' and table_name='table1')e;

Hope this answers your question.