After running analyze commands to create column level statistics I cannot see them. Running describe after the analyze command yields nothing in the describe command. Is there some configuration or set command I need in order to persist these column level stats?
Assuming following is true:
In hive-site.xml, hive.stats.autogather is set to true and you ran ANALYZE TABLE <table_name> COMPUTE STATISTICS. To compute column level stats, run the following:
analyze table t [partition p] compute statistics for [columns c,...];
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_performance_tuning/content/hive_perf_bes... ---> document on how to collect column level stats.
to view statistics
Run "DESCRIBE EXTENDED <Table name>;" or "DESCRIBE FORMATTED <Table name>;"
This is for table level stats or both table and column level stats? I am trying to collect/view column level stats.