On HDP 3.x, the entity metadata information is corrupted after adding a new column to an external table with a primary key.
The primary key information (DESCRIBE FORMATTED table) doesn't contain the column name, and consequently, the driver functionality, DatabaseMetaData getColumns fails/returns empty results for the table.
Primary Key info before adding column:
==============================
Primary Key # Primary Key Table:
shelly_landing.test2 Constraint Name: pk_203965851_1605696431587_0
Column Name: employeeid
Primary Key info after adding column:
=============================
Primary Key # Primary Key Table:
shelly_landing.test2 Constraint Name: pk_203965851_1605696431587_0
Column Name: <-- empty field -->
This bug was fixed in Apache Hive 3.1.3000, however, the latest version of HDP 3.x is 3.1.5 and it still contains the Apache Hive 3.1.0
Any chance that the next version of HDP 3.x will contain this fix?