im looking for a little guidance, i have a requirement to load column/field level descriptions of CSV files so they are searchable. As a bit of context we will usually create external hive tables on top of these files for use by our analysts.
Is there a way to load this business metadata into navigator? we have full descriptions available from a copybook or metadata sheet, i was assuming i could write some service to call the navigator API to set these values for each column but i cannot see any documentation on how i might be able to do this.
Can someone help?
Take a look at the API tutorial, it shows how to query entities in Navigator and how to apply metadata to them.
Start by crafting a query that selects the column you are interested. The Cloudera Navigator web UI is useful for this, make sure to click on show full query for a hint as to the query you can pass to the API. If for example you wanted to get the column 'orders' from the table 'c_customers' in database 'default':
+originalName:orders +parentPath:"/default/c_customers" +type:Field +sourceType:Hive +deleted:False
Using +deleted:False in your query ensures you get the current entity and not a previously deleted one. Once your familiar with finding the column you want to tag you can make a PUT request to upload the desired metadata. How to do this is covered in the documentation link I included above.