question Hi Neeraj can you please help me with apache falcon . my data is in hive how can i tag it and where should i save the metadata in falcon?not the data but metadata in Archives of Support Questions (Read Only)

Hi Neeraj can you please help me with apache falcon . my data is in hive how can i tag it and where should i save the metadata in falcon?not the data but metadata

khushikalra_060 — Thu, 11 Feb 2016 07:26:33 GMT

@Neeraj Sabharwal

Re: Hi Neeraj can you please help me with apache falcon . my data is in hive how can i tag it and where should i save the metadata in falcon?not the data but metadata

nsabharwal — Thu, 11 Feb 2016 07:34:40 GMT

@khushi kalra

It's a really good question.

See this https://blogs.apache.org/falcon/tags/hive

If you meant that you want to store hive tables definitions , columns and data types etc then you can leverage atlas

https://community.hortonworks.com/questions/2081/atlas-tutorials-and-examples.html

Or you can design your own system using search like solr , drop hive table information in solr index , integrate with banana or Kibana and start searching but you have to be very creative about this process

Re: Hi Neeraj can you please help me with apache falcon . my data is in hive how can i tag it and where should i save the metadata in falcon?not the data but metadata

khushikalra_060 — Thu, 11 Feb 2016 23:22:36 GMT

but where does falcon save the metadata and who all can access it? atlas is not a full fleged tool yet right?@Neeraj Sabharwal

Re: Hi Neeraj can you please help me with apache falcon . my data is in hive how can i tag it and where should i save the metadata in falcon?not the data but metadata

nsabharwal — Thu, 11 Feb 2016 23:34:06 GMT

@khushi kalra Atlas and Hive hook works. Take a look on this tutorial please...you can see that all the tags are defined in xml http://hortonworks.com/hadoop-tutorial/defining-processing-data-end-end-data-pipeline-apache-falcon/