Hi Neeraj can you please help me with apache falcon . my data is in hive how can i tag it and where should i save the metadata in falcon?not the data but metadata

[#1]

@Neeraj Sabharwal

[#2 · Accepted solution]

@khushi kalra

It's a really good question.

See this https://blogs.apache.org/falcon/tags/hive

If you meant that you want to store hive tables definitions , columns and data types etc then you can leverage atlas

https://community.hortonworks.com/questions/2081/atlas-tutorials-and-examples.html

Or you can design your own system using search like solr , drop hive table information in solr index , integrate with banana or Kibana and start searching but you have to be very creative about this process

[#3]

but where does falcon save the metadata and who all can access it? atlas is not a full fleged tool yet right?@Neeraj Sabharwal

[#4]

@khushi kalra Atlas and Hive hook works. Take a look on this tutorial please...you can see that all the tags are defined in xml http://hortonworks.com/hadoop-tutorial/defining-processing-data-end-end-data-pipeline-apache-falcon/