Created 02-10-2016 11:26 PM
Created 02-10-2016 11:34 PM
It's a really good question.
See this https://blogs.apache.org/falcon/tags/hive
If you meant that you want to store hive tables definitions , columns and data types etc then you can leverage atlas
https://community.hortonworks.com/questions/2081/atlas-tutorials-and-examples.html
Or you can design your own system using search like solr , drop hive table information in solr index , integrate with banana or Kibana and start searching but you have to be very creative about this process
Created 02-10-2016 11:34 PM
It's a really good question.
See this https://blogs.apache.org/falcon/tags/hive
If you meant that you want to store hive tables definitions , columns and data types etc then you can leverage atlas
https://community.hortonworks.com/questions/2081/atlas-tutorials-and-examples.html
Or you can design your own system using search like solr , drop hive table information in solr index , integrate with banana or Kibana and start searching but you have to be very creative about this process
Created 02-11-2016 03:22 PM
but where does falcon save the metadata and who all can access it? atlas is not a full fleged tool yet right?@Neeraj Sabharwal
Created 02-11-2016 03:34 PM
@khushi kalra Atlas and Hive hook works. Take a look on this tutorial please...you can see that all the tags are defined in xml http://hortonworks.com/hadoop-tutorial/defining-processing-data-end-end-data-pipeline-apache-falcon/