Add metadata automatically

[#1]

Hello,

I am searching a way to do this :

On HDFS, new datas arrived on a certain folder, and in the datas, there could be metadatas like names, emails, that are defined, and I would like a way to use these metadas to class my datas.

I know that you can define tags on Falcon, but it is not automatically.

Is there a way to automatically use the metadatas that are in a file, as to transfer them to falcon or another tools ? The goal is to use a Search tool (like there is in falcon).

[#2 · Accepted solution]

@Arthur GREVIN

Take a look on this https://community.hortonworks.com/content/repo/5240/hadoop-data-pipeline-using-falcon.html

Atlas is the solution for this but as of now, there is hook for hive only. HDFS work is in progress.

[#3]

Thank you for your answer.