Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Add metadata automatically

Solved Go to solution
Highlighted

Add metadata automatically

Hello,

I am searching a way to do this :

On HDFS, new datas arrived on a certain folder, and in the datas, there could be metadatas like names, emails, that are defined, and I would like a way to use these metadas to class my datas.

I know that you can define tags on Falcon, but it is not automatically.

Is there a way to automatically use the metadatas that are in a file, as to transfer them to falcon or another tools ? The goal is to use a Search tool (like there is in falcon).

1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted

Re: Add metadata automatically

@Arthur GREVIN

Take a look on this https://community.hortonworks.com/content/repo/5240/hadoop-data-pipeline-using-falcon.html

Atlas is the solution for this but as of now, there is hook for hive only. HDFS work is in progress.

View solution in original post

2 REPLIES 2
Highlighted

Re: Add metadata automatically

@Arthur GREVIN

Take a look on this https://community.hortonworks.com/content/repo/5240/hadoop-data-pipeline-using-falcon.html

Atlas is the solution for this but as of now, there is hook for hive only. HDFS work is in progress.

View solution in original post

Re: Add metadata automatically

Thank you for your answer.

Don't have an account?
Coming from Hortonworks? Activate your account here