Support Questions

Find answers, ask questions, and share your expertise
Check out our newest addition to the community, the Cloudera Data Analytics (CDA) group hub.

Airflow and Atlas integration

Expert Contributor

Did anyone try to configure Airflow for sending lineage metadata to Atlas?

I try to configure by this instruction:

But in Atlas web ui I see nothing about Airflow when try to search by type.

I have kerberized cluster HDP 2.6.5 and Airflow 1.10.2





@Ruslan Fialkovsky

How did you install the Airflow, I would think you need the Ambari integration for it to work.

Have a look at this git Apache Airflow management pack for Ambari after the integration and configuration that's when I think you can see the lineage in Atlas.

If you use Ambari it will generate automatically the Kerberos principal and keytab !!

Expert Contributor
@Geoffrey Shelton Okot

I tried to install airflow by airflow-mpack but it contain many bugs. I installed airflow and generated keytab by myself it works fine.

I found some information on airflow issue tracker about this problem:

In fact lineage transmission isn't working now.


@Ruslan Fialkovsky

There is a patch attached did you update your code?

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.