10-22-2018 04:40 AM - last edited on 10-22-2018 06:54 AM by cjervis
I can see control flow in lineage diagrams for Hive and Impala operations.
Are there any other sources which can provide the same?
Is it possible to see control flows for jobs executed by Spark or Yarn?
10-23-2018 10:01 AM
When configured correctly, lineage diagrams for Spark and Yarn should be visible under Navigator's Search Tab -> Source Type -> Spark -> (Select Yarn application number) -> (Select Lineage Tab).
If you do not see the Spark Source Type, then check to see if Spark is configured to allow Navigator auditing by doing the following:
1. Go to Cloudera UI.
2. Select Spark Service -> Configuration -> Cloudera Navigator.
3. For the "Enable Lineage Collection" property, select the checkbox to enable the property.