- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
How does the linage diagram of Cloudera Navigator work?
- Labels:
-
Cloudera Navigator
Created 11-10-2016 08:17 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
How does the linage diagram of Cloudera Navigator work?
I mean, Cloudera Navigator draws the diagram because of Ozzie groups a set of actions (hive, pig, mapreduce, and so on) or CN is able to draw the diagram if you throw indepent and sequencial jobs that you execute, for example, manually
Created 12-02-2016 03:57 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, our documentation describes the behaviour of Oozie lineage at http://www.cloudera.com/documentation/enterprise/latest/topics/cn_iu_lineage.html.
For specifics, have you tried running Oozie workflows and examining them inside Navigator? If you don't have a license yet, you can always get a trial license from cloudera.com to try this out for yourself.
Hope this helps.
Created 12-02-2016 03:57 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi, our documentation describes the behaviour of Oozie lineage at http://www.cloudera.com/documentation/enterprise/latest/topics/cn_iu_lineage.html.
For specifics, have you tried running Oozie workflows and examining them inside Navigator? If you don't have a license yet, you can always get a trial license from cloudera.com to try this out for yourself.
Hope this helps.
Created 12-12-2016 10:19 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks Mark for your reply,
I was really asking about how is the method that Cloudera Navigator uses to generate the linage among different actions, I understand that Cloudera Navigators link each action (hive, spark) examining logs and what the action writes and what the action reads in HDFS.
But I am not sure.
Regards,
Created 12-12-2016 11:43 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Created on 12-13-2016 11:16 AM - edited 12-13-2016 11:16 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks I have executed some tests and I have seen how Lineage Graph works definitely
Created 05-29-2017 03:25 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content