Support Questions

Find answers, ask questions, and share your expertise

The "Lineage" tab in the UI disappears when creating my own DataSet and Process types

avatar
Explorer

Issue: The lineage tab in the UI disappears when creating my own DataSet and Process types.

Details: Because I don’t want to inherit all the relationship attributes from DataSet, I would like to create my own custom, My_DataSet that inherits directly from Asset, just the same the Atlas’ buil-in one.

Also, because of the relationships defined between DataSet and Process, I also created my own process type, say My_Process and therefore linked the new types through the new, 

my_dataset_process_inputs and 

my_process_dataset_outputs.

These relationships, just like the buil-in Atlas’ ones tie together the relationships attributes My_DataSet.inputToProcesses, My_DataSet.inputFromProcesses to My_Process.inputs and My_Process.outputs. So just like Atlas, the only difference, less relationship attributes in the My_DataSet definition, as mentioned before.

Back to the issue, now I don’t see the “Lineage” tab in the UI. The relationships between actual entities, when created, are shown properly, but lineage capability, appears to be gone.

Questions:

1. I wonder if Atlas relies on its own, dataset_process_inputs and 

process_dataset_outputs, with these exact names to infer the concept of lineage?

 

2. If the above is true, I would think that somehow I should be able to tell Atlas that my own, my_dataset_process_inputs and my_process_dataset_outputs should also be used to make lineage available? 

If this won’t be possible, it would be very constraining. Should be able to create a custom model, one would think. Hopefully it is not the case.

I would appreciate any education/advise you could provide.

 

Thanks in advance!

 

7 REPLIES 7

avatar
Community Manager

@Heli Welcome to the Cloudera Community!

To help you get the best possible solution, I have tagged our Atlas experts @Scharan @cravani  who may be able to assist you further.

Please keep us updated on your post, and we hope you find a satisfactory solution to your query.


Regards,

Diana Torres,
Senior Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Explorer

Thank you Diana, really appreciated!

New to the community and looking forward to learn.

avatar
Explorer

 Hi @Scharan and @cravani,

I would very much appreciate if you could assist please?

Thank you.

avatar
Explorer

Hi, does anybody know the answer to my question? I understand it may not be a trivial question, but I thought the experts here may have an idea.

@DianaTorres, would you know of anybody else who would be able to help?

If there is a more appropriate forum/community, I should post this question, please share it.

Thanks.

avatar
Community Manager

Hi! @pvishnu @mayank_gupta Do you have any insights here? Thanks!


Regards,

Diana Torres,
Senior Community Moderator


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Explorer

Hi @pvishnu, @mayank_gupta

I would really appreciate if you could help. 

Thanks in advance.

@DianaTorres, thank you for trying, it is a little disappointing nobody bothers to give this a try. Oh well, it is what it is! thanks again Diana. At this point I won't get my hopes up.

avatar
Explorer

Forgot to mention, is there something I said that rendered no responses? My apologies if that's the case, didn't think I ofended anybody.