Support Questions
Find answers, ask questions, and share your expertise

Is there any article showing Apache Storm metadata getting stored to Atlas ?

Explorer

It would be really helpful to see end to end custom topology reporting the per message, DAG stats and lineage to the atlas.

3 REPLIES 3

Re: Is there any article showing Apache Storm metadata getting stored to Atlas ?

Super Collaborator

I am not sure, somehow i guess you already came across this doc: https://atlas.apache.org/Hook-Storm.html ?

Re: Is there any article showing Apache Storm metadata getting stored to Atlas ?

Super Collaborator

Re: Is there any article showing Apache Storm metadata getting stored to Atlas ?

Explorer

@Harald Berghoff Thanks for replying. Yes, I have followed the link for integration but I am unable to see any metrics for the custom-exclamation storm topology. The blog says:

  • The Hook currently does not support capturing lineage for custom spouts and bolts.

Can you elaborate on this? Which DAG in storm default repo will be suitable to test the integration.