About Nigal

Nigal · ‎12-01-2022

Hi @pkr , Thanks for the solution. Much Appreciated

Nigal · ‎12-01-2022

Hi, There is a process flow in Nifi as shown below. Figure 1 And the corresponding lineage of the above process flow is reported in atlas as shown below I want to know how the linking is created between nifi-test and ConsumekafkaRecord in atlas lineage as shown below (highlighted one) since both are two separate process flows in Nifi. Any help is much Appreciated. Thanks

Nigal · ‎11-30-2022

Thanks for the solution . But this point i did'nt get clearly "hdfs_path is synced only if this belongs to a Hive table's lineage" . What i understood from this is that since hive runs on top of HDFS and on creating hive lineage, the lineage will show the HDFS path of hive warehouse directory. Is that correct?

Nigal · ‎11-29-2022

I want to collect the metadata from HDFS. But when i searched , it looks like there is no atlas hook for HDFS available like it is there for kafka , hive and other data sources. Can I get the HDFS hook install steps or the steps to create a custom hook.

Nigal · ‎11-29-2022

Hi, I have set up Nifi - Atlas lineage. I have routetoattribute processor in my workflow. When the lineage is reported the flow is getting broken at routetoattribute processor as two separate flow paths in atlas. And the complete lineage is not visible since. Can someone help on this.

Online	Offline
Last Visited	‎01-05-2023 02:01 AM

Member Since	‎11-29-2022 04:06 AM
Last Visited	‎01-05-2023 02:01 AM
Posts	5

Cloudera Community

Re: Apache Atlas - Unable to collect HDFS metadata

Nifi Atlas Lineage

Re: Apache Atlas - Unable to collect HDFS metadata

Apache Atlas - Unable to collect HDFS metadata

Apache Atlas - Unable to get complete lineage from...