Member since
02-09-2023
1
Post
0
Kudos Received
0
Solutions
08-05-2025
01:41 PM
Hello @suri07 To support search filtering across both vertex and edge attributes in Apache Atlas without breaking compatibility: Denormalize the edge attribute into the vertex during ingestion. Add needed relationship info (like producer process type, owner, etc.) as attributes on the entity itself. Use /v2/entity/bulk to ingest this during lineage creation. Bonus: Automating This If you're using a metadata ingestion pipeline (e.g., from Airflow, Glue, custom ETL): Fetch related entities' properties. Inject them as attributes during entity creation. Keep a mapping logic (e.g., process’s jobType → dataset’s producing_job_type).
... View more