- Microsoft Purview tracks lineage from:
- ADF pipelines and datasets
- Synapse tables
- Snowflake external tables / views
- Lineage is used to:
- Answer "where did this number come from?"
- Assess impact of schema changes.
- Azure Monitor / Log Analytics capture:
- Pipeline run metrics (success/failure, duration).
- Custom metrics for latency and DQ pass rate.
- Dashboards show:
- p95/p99 latency for streaming and batch.
- DLQ volumes.
- Error rates per pipeline.
Alerts are configured on key SLO thresholds; see RUNBOOK.md for how to respond.