Import-first workflow
Most teams already have metadata in dbt or Airflow. DataXPipe imports manifests and DAGs to bootstrap the catalog, then lets you tighten contracts with validated YAML specs.
Pipeline spec format →Category guide
Data pipeline catalog
Register every pipeline, trace dataset lineage, and enforce quality checks from one API — without replacing dbt or Airflow.
Why teams need a pipeline catalog
Spreadsheets and wiki pages drift. A data pipeline catalog gives engineers a single source of truth: which jobs exist, what tables they touch, and what failed last night.
DataXPipe is built for teams who want catalog coverage without a six-month enterprise rollout.
- ✓
Pipeline identity
Name, environment, owner, and schedule.
- ✓
Sources & targets
Datasets with types and connection references.
- ✓
Lineage edges
From → to relationships with pipeline attribution.
- ✓
Quality checks
Freshness, volume, schema, and custom SQL.
- ✓
Run history
Status and timing per orchestrator execution.
Observability on top
A catalog alone does not prevent incidents. DataXPipe adds check results tied to runs, Slack and email alerts, an interactive lineage graph, and AI explanations with blast radius.
Open lineage explorer →Pipeline catalog FAQ
How DataXPipe fits the metadata catalog category.
What is a data pipeline catalog?+
A pipeline catalog is a registry of data pipelines: their sources, targets, schedules, quality checks, and lineage edges. Unlike a general data catalog, it is optimized for operational metadata — what runs, what it depends on, and whether checks passed.
How does DataXPipe build a pipeline catalog?+
Import a dbt manifest.json or Airflow DAG, upload a YAML pipeline spec, or discover Postgres tables. DataXPipe validates specs, stores catalog JSON via a REST API, and exposes lineage queries per dataset.
Pipeline catalog vs metadata catalog?+
A metadata catalog (Collibra, Alation) focuses on governance and business glossary. A pipeline catalog focuses on operational contracts: checks, runs, lineage between datasets, and CI validation of specs before deploy.
Start your catalog today
Free tier includes 2 pipelines. Import dbt or Airflow in the guided setup.