Marquez
An open-source metadata service for collecting, aggregating, and visualizing data lineage and ecosystem metadata.
What is Marquez?
Marquez is an open-source metadata service that collects, aggregates, and visualizes metadata for data ecosystems. It solves the problem of tracking data lineage and understanding dependencies between datasets and jobs, providing visibility into data workflows and centralizing dataset lifecycle management.
Data engineers, data platform teams, and organizations managing complex data pipelines who need to track data provenance, monitor job performance, and ensure data governance.
Developers choose Marquez for its adherence to the OpenLineage standard, offering a vendor-neutral, interoperable solution for metadata collection with a rich Web UI for lineage visualization and comprehensive APIs for integration.
Overview
Collect, aggregate, and visualize a data ecosystem's metadata
Use Cases
Best For
- Tracking data lineage across ETL/ELT pipelines
- Visualizing dependencies between datasets and jobs
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
