awesome-data-engineering
A curated list of data engineering tools, frameworks, databases, and resources for software developers.
What is awesome-data-engineering?
Awesome Data Engineering is a curated GitHub repository listing tools, frameworks, databases, and resources for data engineering. It helps software developers and data practitioners discover and evaluate technologies for building data pipelines, processing systems, and infrastructure. The list is organized by category, covering everything from data ingestion and storage to workflow orchestration and monitoring.
Data engineers, data architects, software developers building data-intensive applications, and anyone involved in designing or maintaining data infrastructure who needs a reference for available tools and best practices.
It saves significant research time by providing a single, community-vetted directory of the data engineering ecosystem. Unlike commercial directories, it is open-source, frequently updated, and includes both established and emerging technologies without vendor bias.
Overview
A curated list of data engineering tools for software developers
Use Cases
Best For
- Discovering new data engineering tools and frameworks
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
