Data Integration
Showing 36 of 81 projects
An open-source data platform that integrates proprietary, licensed, and public financial data sources for analysts, quants, and AI agents.
A system for building agents that perform automated tasks online, like a self-hosted IFTTT or Zapier.
A platform to programmatically author, schedule, and monitor workflows as code.
A platform to programmatically author, schedule, and monitor workflows as code.
An open-source query engine for AI analytics that builds self-reasoning agents across live data sources without ETL.
A distributed event streaming platform for building high-performance data pipelines, streaming analytics, and data integration.
Open-source data integration platform for building ELT pipelines from APIs, databases, and files to data warehouses, lakes, and lakehouses.
A highly scalable and reliable MQTT broker platform for AI, IoT, IIoT, and connected vehicles, supporting multiple protocols and real-time data integration.
A low-latency platform for change data capture (CDC) that streams row-level changes from databases to applications.
A high-performance, resilient stream processor that connects various sources and sinks, performs data transformations, and guarantees at-least-once delivery.
A high-performance, declarative stream processor that connects various sources and sinks with built-in data transformation capabilities.
An open-source ETL (Extract, Transform, Load) tool for data integration and migration.
Open-source data pipelines to sync cloud infrastructure metadata from AWS, Azure, GCP, and 70+ sources into your data warehouse.
Open-source data pipelines for cloud asset inventory, CSPM, FinOps, and vulnerability management across AWS, Azure, GCP, and 70+ sources.
A real-time data integration platform that creates and continually updates consistent views of transactional data using SQL.
An open data lakehouse platform for incremental data processing with upserts, deletes, and time-travel queries.
An easy-to-use, powerful, and reliable system to process and distribute data across cybersecurity, observability, and AI pipelines.
A CLI tool and dataflow engine that lets you query and join data from multiple databases and file formats using SQL.
A distributed data streaming engine with stateful stream processing for building responsive data-intensive applications.
A lean distributed data streaming engine and stream processing framework written in Rust for building responsive data-intensive applications.
A lightweight, fast, and beautiful database management tool with AI-powered chat interface for PostgreSQL, MySQL, SQLite, MongoDB, Redis, and more.
A Python library using machine learning for accurate and scalable fuzzy matching, record deduplication, and entity resolution on structured data.
An open-source, privacy-focused customer data platform (CDP) that collects, processes, and routes event data to warehouses and tools.
A CLI tool to copy data between any databases and platforms with a single command, no code required.
A curated list of awesome ETL frameworks, libraries, and software for data integration and pipeline development.
An open-source data IDE for developers to query, script, and visualize data from databases, files, and APIs.
A declarative code-first data integration engine that unlocks 600+ APIs and databases, eliminating the need to write and maintain custom API integrations.
A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.
A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.
Native integration library for using Elasticsearch with Hadoop, Spark, and Hive for real-time search and analytics on big data.
A parallel bulk data loader that transfers data between various storages, databases, NoSQL, and cloud services via plugins.
A Python library for deep probabilistic modeling and analysis of single-cell and spatial omics data.
An open-source Reverse ETL platform for syncing data from warehouses to business tools like Salesforce, HubSpot, and Slack.
An open-source, multi-tenant platform for self-building knowledge graphs and simulation.
A lightweight, high-performance, embedded, component-based rule engine framework for Go, enabling dynamic orchestration of business logic.
A one-stop, full-scenario integration framework for massive data, supporting data ingestion, synchronization, and subscription.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.