oplog
A generic oplog/replication system for microservices providing real-time data synchronization between producers and consumers.
What is oplog?
OpLog is a generic oplog and replication system for microservices that provides real-time data synchronization between a producer and multiple consumers. It solves the problem of keeping independent components, such as search engines or recommendation systems, updated with changes from an authoritative database without tight coupling. The system uses MongoDB to store operation logs and exposes a Server-Sent Events API for streaming updates.
Developers building microservices architectures that require real-time data replication, such as those implementing search indexing, multi-region deployments, or public streaming APIs. It is also suitable for teams needing to decouple data producers from consumers in event-driven systems.
OpLog offers a lightweight, self-hosted alternative to commercial replication tools, with built-in support for real-time streaming via SSE, full replication for bootstrapping, and periodic synchronization to ensure data consistency. Its design avoids storing actual data, keeping the source API as the gatekeeper for authentication and authorization.
Overview
A generic oplog/replication system for microservices
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
