A fast, secure, and standalone log collector written in Rust that parses, validates, and forwards log data.
Flowgger is a fast, simple, and lightweight log data collector written in Rust. It reads log entries over various protocols, decodes them from multiple formats, and asynchronously forwards them to remote data stores or other collectors. It is designed to solve the problem of high-performance, secure log aggregation with minimal dependencies.
DevOps engineers, SREs, and backend developers who need a performant and secure log collector for infrastructure monitoring, especially those seeking an alternative to heavier tools like Logstash or Fluentd.
Developers choose Flowgger for its combination of high performance, memory safety due to being written entirely in safe Rust, and standalone deployment as a single executable without JVM dependencies. Its paranoid validation ensures data integrity, making it a robust choice for critical log processing pipelines.
A fast data collector in Rust
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Benchmarked as orders of magnitude faster than Logstash and Fluentd, even with systematic parsing and validation, making it ideal for high-throughput log aggregation.
Written entirely in safe Rust without any unsafe code, ensuring reliability and security against common vulnerabilities like buffer overflows.
Distributed as a single executable file with no JVM or complex runtime dependencies, perfect for resource-constrained deployments and easy installation.
Implements paranoid validation to prevent malformed or incomplete log records from propagating downstream, ensuring data integrity in critical pipelines.
Version 0.3.0 introduced breaking changes, such as migrating date handling libraries, which can disrupt existing configurations and signals ongoing development instability.
Has a smaller set of built-in inputs, outputs, and formats compared to mature alternatives like Logstash, restricting flexibility for complex log processing and integration needs.
Relies on a separate wiki for full documentation, which may be incomplete or less maintained, increasing the learning curve and setup time for new users.
jedisct1/flowgger is an open-source alternative to the following products:
Logstash is an open-source data processing pipeline that ingests data from multiple sources, transforms it, and sends it to a destination like Elasticsearch for storage and analysis.
Fluentd is an open-source data collector for unified logging layers, designed to unify data collection and consumption for better use and understanding of data.