Data Compression
Showing 24 of 60 projects
An extremely minimal Huffman encoder/decoder with zero library dependencies, designed for embedded systems.
A command-line tool that reduces GeoJSON file size by trimming coordinate precision, removing whitespace, and optionally stripping properties.
A multi-core stream processing engine for high-throughput window aggregation with optional exactly-once fault tolerance.
A low-memory, DEFLATE-inspired lossless compression library optimized for embedded and resource-constrained environments.
A pure and safe Rust implementation of the Brotli decompression algorithm.
Erlang bindings for the LZ4 compression algorithm, providing fast lossless compression capabilities.
A pure PHP library for reading and writing Parquet columnar storage files without external dependencies.
A Pascal library for encoding binary data into strings using base32, base85, base128, and other custom-base algorithms for FPC and Delphi.
Extensible binary data format designed for speed, safety, and backward compatibility, offering a faster alternative to JSON.
A high-performance, RocksDB-based capture index server for web archives, supporting OpenWayback and PyWb protocols.
A Go implementation of the Elias-Fano encoding for efficient integer sequence compression.
An ultra-high-performance RPC framework using FlatBuffers and D language, designed for simplicity and speed.
A compact binary serialization library for LuaJIT written in Moonscript, enabling efficient data storage and transmission.
Pure OCaml implementation of libXdiff for generating binary diffs, used by ocaml-git for storage optimization.
A portable fork of LZSSE compression codec using SIMDe to enable SSE4.1-based compression/decompression on non-SSE4.1 CPUs and other architectures.
A WebAssembly implementation of gzip compression and decompression for Deno.
A MicroPython wrapper for FastLZ, providing lightning-fast lossless compression on embedded systems.
A lightweight compression algorithm for Lua source code using Huffman coding and LZ77 on language tokens.
A Go package implementing prefix code variable-length unsigned integer encoding for efficient serialization of small values.
Java-based web archive deduplication tool that identifies duplicates and converts them to reference records in WARC files.
A Go library for compressing unit vectors into space-efficient packed formats for storage and transmission.
Ada 2005 binding for the liblzma data compression library, providing a zlib-like API.
Huffman encoding and decoding library for Elixir, optimized for compressing repetitive binary data.
A MessagePack serialization library optimized for MicroPython, offering compact binary data exchange with minimal RAM usage.
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.