Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Data Compression

Data Compression

60 projects

Showing 36 of 60 projects

zstd
zstdC

A fast lossless compression algorithm targeting real-time scenarios with zlib-level or better compression ratios.

#c-library#rfc-8878#zlib-alternative
Stars27.5k
Forks2.5k
Last commit23 days ago
brotli
brotliTypeScript

A generic-purpose lossless compression algorithm offering dense compression at speeds comparable to deflate.

#bandwidth-optimization#stream-compression#lz77
Stars14.8k
Forks1.4k
Last commit21 hours ago
LZ4
LZ4C

An extremely fast lossless compression algorithm offering speeds over 500 MB/s per core with a high-speed decoder.

#c-library#multi-core#embedded-systems
Stars12.0k
Forks1.6k
Last commit23 days ago
πfs
πfsC

A filesystem that stores data by referencing positions in the mathematical constant π instead of using physical storage space.

#filesystem#pi-based#storage-innovation
Stars7.5k
Forks297
Last commit3 months ago
Draco
DracoC++

A library for compressing and decompressing 3D geometric meshes and point clouds to improve storage and transmission.

#geometry-processing#point-clouds#webassembly
Stars7.4k
Forks1.1k
Last commit22 days ago
topoJSON
topoJSONJavaScript

An extension of GeoJSON that encodes topology for efficient, compact geographic data representation.

#cartography#geojson#topojson-format
Stars4.9k
Forks683
Last commit1 year ago
SharpZipLib
SharpZipLibC#

A pure C# library for Zip, GZip, Tar, and BZip2 compression and decompression on the .NET platform.

#bzip2#tar#csharp
Stars3.9k
Forks1.0k
Last commit1 year ago
OpenZL
OpenZLC

A format-aware compression framework that generates specialized compressors for specific data formats, achieving high ratios with high speed.

#c-library#high-performance#universal-decompressor
Stars3.1k
Forks158
Last commit1 day ago
Miniz
MinizC++

A single C source file library implementing zlib compression, PNG writing, and ZIP archive manipulation with MIT licensing.

#c-library#zlib-replacement#png-writer
Stars2.8k
Forks414
Last commit23 days ago
msgpack
msgpackPython

A Python implementation of the MessagePack binary serialization format, providing fast and compact data exchange.

#msgpack#python-library#python
Stars2.1k
Forks253
Last commit4 days ago
zlib-ng
zlib-ngC

A modern, high-performance drop-in replacement for the zlib compression library, optimized for next-generation hardware.

#c-library#library#zlib-replacement
Stars2.1k
Forks334
Last commit3 days ago
LZFSE
LZFSEC

A Lempel-Ziv compression algorithm using Finite State Entropy coding for high-speed compression and decompression.

#apple#c-library#command-line-tool
Stars1.8k
Forks190
Last commit3 years ago
cstore_fdw
cstore_fdwC

A columnar storage extension for PostgreSQL built as a foreign data wrapper, optimized for analytics and data archival.

#database-extension#columnar-store#data-archival
Stars1.8k
Forks169
Last commit5 years ago
heatshrink
heatshrinkC

A data compression library for embedded and real-time systems with minimal memory usage.

#c-library#embedded-systems#low-memory
Stars1.5k
Forks230
Last commit2 years ago
FiniteStateEntropy
FiniteStateEntropyC

A high-speed entropy coding library featuring Huff0 (modern Huffman) and FSE (ANS-based) codecs for fast compression and decompression.

#c-library#huffman#huffman-coding
Stars1.5k
Forks162
Last commit2 years ago
minizip-ng
minizip-ngC

A modern, cross-platform C library for creating, reading, and modifying ZIP archives with extensive compression and encryption support.

#c-library#bzip2#zip-library
Stars1.5k
Forks498
Last commit10 days ago
Minizip
MinizipC

A modern, cross-platform C library for creating, reading, and modifying ZIP archives with extensive compression and encryption support.

#c-library#bzip2#zip-library
Stars1.5k
Forks498
Last commit10 days ago
Bitsery
BitseryC++

A header-only C++ binary serialization library optimized for speed, minimal size, and real-time networking.

#real-time-networking#binary-serialization#c-plus-plus
Stars1.3k
Forks101
Last commit9 months ago
bzip3
bzip3C

A better, faster, and stronger spiritual successor to BZip2, excelling at compressing text and code with higher compression ratios.

#code-compression#text-compression#multi-threading
Stars1.2k
Forks59
Last commit2 days ago
fpng
fpngC

A very fast single-file C++ PNG encoder/decoder for 24/32bpp images with no dependencies.

#encoder#png#graphics
Stars986
Forks66
Last commit1 year ago
rust-brotli
rust-brotliRust

A pure Rust implementation of the Brotli compression algorithm with optional no-stdlib support for embedded and kernel use.

#embedded#ffi#brotli-encoder
Stars935
Forks101
Last commit1 month ago
TokuMX
TokuMXC++

A high-performance, concurrent, compressing drop-in replacement engine for MongoDB built on Fractal Tree indexes.

#database-engine#concurrent-access#high-performance
Stars704
Forks96
Last commit8 years ago
tokudb-engine
tokudb-engineC++

A high-performance, write-optimized, compressing transactional storage engine for Percona Server and MySQL.

#fractal-tree-indexing#database-performance#mysql-storage-engine
Stars663
Forks128
Last commit10 years ago
JavaFastPFOR
JavaFastPFORJava

A high-performance Java library for compressing arrays of integers, optimized for databases and information retrieval.

#java-library#information-retrieval#high-performance
Stars569
Forks66
Last commit1 month ago
ZSON
ZSONC

A PostgreSQL extension that compresses JSONB data using a shared dictionary of frequent strings, saving disk space and memory.

#storage-efficiency#jsonb#extensions
Stars569
Forks22
Last commit3 years ago
xz
xzGo

Pure Go package for reading and writing xz-compressed files with a command-line tool included.

#pure-go#stream-compression#cli-tool
Stars559
Forks53
Last commit3 days ago
FastLZ
FastLZC

A fast, portable ANSI C implementation of LZ77 compression optimized for speed over ratio.

#c-library#intel#high-performance
Stars542
Forks103
Last commit2 years ago
snappy
snappyJavaScript

Node.js bindings for Google's Snappy compression library, providing fast compression and decompression.

#zlib-alternative#bindings#data-compression
Stars477
Forks45
Last commit5 years ago
PSON
PSONJavaScript

A super efficient binary serialization format for JSON, focused on minimal encoding size through dictionaries and varints.

#network-optimization#binary-serialization#protocol-buffers-alternative
Stars463
Forks32
Last commit8 years ago
qs
qsC

A fast R package for serializing and deserializing R objects to/from disk, designed as a drop-in replacement for saveRDS/readRDS.

#data-persistence#data-storage#lz4
Stars443
Forks24
Last commit8 months ago
ZXC
ZXCC

A high-performance asymmetric lossless compression library optimized for maximum decompression speed in game assets, firmware, and app bundles.

#c-library#asymmetric-compression#embedded-systems
Stars417
Forks9
Last commit7 days ago
streamvbyte
streamvbyteC

A fast C library for integer compression using SIMD-accelerated StreamVByte codec.

#c-library#database#simd
Stars417
Forks50
Last commit1 month ago
Kanzi
KanziC++

A modern, modular, and efficient lossless data compressor in C++ that combines multiple algorithms and multi-threading for high performance.

#modular-architecture#huffman#high-performance
Stars222
Forks11
Last commit5 days ago
topojson for Python
topojson for PythonPython

A Python library for encoding spatial data into the TopoJSON format, reducing file sizes through topology computation and simplification.

#geopandas#coordinate-encoding#python-library
Stars198
Forks28
Last commit1 year ago
gtfstidy
gtfstidyGo

A command-line tool for validating, cleaning, and minimizing GTFS transit feed files while preserving semantic equivalence.

#data-cleaning#validation#command-line-tool
Stars148
Forks21
Last commit8 days ago
compactr
compactrTypeScript

OpenAPI-based binary serialization library that reduces API payload size by up to 3.5x compared to JSON.

#binary-serialization#api-optimization#bandwidth-reduction
Stars108
Forks6
Last commit8 months ago
Page 1 of 2

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
Next
#Compression30
#Lossless Compression17
#C Library15
#Performance14
#High Performance9
#Serialization9
#Cross Platform8
#C7
#Lz776
#Embedded Systems6
#Embedded5
#C Plus Plus5