StringZilla
A high-performance string library leveraging SIMD and SWAR to accelerate search, hashing, sorting, and edit distances across C, C++, Python, Rust, and more.
What is StringZilla?
StringZilla is a high-performance string library that accelerates common string operations like search, hashing, sorting, and edit distances using SIMD and SWAR techniques. It provides up to 100x faster performance than standard libraries by leveraging modern CPU and GPU hardware, addressing the inefficiencies of libc and STL across multiple programming languages.
Data engineers parsing large datasets (e.g., CommonCrawl), software engineers optimizing string-heavy applications, bioinformaticians, search engineers, DBMS developers, and hardware designers needing efficient string-processing baselines.
Developers choose StringZilla for its unmatched speed, cross-language consistency, and extensive functionality beyond standard libraries, including Unicode support, batch processing, and memory-efficient operations, making it ideal for high-throughput string processing.
Overview
Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖
Use Cases
Best For
- Parsing and searching multi-gigabyte textual datasets like CommonCrawl or RedPajama
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
