Text Processing
Showing 36 of 424 projects
A high-performance Porter2 stemmer implementation using finite state machines for suffix comparison.
A Go library implementing a space-optimized prefix tree (trie) for efficient string key operations and serverless-friendly serialization.
A Go library for one-way Unicode to ASCII text transliteration with language-specific rules.
A Pawn plugin that adds regular expression support with match group extraction capabilities.
Replace homoglyphs with base characters to detect similar-looking strings, useful for preventing impersonation.
A UNIX command line utility for parsing and formatting CSV files using printf-style syntax.
Elixir library for inflecting Russian first, last, and middle names into grammatical cases.
A highly configurable translation plugin for Neovim with multiple input/output methods and async translation engines.
A Go library and CLI tool that extracts popular tags from HTML, Markdown, or plain text documents in multiple languages.
Go binding (cgo wrapper) for the Snowball stemming library, providing word stem extraction for multiple languages.
A Ruby gem for calculating text readability statistics, complexity metrics, and grade levels across 22 languages with high performance.
A multilingual Rust implementation of the RAKE algorithm for automatic keyword extraction from text.
OCaml bindings to the PCRE library, providing Perl-compatible regular expressions for string matching.
A non-blocking streaming Unicode codec for OCaml supporting UTF-8, UTF-16, UTF-16LE, and UTF-16BE encoding schemes.
A Go library for converting strings into URL-friendly slugs with Unicode support.
A Ruby interface to the Hunspell spell checker library for building spell-checking applications.
A high-performance Delphi library for Unicode text conversion, comparison, and case transformation supporting 50 encodings.
A live-updating version of the UNIX wc command that updates counts in real-time as it processes input.
A CSV reading and writing library for Elixir that operates on files or strings.
A Julia package providing lazy-loading iterators for various NLP corpora with automatic data dependency management.
This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).
A fast HTML parser for Free Pascal and Delphi that enables DOM-like element access without regular expressions.
A CMake module for finding and linking against the International Components for Unicode (ICU) library.
A Go implementation of multi-string pattern matching using Trie data structures, inspired by the Aho-Corasick algorithm.
A Rust crate for generating n-grams from token sequences with Unicode padding support.
A Go library for parsing and generating fixed-width file formats with struct-based mapping.
Elixir wrapper for erlang-mbcs providing character encoding conversion functions for various code pages.
A high-performance Aho-Corasick multi-pattern string matching library for Go, achieving up to 7 GB/s throughput with zero allocations.
A human-friendly OCaml regex library providing an easy interface for common string operations without C dependencies.
An Elixir library for converting Chinese characters to pinyin with tone support.
A Common Lisp package for parsing decimal strings into rational numbers and formatting numbers with extensive customization.
An OCaml library for Unicode text normalization supporting all Unicode normalization forms.
An OCaml library implementing Unicode text segmentation algorithms for grapheme cluster, word, sentence, and line break detection.
A PHP parser for Djot, a modern light markup language with extensible rendering and advanced features.
Remove or replace part of a string with emoji-aware splicing, similar to Array#splice.
An OCaml library providing efficient access to Unicode character properties from the Unicode character database.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.