Data Deduplication
Showing 6 of 6 projects
A fast, encrypted, and deduplicated backup tool written in Rust, compatible with restic repositories.
A fast, memory-efficient command-line tool for finding and removing duplicate files with advanced filtering options.
A Ruby extension library implementing multiple algorithms for approximate string matching, searching, and comparison.
A cross-platform CLI tool for cleaning and improving text datasets for machine learning, with fast operations and LLM-based filtering.
A Go package for calculating Levenshtein distance and similarity metrics with customizable edit costs and prefix bonuses.
A Free Pascal port of FuzzyWuzzy for fuzzy string matching using Levenshtein distance algorithms.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.