tf-idf-similarity
A Ruby gem for calculating text similarity using tf*idf and BM25 vector space models.
What is tf-idf-similarity?
tf-idf-similarity is a Ruby gem that calculates the similarity between texts using a bag-of-words Vector Space Model with tf*idf weights. It implements the same tf*idf formula used by Lucene, Sphinx, and Ferret, providing a reliable way to compare documents based on term importance. The library also supports the Okapi BM25 ranking function and integrates with faster matrix libraries like NArray for performance.
Ruby developers working on information retrieval, text analysis, or natural language processing projects who need to compute document similarities. It's particularly useful for those building search engines, recommendation systems, or content analysis tools.
Developers choose tf-idf-similarity because it accurately implements the tf*idf formula used by major search engines, which was missing in other Ruby gems at its creation. It offers flexibility with custom tokenization, support for multiple matrix libraries for speed, and includes both tf*idf and BM25 models.
Overview
Ruby gem to calculate the similarity between texts using tf*idf
Use Cases
Best For
- Building custom search engines with document similarity scoring
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
