stemmer
An English (Porter2) stemming implementation in Elixir for reducing words to their base forms.
What is stemmer?
Stemmer is an Elixir library that implements the Porter2 stemming algorithm for English text. It reduces inflected or derived words to their base stem forms, which is crucial for improving search relevance and text analysis in natural language processing applications.
Elixir developers working on natural language processing, information retrieval systems, or text analysis tools that require word normalization.
Developers choose Stemmer for its 100% compatibility with the official Porter2 algorithm, simple API, and native Elixir implementation, making it a reliable and efficient choice for stemming tasks within the Elixir ecosystem.
Overview
An English (Porter2) stemming implementation in Elixir.
Use Cases
Best For
- Building search engines that require word normalization for better query matching
- Text classification and sentiment analysis projects needing word stem reduction
- Implementing natural language processing pipelines in Elixir applications
- Enhancing information retrieval systems by standardizing word forms
- Supporting machine learning libraries like Simple Bayes with text preprocessing
- Creating linguistic analysis tools for English text processing
Not Ideal For
- Applications requiring stemming for languages other than English
- Projects needing lemmatization for more accurate word normalization than stemming provides
- Systems with high-performance, real-time text processing demands where algorithm efficiency is critical
- Developers not using the Elixir programming language
Pros & Cons
Pros
Ensures 100% compatibility with the official Porter2 implementation, rigorously tested against over 29,000 words for accuracy as stated in the README.
The `stem/1` function handles single words, sentences, and lists seamlessly, making integration straightforward for various text processing tasks.
Built specifically for Elixir, offering idiomatic usage and easy pairing with other Elixir libraries like Simple Bayes, as mentioned in the README.
Extensive testing and coverage ensure consistent stemming performance, backed by Travis CI and Coveralls badges showing active maintenance.
Cons
Exclusively supports English stemming, making it ineffective for multilingual projects without supplementary tools or libraries.
Implements Porter2, a rule-based algorithm that can produce non-word stems and lacks advanced NLP features like lemmatization or part-of-speech tagging.
Tied to Elixir, so it cannot be directly used in non-Elixir environments, limiting flexibility for cross-language or polyglot projects.
Frequently Asked Questions
Related Projects
HuggingFace Transformers🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
jieba结巴中文分词
spacy💫 Industrial-strength Natural Language Processing (NLP) in Python
HaystackOpen-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.