colibri-core
A C++ and Python library for efficient extraction and analysis of n-grams, skipgrams, and flexgrams from large corpora.
What is colibri-core?
Colibri Core is an NLP tool and library for extracting and analyzing linguistic patterns like n-grams, skipgrams, and flexgrams from large text corpora efficiently. It solves the problem of high memory usage in traditional pattern extraction by using compressed representations and intelligent counting algorithms. The core tool, colibri-patternmodeller, allows users to build, query, and manipulate pattern models with various statistical insights.
Computational linguists, NLP researchers, and data scientists working with large text datasets who need efficient pattern extraction and analysis. It is also suitable for developers building linguistic analysis tools or integrating pattern modeling into applications.
Developers choose Colibri Core for its memory-efficient design, which enables processing of large corpora without prohibitive resource demands. Its support for advanced pattern types (skipgrams and flexgrams) and indexed models for detailed statistics offers more insights than basic n-gram tools.
Overview
Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool colibri-patternmodeller whi ch allows you to build, view, manipulate and query pattern models.
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
