tactful_tokenizer

Ruby

80 stars13 forks0 contributors

Overview

Accurate Bayesian sentence tokenizer in Ruby.

Community-curated · Updated weekly · 100% open source

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

12 years ago

CreatedSince 2010

Auto-fetched 1 day ago

Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.

A multilingual tokenizer to split a string into tokens

Ruby port of the NLTK Punkt sentence segmentation algorithm

A fast and accurate rule-based sentence segmentation tool for Ruby.