tokenizer

pragmatic_segmenter

Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.

pragmatic_tokenizer

A multilingual tokenizer to split a string into tokens

punkt-segmenter

Ruby port of the NLTK Punkt sentence segmentation algorithm

tactful_tokenizer

Accurate Bayesian sentence tokenizer in Ruby.