Bert

tokenizersRust

Fast, state-of-the-art tokenizers for training and tokenization, optimized for both research and production.

rust-bertRust

A Rust-native port of Hugging Face Transformers providing ready-to-use NLP pipelines and transformer models like BERT, GPT2, and T5.

TexarPython

A modular toolkit for machine learning, natural language processing, and text generation with TensorFlow and PyTorch versions.

SciBERTPython

A BERT language model pre-trained on a large corpus of scientific papers for natural language processing tasks in scientific domains.