Natural Language Understanding

BERTPython

TensorFlow implementation and pre-trained models for BERT, a bidirectional Transformer for language understanding.

tokenizersRust

Fast, state-of-the-art tokenizers for training and tokenization, optimized for both research and production.

This Word Does Not ExistPython

A GPT-2 variant that generates plausible fake words, definitions, and usage examples from scratch.