german-transformer-training

BSD-2-ClausePython

A repository for planning and training German transformer language models from scratch.

23 stars2 forks0 contributors

Overview

Plan and train German transformer models.

Community-curated · Updated weekly · 100% open source

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

5 years ago

CreatedSince 2020

Auto-fetched 15 hours ago

State-of-the-Art Embeddings, Retrieval, and Reranking

DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models

This is a german ELMo deep contextualized word representation. It is trained on a special German Wikipedia Text Corpus.