ProtTrans
State-of-the-art pre-trained transformer language models for protein sequences, enabling tasks like structure prediction and function annotation.
What is ProtTrans?
ProtTrans is a suite of pre-trained transformer-based language models specifically designed for protein sequences. It treats amino acid sequences as a language, enabling models to learn rich representations that capture structural and functional properties. These embeddings can be used for a wide range of bioinformatics tasks, such as predicting protein structure, function, and interactions.
Bioinformaticians, computational biologists, and machine learning researchers working on protein-related problems who need high-quality embeddings or want to fine-tune models for specific prediction tasks.
ProtTrans offers state-of-the-art performance on key benchmarks, provides a variety of model architectures and sizes, and is fully integrated with the Hugging Face ecosystem for easy use. Its models are openly available and have been validated in numerous downstream applications, from variant effect prediction to protein design.
Overview
ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.
Use Cases
Best For
- Extracting protein sequence embeddings for machine learning pipelines
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
