A vision transformer foundation model pre-trained on over 200 million pathology images for computational pathology tasks.
UNI is a foundation model for computational pathology, pre-trained on a massive dataset of over 200 million histopathology images. It provides general-purpose visual representations that can be fine-tuned for tasks like cancer classification, survival prediction, and biomarker detection from whole slide images. The model addresses the need for robust, scalable AI tools in medical image analysis by learning from diverse pathology data.
Researchers and developers in computational pathology, biomedical AI, and oncology who need powerful visual feature extractors for histopathology image analysis. It is also valuable for medical institutions and labs building diagnostic or prognostic tools.
UNI offers state-of-the-art performance on benchmark pathology tasks, outperforming other public models. Its large-scale pre-training on diverse histopathology data makes it highly adaptable, reducing the need for extensive labeled datasets in downstream applications.
Pathology Foundation Model - Nature Medicine
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Pre-trained on over 200 million histopathology images from 350,000+ whole slide images, providing robust and generalizable visual representations for diverse pathology tasks.
Outperforms competitors like Virchow and Prov-GigaPath on public ROI and slide-level classification benchmarks, as shown in detailed tables with metrics like 0.957 accuracy on CRC-100K-Raw.
Weights are hosted on Hugging Face and can be loaded directly using the timm library with a few lines of Python code, streamlining integration into existing workflows.
Offers ready-to-use embeddings for major datasets like TCGA, CPTAC, and PANDA on Hugging Face, reducing computational overhead for common research tasks.
Supported by over 50 published studies listed in the README, indicating widespread academic validation and adoption in computational pathology.
The CC-BY-NC-ND 4.0 license forbids commercial use, requiring explicit approval for any monetization, which severely limits practical deployment in healthcare products.
The ViT-h/14 and ViT-g/14 architectures demand significant GPU resources (e.g., high-end NVIDIA cards) for inference and fine-tuning, making it inaccessible for labs with limited hardware.
Effective only for histopathology images; performance on other medical imaging modalities is untested and likely inferior compared to general-purpose vision models.
Requires Hugging Face login, manual timm configuration with specific kwargs, and dependency management, posing a barrier for users unfamiliar with deep learning tooling.