A vision transformer-based deep learning model for automated instance segmentation and classification of cell nuclei in histopathology images.
CellViT is a deep learning model that performs automated instance segmentation and classification of cell nuclei in histopathology images. It addresses the challenge of precisely identifying and categorizing individual cells in digitized tissue samples, which is crucial for cancer diagnosis and biomedical research. The model combines Vision Transformers with a U-Net architecture to achieve state-of-the-art accuracy on benchmarks like PanNuke.
Computational pathologists, biomedical researchers, and machine learning engineers working on medical image analysis, particularly those focused on histopathology, cell biology, and digital pathology workflows.
Developers choose CellViT for its superior accuracy on nuclei segmentation benchmarks, efficient processing of whole slide images, and integration with popular pathology software. Its open-source implementation and pre-trained models provide a reliable foundation for research and clinical applications.
CellViT: Vision Transformers for Precise Cell Segmentation and Classification
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Achieves mean panoptic quality of 0.51 and F1-detection score of 0.83 on the challenging PanNuke dataset, outperforming previous methods.
Uses 1024x1024 patches for fast inference on gigapixel images and exports results to QuPath via GeoJSON for seamless integration into pathology workflows.
Combines Vision Transformers for global context capture with U-Net's local detail preservation, enhancing segmentation accuracy for complex cell structures.
Provides pre-trained models, detailed configuration files, and logging for WandB, ensuring experiments are reproducible and well-documented.
Requires a specific conda environment with Python 3.9.7, manual dependency handling for CuCIM, and can encounter errors like 'ResolvePackageNotFound', making setup non-trivial.
The project has been replaced by CellViT++, which offers improved performance and features, indicating this repository may not receive future updates.
Primarily optimized for PanNuke and MoNuSeg datasets; adapting to new histopathology data requires retraining and may not generalize out-of-the-box.