Huang et al ClinicalBERT

Pretrained on MIMIC-III clinical notes, capturing medical terminology and context, which improves accuracy for healthcare tasks over general-purpose models as highlighted in the README.

Includes fine-tuned models for 30-day readmission prediction from early notes and discharge summaries, with provided scripts for evaluation without additional training.

Offers notebooks to visualize self-attention mechanisms, aiding in interpretability and research on clinical text processing, as referenced in the README.

Provides Word2Vec and FastText models trained on clinical notes, supporting traditional NLP approaches alongside transformer-based methods.

Allows training custom readmission prediction models from pretrained checkpoints with configurable parameters, as shown in the training scripts.