A tool to package, serve, and deploy any ML model on any platform using a GitOps approach.
MLEM is an open-source tool that packages, serves, and deploys machine learning models across various platforms. It solves the problem of moving models from training to production by providing a standard format and deployment commands that work with any ML framework, without requiring code rewrites.
Machine learning engineers and data scientists who need to deploy models to production, and DevOps teams managing ML lifecycle infrastructure.
Developers choose MLEM for its GitOps approach, which allows versioning model metadata in Git and using familiar software deployment processes. Its non-invasive integration and framework-agnostic design make it easy to adopt into existing workflows.
🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
MLEM can wrap models as Python packages or Docker images and deploy to platforms like Heroku, SageMaker, or Kubernetes with a single command, as demonstrated in the CLI deployment example.
It automatically creates human-readable YAML files with Python requirements and input specifications, compatible with any ML framework, shown in the detailed .mlem file output.
Adding just two lines of code to save models preserves existing training workflows, making it non-invasive, as illustrated in the train.py snippet.
Enables versioning model metadata in Git, facilitating software engineering best practices like branching and pull requests for model releases, aligning with its philosophy.
The README notes 'more platforms coming soon,' indicating current deployment options are not exhaustive, which may not cover all production scenarios.
Deployments like Heroku require setting up API keys and running additional commands (e.g., `heroku container:login`), adding setup complexity beyond MLEM itself.
Designed to integrate with the Iterative.ai ecosystem (e.g., DVC, CML), which might encourage dependency on their toolset rather than standalone use.