BentoML is an open-source platform for packaging ML models. It effectively simplifies the productionization of ML models by offering easy-to-use built-in features. BentoML provides a straightforward approach for packaging trained models and their associated code and dependencies into a unified distribution format called “Bento.” This platform supports various deployment options, including serving models as REST APIs, Docker containers, and batch jobs.
BentoML: Serving and Deploying Machine Learning Models
May 7, 2024
—