ITEA is the Eureka Cluster on software innovation
ITEA is the Eureka Cluster on software innovation
Please note that the ITEA Office will be closed from 25 December 2024 to 1 January 2025 inclusive.
ITEA 4 page header azure circular

Stevedore: a generic lightweight ML build setup in Docker

Project
20219 IML4E
Type
New library
Description

Wrapper class and generic API plus Podman/Docker build automation for Python ML models. A specific use case is a set of machine learning models that may be composed, so that they should be tested and packaged together. This by no means excludes use on single model.

Contact
Saku Suuriniemi, Reaktor
Email
saku.suuriniemi@reaktor.com
Research area(s)
MLOps
Technical features

Wrapper class and generic API plus Podman/Docker build automation for Python ML models. A containerized model suitable for local runner, Kubernetes, or a serverless container runner behind a well-thought HTTP API that forces you to second thoughts about monitoring i.e. requires that you provide some model monitoring and automatically builds some more for you, and whose monitoring endpoints are named uniformly, with JSON payloads validated against the schemas you supply and automated build-time testing of the API endpoints before container finalisation.

Integration constraints

HTTP-framework that serves the API is FastAPI. See details in https://github.com/reaktor/ml-py-stevedore

Conditions for reuse

MIT license

Confidentiality
Public
Publication date
01-09-2022
Involved partners
Reaktor Innovations (FIN)

Images

Links