Cog is an open-source tool that lets you package machine learning models in a standard, production-ready container.
Cog bundles Python models into a Docker image with a simple interface for loading and running models. This project aims to match that interface for Rust models, so they can be used interchangeably (on Replicate or Dyson).
This is a work in progress. It's not ready for use yet. Check back soon!
To see the proposed DX, check the hello-world example.