Small-model inference

Small models in serverless functions

Wrote about using ONNX to fit small-model inference into serverless functions such as Lambda.

ONNX, AWS Lambda, Small-model inference

Notes & links

From a public post. Public discussion ↗ · Link to this entry