Deploying PyTorch Model to Production with FastAPI in CUDA-supported Docker
A example FastAPI PyTorch Model deploy with nvidia/cuda base docker.
Model
The model used is trained for classification on Iris Flower Dataset, from this blog written by Nikolai Janakiev: https://janakiev.com/blog/pytorch-iris/
Guide
Detailed explaination can be found in this Medium article: https://medium.com/@mingc.me/deploying-pytorch-model-to-production-with-fastapi-in-cuda-supported-docker-c161cca68bb8