FastAPI TensorFlow Serving

GitHub project for Tensorflow-based Object Detection on the CIFAR-10 dataset, served with FastAPI.

Getting Started

1. Install dependencies from pyproject.toml and activate the created virtualenv:

uv sync && source .venv/bin/activate

2. Start the app with gunicorn with:

make run

3. Access the Swagger UI at:

open http://localhost:8080

Containerization

1. Build the Docker Image with:

make docker-image

2. Spin up the container with:

make docker-run

3. Access the Swagger UI at:

open http://localhost:8000

TODO's:

• PEP-517: Packaging and dependency management with uv
• Code format/lint with Ruff
• Run on Docker
• Serve it with Streamlit
• GitHub CI