Serving a torch model using FastAPI
Published in
4 min readJun 10, 2020
FastAPI is a modern, fast (high-performance), web framework for building APIs with Python 3.6+ based on standard Python type hints. We’re going to see how we can use FastAPI to serve a torch model.
Key Features of FastAPI
- Fast: Very high performance, on par with NodeJS and Go (thanks to Starlette and Pydantic). One of the fastest Python frameworks available.
