InferX 

InferX is a serverless AI inference platform designed to run large models efficiently.
By capturing the full GPU runtime state, InferX enables near-instant cold starts and allows models to be loaded and evicted on demand instead of staying pinned in VRAM.

GitHub Repo: https://github.com/inferx-net/inferx