LiteLLM

Deployment & runtime

Template: verify the official image tag, authentication and persistent storage first

# Confirm the image tag in the official deployment documentation first.
export IMAGE_TAG="REPLACE_WITH_VERIFIED_TAG"
test "$IMAGE_TAG" != "REPLACE_WITH_VERIFIED_TAG" || exit 1
docker run -d --name litellm \
  -p 127.0.0.1:4000:4000 \
  --restart unless-stopped \
  ghcr.io/berriai/litellm:"${IMAGE_TAG}"
# Add the official authentication, database and persistent-volume settings before production use.

Choose hosting for your needs

Provider links below; no unverified starting prices. Choose for actual concurrency, memory and network needs.