dockette/litellm repository overview

⁠Dockette / LiteLLM

🎁 LiteLLM Proxy with preinstalled pip and Pillow.

🕹 f3l1x.io⁠ | 💻 f3l1x⁠ | 🐦 @xf3l1x⁠

LiteLLM⁠ Proxy with pip and Pillow⁠ added to the application virtualenv. The upstream image is built on Wolfi and ships a virtualenv at /app/.venv without pip. LiteLLM imports Pillow for image handling (Bedrock, Vertex AI and Ollama), but does not install it. There is also no HTTP client. This image fills all three gaps.

⁠Features

• LiteLLM Proxy v1.108.2
• Python 3.13 (upstream virtualenv at /app/.venv)
• pip installed and upgraded, so you can add packages at runtime
• Pillow preinstalled (JPEG, PNG, WEBP, AVIF, GIF and TIFF)
• curl installed
• Healthcheck on /health/liveliness, done with curl
• Entrypoint, command, workdir and exposed port are inherited from upstream

⁠Usage

docker run --rm -it \
    -p 4000:4000 \
    -e LITELLM_MASTER_KEY=sk-1234 \
    dockette/litellm:latest

# With a configuration file
docker run --rm -it \
    -p 4000:4000 \
    -e LITELLM_MASTER_KEY=sk-1234 \
    -v $(pwd)/config.yaml:/app/config.yaml \
    dockette/litellm:latest \
    --config /app/config.yaml --port 4000

# Add more Python packages at runtime
docker exec -it <container> /app/.venv/bin/python -m pip install <package>

⁠Configuration

• LITELLM_MASTER_KEY - master key of the proxy
• PORT - port used by the healthcheck, 4000 by default

The default command is --port 4000. This argument wins over PORT. Set both if you change the port.

The working directory is /app. The user is root, same as upstream.

⁠Versions

All versions build on ghcr.io/berriai/litellm:v1.108.2. Pillow is installed at build time and is not pinned, so a rebuild can ship a newer Pillow. Releases are listed on GitHub⁠.

⁠Development

make build          # build the image
make test           # check curl, pip, Pillow, codecs and LiteLLM
make test-docker    # start the image and check the proxy
make run            # run the proxy on port 14000
make shell          # open a shell in the image
make push           # build and push linux/amd64 and linux/arm64
make version        # print VERSION
make release        # set today's date in VERSION

# Build against another LiteLLM release
make build LITELLM_VERSION=v1.97.0

⁠Maintenance

See how to contribute⁠ to this package. Consider to support⁠ f3l1x. Thank you for using this package.