Runtime Containers

Dynamo runtime images package the Dynamo runtime with an inference engine. The same container build flow can generate images for the built-in engines or a backend that you add on top of the Dynamo runtime.

Use container/render.py to select the engine family and Docker target:

$
# vLLM runtime image
$
python container/render.py --framework=vllm --target=runtime --output-short-filename
$
docker build -t dynamo:latest-vllm-runtime -f container/rendered.Dockerfile .
$
$
# SGLang runtime image
$
python container/render.py --framework=sglang --target=runtime --output-short-filename
$
docker build -t dynamo:latest-sglang-runtime -f container/rendered.Dockerfile .
$
$
# TensorRT-LLM runtime image
$
python container/render.py --framework=trtllm --target=runtime --cuda-version=13.1 --output-short-filename
$
docker build -t dynamo:latest-trtllm-runtime -f container/rendered.Dockerfile .

Engine and Target Toggles

--framework chooses the engine base. Use vllm, sglang, or trtllm for built-in backends. Use none when you want a Dynamo-only base image and plan to install your own backend package.

--target chooses the image shape:

Custom Backend Image

For a Python custom backend, start with a built-in engine image if you need that framework’s CUDA/Python stack, or use --framework=none if your backend brings its own dependencies:

$
python container/render.py --framework=none --target=runtime --output-short-filename
$
docker build -t dynamo:custom-backend-base -f container/rendered.Dockerfile .

Then layer your backend package into a small Dockerfile:

1
FROM dynamo:custom-backend-base
2
3
COPY dist/my_backend-*.whl /tmp/
4
RUN uv pip install --system --no-deps /tmp/my_backend-*.whl
5
6
ENTRYPOINT ["my-backend"]

For a Rust custom backend, build the backend binary in your own builder stage and copy it into the Dynamo runtime image:

1
FROM rust:1.93 AS backend-builder
2
WORKDIR /src
3
COPY . .
4
RUN cargo build --release
5
6
FROM dynamo:custom-backend-base
7
COPY --from=backend-builder /src/target/release/my-backend /usr/local/bin/my-backend
8
9
ENTRYPOINT ["my-backend"]

Run Locally

Use container/run.sh to launch the image with the same GPU and mount defaults used by Dynamo development workflows:

$
container/run.sh --image dynamo:custom-backend-base --mount-workspace -it

For the full container build reference, target matrix, and troubleshooting notes, see the repository-level Container Development Guide.