Python API
Public Python surfaces on the Dynamo distributed runtime, statically discovered from the source tree.
This page is for version dev.
For other versions, use one of these documentation indexes:
- Latest (v1.5.1) (default): https://docs.nvidia.com/dynamo/latest/llms.txt
- dev: https://docs.nvidia.com/dynamo/dev/llms.txt
- v1.5.1: https://docs.nvidia.com/dynamo/v1.5.1/llms.txt
- v1.5.0: https://docs.nvidia.com/dynamo/v1.5.0/llms.txt
- v1.4.2: https://docs.nvidia.com/dynamo/v1.4.2/llms.txt
- v1.4.1: https://docs.nvidia.com/dynamo/v1.4.1/llms.txt
- v1.4.0: https://docs.nvidia.com/dynamo/v1.4.0/llms.txt
- v1.3.0: https://docs.nvidia.com/dynamo/v1.3.0/llms.txt
- v1.2.1: https://docs.nvidia.com/dynamo/v1.2.1/llms.txt
- v1.2.0: https://docs.nvidia.com/dynamo/v1.2.0/llms.txt
- v1.1.1: https://docs.nvidia.com/dynamo/v1.1.1/llms.txt
- v1.1.0: https://docs.nvidia.com/dynamo/v1.1.0/llms.txt
- v1.0.2: https://docs.nvidia.com/dynamo/v1.0.2/llms.txt
- v1.0.1: https://docs.nvidia.com/dynamo/v1.0.1/llms.txt
- v1.0.0: https://docs.nvidia.com/dynamo/v1.0.0/llms.txt
- v0.9.1: https://docs.nvidia.com/dynamo/v-0-9-1/llms.txt
- v0.9.0: https://docs.nvidia.com/dynamo/v-0-9-0/llms.txt
- v0.8.1: https://docs.nvidia.com/dynamo/v-0-8-1/llms.txt
- v0.8.0: https://docs.nvidia.com/dynamo/v-0-8-0/llms.txt
- v0.7.1: https://docs.nvidia.com/dynamo/v-0-7-1/llms.txt
- v0.7.0: https://docs.nvidia.com/dynamo/v-0-7-0/llms.txt
Dynamo publishes 11 Python modules with 400 public class and function symbols under dynamo.*.
dynamo._core
96 symbols. Rust-backed distributed runtime, KV router, and endpoint bindings.
dynamo.runtime
19 symbols. Decorators and re-exports for defining Dynamo workers and endpoints.
dynamo.llm
53 symbols. High-level LLM primitives for building request pipelines.
dynamo.frontend
54 symbols. OpenAI-compatible HTTP frontend, argument parsing, and pre/post-processing.
dynamo.common
83 symbols. Shared configuration groups, storage adapters, and utility helpers.
dynamo.health_check
2 symbols. Health-check payload types and environment-driven configuration.
dynamo.logits_processing
4 symbols. Custom logits processors for LLM token generation.
dynamo.planner
45 symbols. Scaling connectors, decision types, and Planner configuration.
dynamo.router
7 symbols. Request-router configuration and command-line argument groups.
dynamo.mocker
20 symbols. Mock engine used to run Dynamo workflows without a real GPU backend.
dynamo.nixl_connect
17 symbols. NIXL RDMA connector primitives for KV cache and tensor transport.