For AI agents: a documentation index is available at the root level at /llms.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
This page is for version v1.0.1.
For other versions, use one of these documentation indexes:
- Latest (v1.5.1) (default): https://docs.nvidia.com/dynamo/latest/llms.txt
- dev: https://docs.nvidia.com/dynamo/dev/llms.txt
- v1.5.1: https://docs.nvidia.com/dynamo/v1.5.1/llms.txt
- v1.5.0: https://docs.nvidia.com/dynamo/v1.5.0/llms.txt
- v1.4.2: https://docs.nvidia.com/dynamo/v1.4.2/llms.txt
- v1.4.1: https://docs.nvidia.com/dynamo/v1.4.1/llms.txt
- v1.4.0: https://docs.nvidia.com/dynamo/v1.4.0/llms.txt
- v1.3.0: https://docs.nvidia.com/dynamo/v1.3.0/llms.txt
- v1.2.1: https://docs.nvidia.com/dynamo/v1.2.1/llms.txt
- v1.2.0: https://docs.nvidia.com/dynamo/v1.2.0/llms.txt
- v1.1.1: https://docs.nvidia.com/dynamo/v1.1.1/llms.txt
- v1.1.0: https://docs.nvidia.com/dynamo/v1.1.0/llms.txt
- v1.0.2: https://docs.nvidia.com/dynamo/v1.0.2/llms.txt
- v1.0.1: https://docs.nvidia.com/dynamo/v1.0.1/llms.txt
- v1.0.0: https://docs.nvidia.com/dynamo/v1.0.0/llms.txt
- v0.9.1: https://docs.nvidia.com/dynamo/v-0-9-1/llms.txt
- v0.9.0: https://docs.nvidia.com/dynamo/v-0-9-0/llms.txt
- v0.8.1: https://docs.nvidia.com/dynamo/v-0-8-1/llms.txt
- v0.8.0: https://docs.nvidia.com/dynamo/v-0-8-0/llms.txt
- v0.7.1: https://docs.nvidia.com/dynamo/v-0-7-1/llms.txt
- v0.7.0: https://docs.nvidia.com/dynamo/v-0-7-0/llms.txt
For general TensorRT-LLM features and configuration, see the Reference Guide.
Dynamo supports video generation using diffusion models through the --modality video_diffusion flag.
Requirements
TensorRT-LLM with visual_gen: The visual_gen module is part of TensorRT-LLM (tensorrt_llm._torch.visual_gen). Install TensorRT-LLM following the official instructions.
imageio with ffmpeg: Required for encoding generated frames to MP4 video:
pip install imageio[ffmpeg]
dynamo-runtime with video API: The Dynamo runtime must include ModelType.Videos support. Ensure you’re using a compatible version.
Supported Models
Diffusers Pipeline
Description
Example Model
WanPipeline
Wan 2.1/2.2 Text-to-Video
Wan-AI/Wan2.1-T2V-1.3B-Diffusers
The pipeline type is auto-detected from the model’s model_index.json — no --model-type flag is needed.
Quick Start
python -m dynamo.trtllm \
--modality video_diffusion \
--model-path Wan-AI/Wan2.1-T2V-1.3B-Diffusers \
--media-output-fs-url file:///tmp/dynamo_media
API Endpoint
Video generation uses the /v1/videos endpoint:
curl -X POST http://localhost:8000/v1/videos \
-H "Content-Type: application/json" \
-d '{
"prompt": "A cat playing piano",
"model": "wan_t2v",
"seconds": 4,
"size": "832x480",
"nvext": {
"fps": 24
}
}'
Configuration Options
Flag
Description
Default
--media-output-fs-url
Filesystem URL for storing generated media
file:///tmp/dynamo_media
--default-height
Default video height
480
--default-width
Default video width
832
--default-num-frames
Default frame count
81
--enable-teacache
Enable TeaCache optimization
False
--disable-torch-compile
Disable torch.compile
False
Limitations
Video diffusion is experimental and not recommended for production use
Only text-to-video is supported in this release (image-to-video planned)
Requires GPU with sufficient VRAM for the diffusion model
