Rust API

Published Dynamo crates with release-pinned docs.rs links.

Dynamo publishes 25 Rust crates for release 1.4.0.

dynamo-kv-router

KV-aware request routing library

LLM inference engine

Memory management utilities

Core distributed runtime library

Logical layer for the KV Block Manager

Lightweight HTTP benchmarks for Dynamo endpoints

Configuration management

dynamo-data-gen

Schemas and primitives for Dynamo data generation and replay traces

dynamo-kv-hashing

Request-to-lineage-hash contract for KV cache identity

Protocol parsers (SSE, JSON streaming)

dynamo-parsers-v2

Successor parser line to dynamo-parsers, consumed by the Frontend

dynamo-protocols

Async OpenAI-compatible API client

dynamo-renderer

Chat-template rendering used by the Dynamo Frontend

Dynamo RL worker discovery API

dynamo-tokenizers

Tokenizer library for LLM inference

Tokenizer bindings for LLM inference

Canonical truthy/falsy boolean flag parsing

Rust BPE tokenizer backend consumed by the Frontend

Shared types for the KV Block Manager

KVBM configuration for Tokio, Rayon, and Messenger runtimes

Distributed coordination primitives for KVBM

CUDA kernels for the KV Block Manager

Physical block layer for the KV Block Manager

Inference engine simulator for benchmarking

dynamo-async-openai

Legacy OpenAI client; use dynamo-protocols

Core Crates

Crate	Summary	Version	Install
`dynamo-kv-router`	KV-aware request routing library	`1.4.0`	`cargo add dynamo-kv-router@1.4.0`
`dynamo-llm`	LLM inference engine	`1.4.0`	`cargo add dynamo-llm@1.4.0`
`dynamo-memory`	Memory management utilities	`1.4.0`	`cargo add dynamo-memory@1.4.0`
`dynamo-runtime`	Core distributed runtime library	`1.4.0`	`cargo add dynamo-runtime@1.4.0`
`kvbm-logical`	Logical layer for the KV Block Manager	`1.4.0`	`cargo add kvbm-logical@1.4.0`

Supporting Crates

Crate	Summary	Version	Install
`dynamo-bench`	Lightweight HTTP benchmarks for Dynamo endpoints	`1.4.0`	`cargo add dynamo-bench@1.4.0`
`dynamo-config`	Configuration management	`1.2.1`	`cargo add dynamo-config@1.2.1`
`dynamo-data-gen`	Schemas and primitives for Dynamo data generation and replay traces	`1.4.0`	`cargo add dynamo-data-gen@1.4.0`
`dynamo-kv-hashing`	Request-to-lineage-hash contract for KV cache identity	`1.4.0`	`cargo add dynamo-kv-hashing@1.4.0`
`dynamo-parsers`	Protocol parsers (SSE, JSON streaming)	`7.0.1`	`cargo add dynamo-parsers@7.0.1`
`dynamo-parsers-v2`	Successor parser line to dynamo-parsers, consumed by the Frontend	`0.1.23`	`cargo add dynamo-parsers-v2@0.1.23`
`dynamo-protocols`	Async OpenAI-compatible API client	`5.0.1`	`cargo add dynamo-protocols@5.0.1`
`dynamo-renderer`	Chat-template rendering used by the Dynamo Frontend	`4.0.0`	`cargo add dynamo-renderer@4.0.0`
`dynamo-rl`	Dynamo RL worker discovery API	`1.4.0`	`cargo add dynamo-rl@1.4.0`
`dynamo-tokenizers`	Tokenizer library for LLM inference	`1.5.4`	`cargo add dynamo-tokenizers@1.5.4`
`dynamo-tokens`	Tokenizer bindings for LLM inference	`1.4.0`	`cargo add dynamo-tokens@1.4.0`
`dynamo-truthy`	Canonical truthy/falsy boolean flag parsing	`1.4.0`	`cargo add dynamo-truthy@1.4.0`
`fastokens`	Rust BPE tokenizer backend consumed by the Frontend	`0.2.0`	`cargo add fastokens@0.2.0`
`kvbm-common`	Shared types for the KV Block Manager	`1.4.0`	`cargo add kvbm-common@1.4.0`
`kvbm-config`	KVBM configuration for Tokio, Rayon, and Messenger runtimes	`1.4.0`	`cargo add kvbm-config@1.4.0`
`kvbm-engine`	Distributed coordination primitives for KVBM	`1.4.0`	`cargo add kvbm-engine@1.4.0`
`kvbm-kernels`	CUDA kernels for the KV Block Manager	`1.4.0`	`cargo add kvbm-kernels@1.4.0`
`kvbm-physical`	Physical block layer for the KV Block Manager	`1.4.0`	`cargo add kvbm-physical@1.4.0`

Development and Testing

Crate	Summary	Version	Install
`dynamo-mocker`	Inference engine simulator for benchmarking	`1.4.0`	`cargo add dynamo-mocker@1.4.0`

Deprecated Crates

Crate	Summary	Version	Install
`dynamo-async-openai`	Legacy OpenAI client; use dynamo-protocols	`1.0.2`	`cargo add dynamo-async-openai@1.0.2`

Language Bindings

Binding	Language	Summary	Source
`dynamo-codegen`	Python	PyO3 code generation for the dynamo._core module.	`lib/bindings/python/codegen`
`libdynamo_llm`	C	C bindings for the Dynamo LLM library.	`lib/bindings/c`