Skip to content

vllm_omni.diffusion.cache.cachedit.runtime

Declarative request-scoped Cache-DiT lifecycle.

CacheDiTRequestSpec dataclass

Desired Cache-DiT state for one request.

installation_key identifies configurations that require reinstalling hooks when switching between them. Step-count changes only require a context refresh.

cache_config instance-attribute 

cache_config: DiffusionCacheConfig

installation_key instance-attribute 

installation_key: str

num_inference_steps instance-attribute 

num_inference_steps: int

RequestScopedCacheDiTRuntime

Reconcile declarative request state with installed Cache-DiT hooks.

is_enabled property 

is_enabled: bool

adopt 

adopt(
    backend: CacheDiTBackend, *, installation_key: str
) -> None

Assume ownership of an already-enabled startup backend.

disable 

disable() -> None

prepare 

prepare(spec: CacheDiTRequestSpec | None) -> None

Apply the minimal transition needed before the request denoise.

None disables installed hooks. An unchanged installation key only refreshes request context; a changed key disables the previous hooks before installing the requested profile.