vllm_omni.worker_v2.model_states ¶

Omni-aware init_model_state factory.

Extends the upstream v2 factory with Omni architecture dispatch. Non-Omni architectures fall through to the upstream init_model_state.

Modules:

Name	Description
`intermediate_buffer`	OmniIntermediateBuffer — per-request cross-stage state for Omni pipelines.
`omni_model_state`	OmniModelState — generic ModelState base for all Omni model stages.

init_omni_model_state ¶

init_omni_model_state(
    vllm_config: VllmConfig,
    model: Module,
    encoder_cache: EncoderCache | None,
    device: device,
) -> ModelState

Create the appropriate ModelState for model.

Returns an OmniModelState when the model declares Omni lifecycle capabilities; otherwise delegates to the upstream v2 factory.