Skip to content

vllm_omni.diffusion.model_loader.checkpoint_adapters ¶

Modules:

Name	Description
`direct_mmap`	Loader-side adapters for proven direct-checkpoint mmap layouts.
`modelopt`

ModelOptFp8CheckpointAdapter ¶

adapt ¶

adapt(
    weights: Iterable[tuple[str, Tensor]],
) -> Generator[tuple[str, Tensor], None, None]

is_compatible `classmethod` ¶

is_compatible(
    source: object,
    quant_config: object | None,
    use_safetensors: bool,
) -> bool

ModelOptMixedPrecisionCheckpointAdapter ¶

Bases: ModelOptFp8CheckpointAdapter

ModelOptNvFp4CheckpointAdapter ¶

Bases: ModelOptFp8CheckpointAdapter

adapt ¶

adapt(
    weights: Iterable[tuple[str, Tensor]],
) -> Generator[tuple[str, Tensor], None, None]

get_checkpoint_adapter ¶

get_checkpoint_adapter(
    model: Module,
    source: object,
    quant_config: object | None,
    use_safetensors: bool,
) -> (
    ModelOptFp8CheckpointAdapter
    | ModelOptNvFp4CheckpointAdapter
    | ModelOptMixedPrecisionCheckpointAdapter
    | None
)

get_direct_mmap_adapter ¶

get_direct_mmap_adapter(model: Module)

Resolve direct-mmap adapters lazily to avoid model-loader cycles.