Skip to content

vllm_omni.diffusion.model_loader.host_weights.contracts

Typed semantic contracts shared by final-layout artifact representations.

FINAL_LAYOUT_TENSOR_RESTORER_SCHEMA module-attribute

FINAL_LAYOUT_TENSOR_RESTORER_SCHEMA = (
    "diffusion-final-layout-tensor-restorer-v1"
)

FinalLayoutArtifactSpec dataclass

Concrete representation, layout, producer, and restoration ABI.

component_name class-attribute instance-attribute

component_name: str = 'diffusion-dit'

component_ownership class-attribute instance-attribute

component_ownership: str = 'complete-final-layout-tensors'

implementation_abi instance-attribute

implementation_abi: CanonicalJson

layout_name class-attribute instance-attribute

layout_name: str = 'diffusion-final-module-layout-v1'

model_contract_schema class-attribute instance-attribute

model_contract_schema: str = (
    FINAL_LAYOUT_TENSOR_MODEL_CONTRACT_SCHEMA
)

producer instance-attribute

producer: ProducerIdentity

representation instance-attribute

representation: WeightRepresentation

FinalLayoutContractCode

Bases: str, Enum

DTYPE_UNSUPPORTED class-attribute instance-attribute

DTYPE_UNSUPPORTED = 'dtype_unsupported'

IDENTITY_INCOMPATIBLE class-attribute instance-attribute

IDENTITY_INCOMPATIBLE = 'identity_incompatible'

MODEL_CONTRACT_UNSUPPORTED class-attribute instance-attribute

MODEL_CONTRACT_UNSUPPORTED = 'model_contract_unsupported'

OWNERSHIP_AMBIGUOUS class-attribute instance-attribute

OWNERSHIP_AMBIGUOUS = 'ownership_ambiguous'

SOURCE_CHANGED class-attribute instance-attribute

SOURCE_CHANGED = 'source_changed'

SOURCE_COVERAGE_INVALID class-attribute instance-attribute

SOURCE_COVERAGE_INVALID = 'source_coverage_invalid'

TENSOR_CONTRACT_CHANGED class-attribute instance-attribute

TENSOR_CONTRACT_CHANGED = 'tensor_contract_changed'

TENSOR_UNSUPPORTED class-attribute instance-attribute

TENSOR_UNSUPPORTED = 'tensor_unsupported'

FinalLayoutContractError

Bases: ValueError

Typed fail-closed error at a final-layout model integration boundary.

code instance-attribute

code = code

FinalLayoutLoaderIdentity dataclass

Loader ABI and exact configuration facts that may change final bytes.

implementation instance-attribute

implementation: ImplementationIdentity

model_config_fingerprint instance-attribute

model_config_fingerprint: str

weight_transform_fingerprint instance-attribute

weight_transform_fingerprint: str

to_dict

to_dict() -> dict[str, object]

FinalLayoutParallelIdentity dataclass

Semantic parallel layout with DP and SP rank intentionally absent.

allgather_degree class-attribute instance-attribute

allgather_degree: int = 1

cfg_parallel_size class-attribute instance-attribute

cfg_parallel_size: int = 1

enable_expert_parallel class-attribute instance-attribute

enable_expert_parallel: bool = False

pipeline_parallel_size class-attribute instance-attribute

pipeline_parallel_size: int = 1

ring_degree class-attribute instance-attribute

ring_degree: int = 1

sequence_parallel_backend property

sequence_parallel_backend: str

sequence_parallel_size class-attribute instance-attribute

sequence_parallel_size: int = 1

tensor_parallel_rank class-attribute instance-attribute

tensor_parallel_rank: int = 0

tensor_parallel_size class-attribute instance-attribute

tensor_parallel_size: int = 1

ulysses_degree class-attribute instance-attribute

ulysses_degree: int = 1

ulysses_mode class-attribute instance-attribute

ulysses_mode: str = 'strict'

use_hsdp class-attribute instance-attribute

use_hsdp: bool = False

to_dict

to_dict() -> dict[str, object]

FinalLayoutRequest dataclass

Representation-independent semantic request assembled by the loader.

adaptation class-attribute instance-attribute

adaptation: AdaptationIdentity = field(
    default_factory=AdaptationIdentity
)

load_format class-attribute instance-attribute

load_format: str = 'default'

loader instance-attribute

model_id instance-attribute

model_id: str

parallel class-attribute instance-attribute

FinalLayoutTensorPolicy

Bases: Protocol

Representation-specific validation over shared final-layout mechanics.

spec property

build_format_metadata

build_format_metadata(
    *,
    component_names: tuple[str, ...],
    tensor_contract_digest: str,
    tensor_count: int,
) -> CanonicalJson

tensor_role

tensor_role(
    name: str, tensor: Tensor, kind: TensorKind
) -> str

validate_collection

validate_collection(
    targets: Sequence[RuntimeTensorTarget],
) -> None

validate_format_metadata

validate_format_metadata(
    metadata: CanonicalJson,
    *,
    component_names: tuple[str, ...],
    tensor_contract_digest: str,
    tensor_count: int,
) -> None

validate_request

validate_request(request: FinalLayoutRequest) -> None

validate_target

validate_target(target: RuntimeTensorTarget) -> None

ImplementationIdentity dataclass

Explicit stable identity for one semantic implementation boundary.

fingerprint instance-attribute

fingerprint: str

implementation_id instance-attribute

implementation_id: str

version instance-attribute

version: str

to_dict

to_dict() -> dict[str, str]

final_layout_producer_error

final_layout_producer_error(
    error: FinalLayoutContractError,
) -> HostWeightError

Translate representation failures into the runtime's stable taxonomy.

implementation_abi_fingerprint

implementation_abi_fingerprint(abi: CanonicalJson) -> str