Skip to content

vllm_omni.host_weight_runtime.manifest

Versioned immutable manifests for runtime-ready host weights.

FileManifestEntry dataclass

file_name instance-attribute 

file_name: str

sha256 instance-attribute 

sha256: str

size instance-attribute 

size: int

from_dict classmethod 

from_dict(value: dict[str, object]) -> FileManifestEntry

to_dict 

to_dict() -> dict[str, JsonValue]

ManifestValidationError

Bases: ValueError

Raised when a published manifest violates its schema.

PublicationMarker dataclass

artifact_content_sha256 instance-attribute 

artifact_content_sha256: str

canonical_bytes property 

canonical_bytes: bytes

integrity_mode instance-attribute 

integrity_mode: str

manifest_sha256 instance-attribute 

manifest_sha256: str

publication_id instance-attribute 

publication_id: str

schema_version instance-attribute 

schema_version: int

from_dict classmethod 

from_dict(value: dict[str, object]) -> PublicationMarker

to_dict 

to_dict() -> dict[str, JsonValue]

TensorKind

Bases: str, Enum

BUFFER class-attribute instance-attribute 

BUFFER = 'buffer'

PARAMETER class-attribute instance-attribute 

PARAMETER = 'parameter'

TensorManifestEntry dataclass

dtype instance-attribute 

dtype: str

file_name instance-attribute 

file_name: str

kind instance-attribute 

kind: TensorKind

name instance-attribute 

name: str

nbytes instance-attribute 

nbytes: int

role instance-attribute 

role: str

sha256 instance-attribute 

sha256: str

shape instance-attribute 

shape: tuple[int, ...]

storage_key instance-attribute 

storage_key: str

stride instance-attribute 

stride: tuple[int, ...]

from_dict classmethod 

from_dict(value: dict[str, object]) -> TensorManifestEntry

semantic_dict 

semantic_dict() -> dict[str, JsonValue]

Return content identity independent of physical file sharding.

to_dict 

to_dict() -> dict[str, JsonValue]

WeightManifest dataclass

artifact_content_sha256 instance-attribute 

artifact_content_sha256: str

artifact_key instance-attribute 

artifact_key: str

canonical_bytes property 

canonical_bytes: bytes

files instance-attribute 

files: tuple[FileManifestEntry, ...]

format_metadata class-attribute instance-attribute 

format_metadata: CanonicalJson = field(
    default_factory=CanonicalJson.empty
)

identity instance-attribute 

identity: WeightArtifactIdentity

producer_schema instance-attribute 

producer_schema: str

restorer_schema instance-attribute 

restorer_schema: str

schema_version instance-attribute 

schema_version: int

tensors instance-attribute 

tensors: tuple[TensorManifestEntry, ...]

total_tensor_bytes property 

total_tensor_bytes: int

from_dict classmethod 

from_dict(value: dict[str, object]) -> WeightManifest

to_dict 

to_dict() -> dict[str, JsonValue]