Skip to content

vllm_omni.host_weight_runtime.runtime ¶

Policy-driven exact resolution over HostWeightStore contracts.

logger `module-attribute` ¶

logger = logging.getLogger(__name__)

HostWeightRuntime ¶

Resolve or publish one exact representation without owning restoration.

config `instance-attribute` ¶

config = config

enabled `property` ¶

enabled: bool

store `instance-attribute` ¶

store = store

from_config `classmethod` ¶

from_config(
    config: HostWeightRuntimeConfig,
    *,
    observer: Callable[[ResolutionReport], None]
    | None = None,
    publication_observer: Callable[
        [PostLoadPublicationReport], None
    ]
    | None = None,
) -> HostWeightRuntime

Construct lazily so disabled mode performs no filesystem probe.

publish_after_load ¶

publish_after_load(
    identity: WeightArtifactIdentity | None = None,
    *,
    producer: WeightProducer | None = None,
) -> PostLoadPublicationReport

Synchronously warm a future startup without revising resolution.

A successful store operation returns a validated lease. The runtime closes that lease before returning because POST_LOAD_ONLY production must not mutate or rebind the model serving the current startup.

resolve ¶

resolve(
    identity: WeightArtifactIdentity | None = None,
    *,
    producer: WeightProducer | None = None,
) -> HostWeightResolution