Skip to content

Quantization

Quantization owns method registration, checkpoint interpretation, layer replacement, and runtime constraints for reduced-precision execution.

Candidate invariants

QUANT-INV-001: Checkpoint and runtime methods agree

Rule: The selected method MUST validate checkpoint metadata, supported layers, device capabilities, and required dependencies before use.

QUANT-INV-002: Unsupported combinations fail clearly

Rule: Quantization MUST NOT silently fall back to a different precision or method when a requested combination is unsupported.

QUANT-INV-003: Numerical validation is required

Rule: A new method or layer mapping MUST include correctness comparison against a defined reference result.

Safe-change guide

Test loading, representative layers, metadata, platform guards, and numerical tolerances separately from performance.