Skip to content

vllm_omni.diffusion.cache.cachedit.config

Configuration types and conversion helpers for Cache-DiT.

logger module-attribute 

logger = init_logger(__name__)

CacheDiTAdapterConfig dataclass

Describe how Cache-DiT wraps a model's transformer blocks.

block_forward_patterns instance-attribute 

block_forward_patterns: dict[str, ForwardPattern]

cached_adapter_cls class-attribute instance-attribute 

cached_adapter_cls: type[CachedAdapter] | None = None

check_forward_pattern class-attribute instance-attribute 

check_forward_pattern: bool = True

has_separate_cfg class-attribute instance-attribute 

has_separate_cfg: bool = False

CacheDiTConfig dataclass

Cache-DiT-specific projection of the shared diffusion cache config.

Bn_compute_blocks class-attribute instance-attribute 

Bn_compute_blocks: int = 0

Fn_compute_blocks class-attribute instance-attribute 

Fn_compute_blocks: int = 1

enable_taylorseer class-attribute instance-attribute 

enable_taylorseer: bool = False

force_refresh_step_hint class-attribute instance-attribute 

force_refresh_step_hint: int | None = None

force_refresh_step_policy class-attribute instance-attribute 

force_refresh_step_policy: str = 'once'

max_cached_steps class-attribute instance-attribute 

max_cached_steps: int = -1

max_continuous_cached_steps class-attribute instance-attribute 

max_continuous_cached_steps: int = 3

max_warmup_steps class-attribute instance-attribute 

max_warmup_steps: int = 4

residual_diff_threshold class-attribute instance-attribute 

residual_diff_threshold: float = 0.24

scm_steps_mask_policy class-attribute instance-attribute 

scm_steps_mask_policy: str | None = None

scm_steps_policy class-attribute instance-attribute 

scm_steps_policy: str = 'dynamic'

taylorseer_order class-attribute instance-attribute 

taylorseer_order: int = 1

from_diffusion_config classmethod 

from_diffusion_config(
    config: DiffusionCacheConfig,
) -> CacheDiTConfig

Project the shared config onto fields consumed by Cache-DiT.

to_calibrator_config 

to_calibrator_config() -> CalibratorConfig | None

Build the optional TaylorSeer calibrator configuration.

to_db_cache_config 

to_db_cache_config() -> DBCacheConfig

Build the third-party cache configuration used during installation.