vllm_omni.model_executor.models.cosyvoice3.runtime ¶

Runtime toggles shared by the CosyVoice3 stages.

cosyvoice3_batch_flow_debug ¶

cosyvoice3_batch_flow_debug() -> bool

Return whether Stage-1 batching diagnostics are enabled.

cosyvoice3_batch_flow_enabled() -> bool

Return whether cross-request Stage-1 flow batching is enabled.

cosyvoice3_batch_flow_profile(name: str)

Create a profiler scope only when batching diagnostics are enabled.