Scheduling components for vLLM-Omni.
Modules:
| Name | Description |
|---|---|
omni_ar_scheduler | |
omni_cfg_ar_scheduler | Atomic CFG admission for full-attention AR models with unequal prompts. |
omni_generation_scheduler | |
omni_scheduler_mixin | |
omni_scheduling_coordinator | Scheduling-side coordination for chunk and full-payload input waiting. |
output | |
utils | Shared utilities for omni schedulers. |