Tag: prefill-decode
All the articles with the tag "prefill-decode".
-
Huawei OmniInfer PD Disaggregation on Ascend: Qwen3-VL Single-Node Deployment (1P1D)
Practical guide to deploying Qwen3-VL with Prefill-Decode separation on Ascend NPUs using OmniInfer. Covers minimal 1P1D setup, KV cache transfer, troubleshooting, and complete working scripts.