Tag: inference-optimization

All the articles with the tag "inference-optimization".

• Huawei OmniInfer PD Disaggregation on Ascend: Qwen3-VL Single-Node Deployment (1P1D)

  4 Feb, 2026

  Practical guide to deploying Qwen3-VL with Prefill-Decode separation on Ascend NPUs using OmniInfer. Covers minimal 1P1D setup, KV cache transfer, troubleshooting, and complete working scripts.