Tag: model-serving

All the articles with the tag "model-serving".

• How We Successfully Started Qwen3-Coder-Next on Huawei Ascend 910B with vLLM-Ascend 0.17

  28 Mar, 2026

  Complete deployment guide for Qwen3-Coder-Next on Huawei Ascend 910B with vLLM-Ascend 0.17. Documents the working configuration after multiple failed attempts, covering CANN 8.5.1, W8A8 quantization, worker startup modes, and KV cache management.