Tag: modelarts
All the articles with the tag "modelarts".
-
Deploying Qwen3.6-27B-W8A8 on Huawei Ascend 910B with vLLM Ascend
Updated:A field-tested deployment guide for Qwen3.6-27B-W8A8 on Huawei Ascend 910B/A2 with vLLM Ascend v0.19.1rc1 and vLLM v0.19.1, covering CANN 8.5.2, Python 3.11, torch-npu 2.9, Triton Ascend, native kernels, ATB, graph mode, and the failure fixes needed to make deployment repeatable.
-
Deploying GLM-5 W4A8 on Huawei Cloud Ascend 910B x8
A field report on deploying GLM-5 W4A8 on ModelArts with 8 Ascend 910B cards. We solved Python stack issues and got the API server ready, but hit a decode blocker at the Ascend runtime layer. This is a practical summary of what worked, what broke, and where the real problem turned out to be.
-
From Zero to a Working Coding Assistant: Deploying Qwen3.5-9B on a Huawei Cloud 910B Notebook
A practical guide to deploying Qwen3.5-9B on Huawei Cloud ModelArts with Ascend 910B, including model selection, runtime setup, and opencode integration for coding assistance.
-
Deploy OpenClaw on Huawei Cloud ECS and Use Huawei ModelArts MaaS (OpenAI-Compatible)
A production-like runbook to deploy OpenClaw on Huawei Cloud ECS, wire it to Huawei ModelArts Studio (MaaS) via OpenAI-compatible APIs, and validate automation with cron-driven health checks (Telegram example).