Skip to content

di ci: glm-5-2 1p 1d && 2p1d#1528

Open
JiaoliangYu wants to merge 3 commits into
ROCm:mainfrom
JiaoliangYu:add-glm-5-2-fp8-tp-case
Open

di ci: glm-5-2 1p 1d && 2p1d#1528
JiaoliangYu wants to merge 3 commits into
ROCm:mainfrom
JiaoliangYu:add-glm-5-2-fp8-tp-case

Conversation

@JiaoliangYu

Copy link
Copy Markdown
Contributor

Motivation

Add a GLM-5.2-FP8 ATOM DI CI case for TP-only 1P1D validation.

Technical Details

  • Add GLM-5.2-FP8 to models_atomesh.yaml.
  • Configure the model to use ${ATOMESH_MODEL_ROOT}/GLM-5.2-FP8/.
  • Run ATOM backend with FP8 KV cache.
  • Use 1P1D multi-node topology with one prefill TP8 worker and one decode TP8 worker.
  • Add benchmark concurrency levels: 128, 256.
  • Enable full GSM8K evaluation with few-shot 3.
  • Run GSM8K eval at concurrency 64 and 256.
  • Add a manual workflow dispatch switch: run_glm_5_2_fp8.

Test Plan

Test Result

Submission Checklist

@JiaoliangYu JiaoliangYu force-pushed the add-glm-5-2-fp8-tp-case branch from 0ffebf7 to 02102aa Compare July 9, 2026 05:04
@zufayu zufayu requested review from gyohuangxin and zufayu July 9, 2026 05:23
@JiaoliangYu JiaoliangYu force-pushed the add-glm-5-2-fp8-tp-case branch from 31ee712 to 02102aa Compare July 9, 2026 08:09
zufayu
zufayu previously approved these changes Jul 9, 2026
@JiaoliangYu JiaoliangYu changed the title di ci: glm-5-2 1p 1d di ci: glm-5-2 1p 1d && 2p1d Jul 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants