Skip to content

[AMD][dsv4] fix 2P1D 8k1k straggler (decode/prefill context-length asymmetry)#2257

Closed
inkcherry wants to merge 1 commit into
SemiAnalysisAI:mainfrom
inkcherry:pr/dsv4-straggler-fix
Closed

[AMD][dsv4] fix 2P1D 8k1k straggler (decode/prefill context-length asymmetry)#2257
inkcherry wants to merge 1 commit into
SemiAnalysisAI:mainfrom
inkcherry:pr/dsv4-straggler-fix

dsv4 2P1D: set decode --context-length to match prefill (fix 8k1k str…

9bb01ec
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs