Skip to content

[Fix Bug] correct multi-gpu appearance style aggregation#207

Open
z-jiaming wants to merge 1 commit into
Vchitect:masterfrom
z-jiaming:master
Open

[Fix Bug] correct multi-gpu appearance style aggregation#207
z-jiaming wants to merge 1 commit into
Vchitect:masterfrom
z-jiaming:master

Conversation

@z-jiaming
Copy link
Copy Markdown

fix(vbench): correct multi-gpu appearance style aggregation

The multi-GPU path for appearance_style previously gathered per-video results from all ranks, but computed the final score from each video's cur_sim field. cur_sim only stores the last processed frame score for a video, while the single-GPU path reports the average score across all frames.

This caused single-GPU and multi-GPU evaluation runs to produce different top-level appearance_style scores even when their per-video video_results were identical.

Compute the distributed aggregate from video_results instead, matching the single-GPU behavior and the values written in the detailed results.

@z-jiaming z-jiaming changed the title correct multi-gpu appearance style aggregation [Fix Bug] correct multi-gpu appearance style aggregation Jun 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant