Skip to content

[QNN_EP] Rewrite QKV split to remove 5D Ops. - #745

Open
ankus-qti wants to merge 2 commits into
mainfrom
dev/ankus/QKV_fusion_window_partition_fusion
Open

ankus-qti wants to merge 2 commits into
mainfrom
dev/ankus/QKV_fusion_window_partition_fusion

Conversation

@ankus-qti

Copy link
Copy Markdown
Collaborator

Description

Rewrite high-rank tensor patterns in Swin-Transformer-style attention into rank-≤4 QNN ops on the HTP backend.

Motivation and Context

Rank-5 tensors are supported on HTP but perform poorly; these fusions eliminate them from the hot path and achieve ~2x perf gain.
Before: 1005 ms
After: 502 ms

Adrressing claude review comments.

Signed-off-by: ankus <ankus@qti.qualcomm.com>
@ankus-qti
ankus-qti force-pushed the dev/ankus/QKV_fusion_window_partition_fusion branch from 4d7446e to 3e633ec Compare August 21, 2026 03:32

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant