Skip to content

Poc tileir gpu spaces - #61

Open
macqueen09 wants to merge 5 commits into
flagos-ai:mainfrom
kateyijian:poc-tileir-gpu-spaces
Open

Poc tileir gpu spaces#61
macqueen09 wants to merge 5 commits into
flagos-ai:mainfrom
kateyijian:poc-tileir-gpu-spaces

Conversation

@macqueen09

Copy link
Copy Markdown

主要功能:

  1. 新增 tle.gpu DSL,支持 alloc / copy / to_tensor / subview / store_tensor / to_buffer。
  2. tle.gpu 原语可以下降到 CommonIR TileIR:tile.alloc / tile.copy / tile.to_tensor / tile.subview / tile.store_tensor。
  3. GPU 侧 TileIR buffer memory space 增加 global / shared / local / register。
  4. FLIR 侧新增 tile-infer-layout pass,补默认 TileIR layout。
  5. NVIDIA 后端增加 TileIR -> TTGIR lowering,matmul 路径中 tile.copy/to_tensor 可继续降到 triton_gpu.local_alloc / async_copy_global_to_local / local_load。
  6. native_matmul_gpu.py 新增 tle.gpu matmul 对照测试。
  7. native_fa.py 已替换 Q/K/V staging 路径为 tle.gpu.alloc/copy/to_tensor。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants