FSDP 分布式训练,全参、KTO训练,报错“Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:1! ” #4084
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: label_issue | |
| on: | |
| issues: | |
| types: | |
| - opened | |
| jobs: | |
| label_issue: | |
| runs-on: ubuntu-latest | |
| permissions: | |
| issues: write | |
| steps: | |
| - env: | |
| GH_TOKEN: ${{ secrets.GITHUB_TOKEN }} | |
| ISSUE_URL: ${{ github.event.issue.html_url }} | |
| ISSUE_TITLE: ${{ github.event.issue.title }} | |
| run: | | |
| LABEL="" | |
| NPU_KEYWORDS=(npu huawei ascend 华为 昇腾 910) | |
| ISSUE_TITLE_LOWER=$(echo $ISSUE_TITLE | tr '[:upper:]' '[:lower:]') | |
| for KEYWORD in ${NPU_KEYWORDS[@]}; do | |
| if [[ $ISSUE_TITLE_LOWER == *$KEYWORD* ]] && [[ $ISSUE_TITLE_LOWER != *input* ]]; then | |
| LABEL="npu" | |
| break | |
| fi | |
| done | |
| if [ -n "$LABEL" ]; then | |
| gh issue edit $ISSUE_URL --add-label $LABEL | |
| fi |