Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI]Split XPU distributed UT into another job #1371

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

zxd1997066
Copy link
Contributor

No description provided.

@zxd1997066 zxd1997066 marked this pull request as ready for review February 17, 2025 08:20
Copy link
Contributor

@chuanqi129 chuanqi129 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The split means, we add 2 jobs in ./.github/workflows/_linux_ut.yml one for non-distributed ut test(already exist), another for distributed UT

@@ -233,6 +221,31 @@ jobs:
ut: op_extended
runner: linux.idc.xpu

preci-linux-build-distributed:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove this job, we don't need 2 builds

@zxd1997066 zxd1997066 force-pushed the xiangdong/split_ddp branch 3 times, most recently from e191aaf to cc2b42b Compare February 18, 2025 14:25
@chuanqi129
Copy link
Contributor

Please add if condition for ut_test job also, if the ut scope only has distributed ut this job will not be triggered also

@zxd1997066 zxd1997066 force-pushed the xiangdong/split_ddp branch 3 times, most recently from 332ce7b to a426c25 Compare February 19, 2025 03:15
path: ${{ github.workspace }}/ut_log

distributed_ut_test:
runs-on: ${{ inputs.runner }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's hardcode the distributed runner as pvc_e2e

@@ -49,6 +49,7 @@ permissions: read-all
jobs:
ut_test:
runs-on: ${{ inputs.runner }}
if: contains(inputs.ut, 'xpu_distributed') == false
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if: contains(inputs.ut, 'xpu_distributed') == false
if: ${{ inputs.ut != 'xpu_distributed' }}

@chuanqi129
Copy link
Contributor

@zxd1997066 zxd1997066 force-pushed the xiangdong/split_ddp branch 2 times, most recently from 1eda649 to 80b8447 Compare February 21, 2025 12:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants