Skip to content
Back to pull request #5789

[shardformer] Support 4D parallel + Flash Attention #1478

Sign in to view logs

[shardformer] Support 4D parallel + Flash Attention

[shardformer] Support 4D parallel + Flash Attention #1478

Triggered via pull request June 17, 2024 08:26
@EdenzzzzEdenzzzz
synchronize #5789
Edenzzzz:sp_flash_attn
Status Success
Total duration 45m 27s
Artifacts –

example_check_on_pr.yml

on: pull_request
Detect changed example files
9s
Detect changed example files
Matrix: Test the changed example
Fit to window
Zoom out
Zoom in

Annotations

2 warnings
Detect changed example files
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, tj-actions/glob@v17.2.5. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test the changed example (language/llama)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.