Skip to content

[shardformer] Support 4D parallel + Flash Attention #7642

[shardformer] Support 4D parallel + Flash Attention

[shardformer] Support 4D parallel + Flash Attention #7642

Triggered via pull request June 17, 2024 08:30
Status Skipped
Total duration 2s
Artifacts

build_on_pr.yml

on: pull_request
Detect file change
0s
Detect file change
Build and Test Colossal-AI
0s
Build and Test Colossal-AI
Fit to window
Zoom out
Zoom in