[shardformer]fix flash attention, when mask is casual, just don't unpad it #4712
Job | Run time |
---|---|
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
7s | |
7s | |
7s | |
1m 55s | |
58s | |
30m 12s | |
33m 26s |
Job | Run time |
---|---|
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
0s | |
7s | |
7s | |
7s | |
1m 55s | |
58s | |
30m 12s | |
33m 26s |