Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add block sparse api #7

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

add block sparse api #7

wants to merge 7 commits into from

Commits on May 26, 2023

  1. add sparse api

    @kuizhiqing
    kuizhiqing committed May 26, 2023
    Configuration menu
    Copy the full SHA
    48d9be3 View commit details
    Browse the repository at this point in the history

  2. include cu file

    @kuizhiqing
    kuizhiqing committed May 26, 2023
    Configuration menu
    Copy the full SHA
    be5cade View commit details
    Browse the repository at this point in the history

Commits on May 27, 2023

  1. support bf16 for block

    @kuizhiqing
    kuizhiqing committed May 27, 2023
    Configuration menu
    Copy the full SHA
    c51e944 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. fix bf16 bug in grad

    @kuizhiqing
    kuizhiqing committed May 29, 2023
    Configuration menu
    Copy the full SHA
    dc55747 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. add dim128 support for block sparsewq

    @kuizhiqing
    kuizhiqing committed May 31, 2023
    Configuration menu
    Copy the full SHA
    ff74bc0 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Add 128 hdim.

    @umiswing
    umiswing committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    98625ce View commit details
    Browse the repository at this point in the history

  2. Merge pull request #3 from umiswing/sparse_128_fix 

    Fix bug of sparse attn on hdim 128.
    @kuizhiqing
    kuizhiqing authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    5a82ddc View commit details
    Browse the repository at this point in the history