Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[shardformer] update modeling to fit colo attention #5465

Merged
merged 14 commits into from
Mar 26, 2024
Merged

[shardformer] update modeling to fit colo attention #5465

merged 14 commits into from
Mar 26, 2024

Commits on Mar 15, 2024

  1. [misc] refactor folder structure

    @ver217
    ver217 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    ba95469 View commit details
    Browse the repository at this point in the history

  2. [shardformer] update llama flash-attn

    @ver217
    ver217 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    bcd53b1 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. [shardformer] fix llama policy

    @ver217
    ver217 committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    2ec3063 View commit details
    Browse the repository at this point in the history

  2. [devops] update tensornvme install

    @ver217
    ver217 committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    4ed3fea View commit details
    Browse the repository at this point in the history

  3. [test] update llama test

    @ver217
    ver217 committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    c8de1fd View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. [shardformer] update colo attn kernel dispatch

    @ver217
    ver217 committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    e582ab0 View commit details
    Browse the repository at this point in the history

  2. [shardformer] update blip2

    @ver217
    ver217 committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    96910be View commit details
    Browse the repository at this point in the history

  3. [shardformer] update chatglm

    @ver217
    ver217 committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    7d58d5e View commit details
    Browse the repository at this point in the history

  4. [shardformer] update gpt2

    @ver217
    ver217 committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    48b971a View commit details
    Browse the repository at this point in the history

  5. [shardformer] update gptj

    @ver217
    ver217 committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    59c89b2 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. [shardformer] update opt

    @ver217
    ver217 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    86096d7 View commit details
    Browse the repository at this point in the history

  2. [shardformer] update vit

    @ver217
    ver217 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    912a421 View commit details
    Browse the repository at this point in the history

  3. [shardformer] update colo attention mask prep

    @ver217
    ver217 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    b270492 View commit details
    Browse the repository at this point in the history

  4. [shardformer] update whisper

    @ver217
    ver217 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    0455557 View commit details
    Browse the repository at this point in the history