Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ColossalChat] Colossalchat upgrade #5759

Merged
merged 19 commits into from
Jun 11, 2024
Merged

[ColossalChat] Colossalchat upgrade #5759

merged 19 commits into from
Jun 11, 2024

Commits on Jun 7, 2024

  1. upgrade colossal-chat support tp_group>1, add sp for sft

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    7a7e869 View commit details
    Browse the repository at this point in the history

  2. upgrade ppo dpo rm script

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    929e1e3 View commit details
    Browse the repository at this point in the history

  3. run pre-commit

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    7e65b71 View commit details
    Browse the repository at this point in the history

  4. moupdate ci tests, st ci test cases passed, tp failed in generation f… 

    …or ppo, sp is buggy
    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0b4a335 View commit details
    Browse the repository at this point in the history

  5. fix training script

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    7ae87b3 View commit details
    Browse the repository at this point in the history

  6. fix ci

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    b1031f7 View commit details
    Browse the repository at this point in the history

  7. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci @YeAnbang
    pre-commit-ci[bot] authored and YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    1b880ce View commit details
    Browse the repository at this point in the history

  8. fix transformers version

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    b8b5cac View commit details
    Browse the repository at this point in the history

  9. remove duplicated test

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    62eb28b View commit details
    Browse the repository at this point in the history

  10. fix datasets version

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0bbac15 View commit details
    Browse the repository at this point in the history

  11. remove models that require huggingface auth from ci

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    bf57b13 View commit details
    Browse the repository at this point in the history

  12. remove local data path

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    45195ac View commit details
    Browse the repository at this point in the history

  13. update ci

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    e16ccc2 View commit details
    Browse the repository at this point in the history

  14. remove baichuan from template test due to transformer version conflict

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    ac1520c View commit details
    Browse the repository at this point in the history

  15. merge

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    790e136 View commit details
    Browse the repository at this point in the history

  16. replace the customized dataloader setup with the build-in one

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    0d7ff10 View commit details
    Browse the repository at this point in the history

  17. replace the customized dataloader setup with the build-in one

    @YeAnbang
    YeAnbang committed Jun 7, 2024
    Configuration menu
    Copy the full SHA
    77db216 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. fix readme

    @YeAnbang
    YeAnbang committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    2abdede View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. update sft trainning script

    @YeAnbang
    YeAnbang committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    84eab13 View commit details
    Browse the repository at this point in the history