Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[optim] Distributed Adafactor #5484

Merged
merged 36 commits into from
Apr 30, 2024
Merged

[optim] Distributed Adafactor #5484

merged 36 commits into from
Apr 30, 2024

Commits on Apr 8, 2024

  1. [feature] solve conflict; update optimizer readme;

    @duanjunwen
    duanjunwen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    f77ffc2 View commit details
    Browse the repository at this point in the history

  2. [feature] update optimize readme;

    @duanjunwen
    duanjunwen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    b75ac58 View commit details
    Browse the repository at this point in the history

  3. [fix] fix testcase;

    @duanjunwen
    duanjunwen committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    d5f72fe View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. [feature] Add transformer-bert to testcase;solve a bug related to ind… 

    …ivisible shape (induction in use_zero and tp is row parallel);
    @duanjunwen
    duanjunwen committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    020ed54 View commit details
    Browse the repository at this point in the history

  2. [feature] Add transformers_bert model zoo in testcase;

    @duanjunwen
    duanjunwen committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    ce58adf View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. [feature] add user documentation to docs/source/feature.

    @duanjunwen
    duanjunwen committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    efac2a1 View commit details
    Browse the repository at this point in the history

  2. [feature] add API Reference & Sample to optimizer Readme; add state c… 

    …heck for bert exam;
    @duanjunwen
    duanjunwen committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    40a5528 View commit details
    Browse the repository at this point in the history

  3. [feature] modify user documentation;

    @duanjunwen
    duanjunwen committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    1c9bb93 View commit details
    Browse the repository at this point in the history

  4. [fix] fix readme format issue;

    @duanjunwen
    duanjunwen committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    1039f34 View commit details
    Browse the repository at this point in the history

  5. [fix] add zero=0 in testcase; cached augment in dict;

    @duanjunwen
    duanjunwen committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    2ffca49 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. [fix] fix percision issue;

    @duanjunwen
    duanjunwen committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    0fd62a0 View commit details
    Browse the repository at this point in the history

  2. [feature] add distributed rms;

    @duanjunwen
    duanjunwen committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    28c3a40 View commit details
    Browse the repository at this point in the history

  3. [feature] remove useless comment in testcase;

    @duanjunwen
    duanjunwen committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a9c5bf7 View commit details
    Browse the repository at this point in the history

  4. [fix] Remove useless test; open zero test; remove fp16 test in bert e… 

    …xam;
    @duanjunwen
    duanjunwen committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    150ac19 View commit details
    Browse the repository at this point in the history

  5. [feature] Extract distributed rms function;

    @duanjunwen
    duanjunwen committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    e783599 View commit details
    Browse the repository at this point in the history

  6. [feature] add booster + lowlevelzeroPlugin in test;

    @duanjunwen
    duanjunwen committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    9d33a34 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. [feature] add Start_with_booster_API case in md; add Supporting Infor… 

    …mation in md;
    @duanjunwen
    duanjunwen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    419c1c0 View commit details
    Browse the repository at this point in the history

  2. [fix] Also remove state movement in base adafactor;

    @duanjunwen
    duanjunwen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    c84fb52 View commit details
    Browse the repository at this point in the history

  3. [feature] extract factor function;

    @duanjunwen
    duanjunwen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    2eb069d View commit details
    Browse the repository at this point in the history

  4. [feature] add LowLevelZeroPlugin test;

    @duanjunwen
    duanjunwen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    6303291 View commit details
    Browse the repository at this point in the history

  5. [fix] add tp=False and zero=True in logic;

    @duanjunwen
    duanjunwen committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    60489ab View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2024

  1. [fix] fix use zero logic;

    @duanjunwen
    duanjunwen committed Apr 13, 2024
    Configuration menu
    Copy the full SHA
    02ea83e View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2024

  1. [feature] add row residue logic in column parallel factor;

    @duanjunwen
    duanjunwen committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    fb14125 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. [feature] add check optim state func;

    @duanjunwen
    duanjunwen committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    2dc0341 View commit details
    Browse the repository at this point in the history

  2. [feature] Remove duplicate logic;

    @duanjunwen
    duanjunwen committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    3168a59 View commit details
    Browse the repository at this point in the history

  3. [feature] update optim state check func and percision test bug;

    @duanjunwen
    duanjunwen committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    3bca491 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. [fix] update/fix optim state; Still exist percision issue;

    @duanjunwen
    duanjunwen committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    1357dd1 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. [fix] Add use_zero check in _rms; Add plugin support info in Readme; … 

    …Add Dist Adafactor init Info;
    @duanjunwen
    duanjunwen committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    1038b23 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/dist-optim-upstream' into dist_adafactor

    @duanjunwen
    duanjunwen committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    2c92350 View commit details
    Browse the repository at this point in the history

  3. [feature] removed print & comments in utils;

    @duanjunwen
    duanjunwen committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    87746ec View commit details
    Browse the repository at this point in the history

  4. [feature] uodate Readme;

    @duanjunwen
    duanjunwen committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    42b8cf5 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. [feature] add LowLevelZeroPlugin test with Bert model zoo;

    @duanjunwen
    duanjunwen committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    510d4c0 View commit details
    Browse the repository at this point in the history

  2. [fix] fix logic in _rms;

    @duanjunwen
    duanjunwen committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    0a7f682 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    40c5f51 View commit details
    Browse the repository at this point in the history

  4. [fix] remove comments in testcase;

    @duanjunwen
    duanjunwen committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    91310e9 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. [feature] add zh-Han Readme;

    @duanjunwen
    duanjunwen committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    3046daf View commit details
    Browse the repository at this point in the history