Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add UNet 1d for RL model for planning + colab #105

Merged
merged 69 commits into from
Nov 14, 2022
Merged

Add UNet 1d for RL model for planning + colab #105

merged 69 commits into from
Nov 14, 2022

Commits on Oct 3, 2022

  1. re-add RL model code

    @natolambert
    natolambert committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    8d1a17c View commit details
    Browse the repository at this point in the history

  2. match model forward api

    @natolambert
    natolambert committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    84e94d7 View commit details
    Browse the repository at this point in the history

  3. add register_to_config, pass training tests

    @natolambert
    natolambert committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    f67b036 View commit details
    Browse the repository at this point in the history

  4. fix tests, update forward outputs

    @natolambert
    natolambert committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    e42d1c0 View commit details
    Browse the repository at this point in the history

  5. remove unused code, some comments

    @natolambert
    natolambert committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    2dd514e View commit details
    Browse the repository at this point in the history

  6. add to docs

    @natolambert
    natolambert committed Oct 3, 2022
    Configuration menu
    Copy the full SHA
    b4c6188 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2022

  1. remove extra embedding code

    @natolambert
    natolambert committed Oct 6, 2022
    Configuration menu
    Copy the full SHA
    c53bba9 View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2022

  1. unify time embedding

    @natolambert
    natolambert committed Oct 7, 2022
    Configuration menu
    Copy the full SHA
    effcbdb View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2022

  1. remove conv1d output sequential

    @natolambert
    natolambert committed Oct 8, 2022
    Configuration menu
    Copy the full SHA
    7865231 View commit details
    Browse the repository at this point in the history

  2. remove sequential from conv1dblock

    @natolambert
    natolambert committed Oct 8, 2022
    Configuration menu
    Copy the full SHA
    35b0a43 View commit details
    Browse the repository at this point in the history

  3. style and deleting duplicated code

    @natolambert
    natolambert committed Oct 8, 2022
    Configuration menu
    Copy the full SHA
    9b1379d View commit details
    Browse the repository at this point in the history

  4. clean files

    @natolambert
    natolambert committed Oct 8, 2022
    Configuration menu
    Copy the full SHA
    e97a610 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2022

  1. remove unused variables

    @natolambert
    natolambert committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    8642560 View commit details
    Browse the repository at this point in the history

  2. clean variables

    @natolambert
    natolambert committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    f58c915 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into rl

    @natolambert
    natolambert committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    ad8376d View commit details
    Browse the repository at this point in the history

  4. add 1d resnet block structure for downsample

    @natolambert
    natolambert committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    3b08bea View commit details
    Browse the repository at this point in the history

  5. rename as unet1d

    @natolambert
    natolambert committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    aae2a9a View commit details
    Browse the repository at this point in the history

  6. fix renaming

    @natolambert
    natolambert committed Oct 10, 2022
    Configuration menu
    Copy the full SHA
    dd872af View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2022

  1. rename files

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    9b67bb7 View commit details
    Browse the repository at this point in the history

  2. add get_block(...) api

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    db012eb View commit details
    Browse the repository at this point in the history

  3. unify args for model1d like model2d

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    4db6e0b View commit details
    Browse the repository at this point in the history

  4. minor cleaning

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    634a526 View commit details
    Browse the repository at this point in the history

  5. fix docs

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    aebf547 View commit details
    Browse the repository at this point in the history

  6. improve 1d resnet blocks

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    305ecd8 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into rl

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    42855b9 View commit details
    Browse the repository at this point in the history

  8. fix tests, remove permuts

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    95d3a1c View commit details
    Browse the repository at this point in the history

  9. fix style

    @natolambert
    natolambert committed Oct 12, 2022
    Configuration menu
    Copy the full SHA
    6cbb73b View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2022

  1. add output activation

    @natolambert
    natolambert committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    ffb7355 View commit details
    Browse the repository at this point in the history

  2. rename flax blocks file

    @natolambert
    natolambert committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    a6314f6 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2022

  1. Add Value Function and corresponding example script to Diffuser imple… 

    …mentation (#884)

* valuefunction code

* start example scripts

* missing imports

* bug fixes and placeholder example script

* add value function scheduler

* load value function from hub and get best actions in example

* very close to working example

* larger batch size for planning

* more tests

* merge unet1d changes

* wandb for debugging, use newer models

* success!

* turns out we just need more diffusion steps

* run on modal

* merge and code cleanup

* use same api for rl model

* fix variance type

* wrong normalization function

* add tests

* style

* style and quality

* edits based on comments

* style and quality

* remove unused var

* hack unet1d into a value function

* add pipeline

* fix arg order

* add pipeline to core library

* community pipeline

* fix couple shape bugs

* style

* Apply suggestions from code review

Co-authored-by: Nathan Lambert <nathan@huggingface.co>
    @bglick13
    bglick13 and Nathan Lambert authored Oct 21, 2022
    Configuration menu
    Copy the full SHA
    48a7414 View commit details
    Browse the repository at this point in the history

  2. update post merge of scripts

    @natolambert
    natolambert committed Oct 21, 2022
    Configuration menu
    Copy the full SHA
    3acddb5 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2022

  1. add mdiblock / outblock architecture

    @natolambert
    natolambert committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    713e8f2 View commit details
    Browse the repository at this point in the history

  2. Pipeline cleanup (#947) 

    * valuefunction code

* start example scripts

* missing imports

* bug fixes and placeholder example script

* add value function scheduler

* load value function from hub and get best actions in example

* very close to working example

* larger batch size for planning

* more tests

* merge unet1d changes

* wandb for debugging, use newer models

* success!

* turns out we just need more diffusion steps

* run on modal

* merge and code cleanup

* use same api for rl model

* fix variance type

* wrong normalization function

* add tests

* style

* style and quality

* edits based on comments

* style and quality

* remove unused var

* hack unet1d into a value function

* add pipeline

* fix arg order

* add pipeline to core library

* community pipeline

* fix couple shape bugs

* style

* Apply suggestions from code review

* clean up comments

* convert older script to using pipeline and add readme

* rename scripts

* style, update tests

* delete unet rl model file

* remove imports in src

Co-authored-by: Nathan Lambert <nathan@huggingface.co>
    @bglick13
    bglick13 and Nathan Lambert authored Oct 24, 2022
    Configuration menu
    Copy the full SHA
    268ebdf View commit details
    Browse the repository at this point in the history

  3. Update src/diffusers/models/unet_1d_blocks.py

    Nathan Lambert authored Oct 24, 2022
    Configuration menu
    Copy the full SHA
    daa05fb View commit details
    Browse the repository at this point in the history

  4. Update tests/test_models_unet.py

    Nathan Lambert authored Oct 24, 2022
    Configuration menu
    Copy the full SHA
    ea5f231 View commit details
    Browse the repository at this point in the history

  5. RL Cleanup v2 (#965) 

    * valuefunction code

* start example scripts

* missing imports

* bug fixes and placeholder example script

* add value function scheduler

* load value function from hub and get best actions in example

* very close to working example

* larger batch size for planning

* more tests

* merge unet1d changes

* wandb for debugging, use newer models

* success!

* turns out we just need more diffusion steps

* run on modal

* merge and code cleanup

* use same api for rl model

* fix variance type

* wrong normalization function

* add tests

* style

* style and quality

* edits based on comments

* style and quality

* remove unused var

* hack unet1d into a value function

* add pipeline

* fix arg order

* add pipeline to core library

* community pipeline

* fix couple shape bugs

* style

* Apply suggestions from code review

* clean up comments

* convert older script to using pipeline and add readme

* rename scripts

* style, update tests

* delete unet rl model file

* remove imports in src

* add specific vf block and update tests

* style

* Update tests/test_models_unet.py

Co-authored-by: Nathan Lambert <nathan@huggingface.co>
    @bglick13
    bglick13 and Nathan Lambert authored Oct 24, 2022
    Configuration menu
    Copy the full SHA
    4f7a3a4 View commit details
    Browse the repository at this point in the history

  6. fix quality in tests

    @natolambert
    natolambert committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    d90b8b1 View commit details
    Browse the repository at this point in the history

  7. fix quality style, split test file

    @natolambert
    natolambert committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    ad8b6cf View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into rl

    @natolambert
    natolambert committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    e06a4a4 View commit details
    Browse the repository at this point in the history

  9. fix checks / tests

    @natolambert
    natolambert committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    99b2c81 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2022

  1. make timesteps closer to main

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    de4b6e4 View commit details
    Browse the repository at this point in the history

  2. unify block API

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    ef6ca1f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into rl

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    6e3485c View commit details
    Browse the repository at this point in the history

  4. unify forward api

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    e6f1a83 View commit details
    Browse the repository at this point in the history

  5. delete lines in examples

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    c35a925 View commit details
    Browse the repository at this point in the history

  6. style

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    949b93a View commit details
    Browse the repository at this point in the history

  7. examples style

    @natolambert
    natolambert committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    2f6462b View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2022

  1. all tests pass

    @natolambert
    natolambert committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    a2dd559 View commit details
    Browse the repository at this point in the history

  2. make style

    @natolambert
    natolambert committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    39dff73 View commit details
    Browse the repository at this point in the history

  3. make dance_diff test pass

    @natolambert
    natolambert committed Oct 26, 2022
    Configuration menu
    Copy the full SHA
    d5eedff View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2022

  1. Refactoring RL PR (#1200) 

    * init file changes

* add import utils

* finish cleaning files, imports

* remove import flags

* clean examples

* fix imports, tests for merge

* update readmes
    Nathan Lambert authored Nov 8, 2022
    Configuration menu
    Copy the full SHA
    faeacd5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into rl

    @natolambert
    natolambert committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    be25030 View commit details
    Browse the repository at this point in the history

  3. hotfix for tests

    @natolambert
    natolambert committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    72b7ee8 View commit details
    Browse the repository at this point in the history

  4. quality

    @natolambert
    natolambert committed Nov 8, 2022
    Configuration menu
    Copy the full SHA
    cf76a2d View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2022

  1. fix some tests

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    2290356 View commit details
    Browse the repository at this point in the history

  2. change defaults

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    a061f7e View commit details
    Browse the repository at this point in the history

  3. more mps test fixes

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    0c58758 View commit details
    Browse the repository at this point in the history

  4. unet1d defaults

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    691ddee View commit details
    Browse the repository at this point in the history

  5. do not default import experimental

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    4948ca7 View commit details
    Browse the repository at this point in the history

  6. defaults for tests

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    ac88677 View commit details
    Browse the repository at this point in the history

  7. fix tests

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    ba204db View commit details
    Browse the repository at this point in the history

  8. fix-copies

    @natolambert
    natolambert committed Nov 9, 2022
    Configuration menu
    Copy the full SHA
    915c41e View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2022

  1. Merge branch 'main' into rl

    @natolambert
    natolambert committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    c901889 View commit details
    Browse the repository at this point in the history

  2. fix

    @natolambert
    natolambert committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    becc803 View commit details
    Browse the repository at this point in the history

  3. changes per Patrik's comments (#1285) 

    * changes per Patrik's comments

* update conversion script
    @bglick13
    bglick13 authored Nov 14, 2022
    Configuration menu
    Copy the full SHA
    9b8e5ee View commit details
    Browse the repository at this point in the history

  4. fix renaming

    @natolambert
    natolambert committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    3684a8c View commit details
    Browse the repository at this point in the history

  5. skip more mps tests

    @natolambert
    natolambert committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    ebdef16 View commit details
    Browse the repository at this point in the history

  6. last test fix

    @natolambert
    natolambert committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    a259aae View commit details
    Browse the repository at this point in the history

  7. Update examples/rl/README.md

    Nathan Lambert authored Nov 14, 2022
    Configuration menu
    Copy the full SHA
    1f7702c View commit details
    Browse the repository at this point in the history