Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Setup allowing to use extra features: flash attention and IQ quants #216

Merged
merged 8 commits into from
Aug 21, 2024
Merged

Setup allowing to use extra features: flash attention and IQ quants #216

merged 8 commits into from
Aug 21, 2024

Commits on Aug 21, 2024

  1. move around code

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    157165e View commit details
    Browse the repository at this point in the history

  2. improve library setup and include build for extras

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    25a0d78 View commit details
    Browse the repository at this point in the history

  3. use full library for cuda if set

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    711ff3c View commit details
    Browse the repository at this point in the history

  4. include full build if set, remove setup dir

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    54cd32d View commit details
    Browse the repository at this point in the history

  5. add flash attention argument

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    cabb1c8 View commit details
    Browse the repository at this point in the history

  6. add setup extras button, show extras arguments if set

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    1ed2db7 View commit details
    Browse the repository at this point in the history

  7. download library after loading prefs, set max download progress of 0.… 

    …99 to avoid enabling editor, handle overwrite plugin
    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b37684a View commit details
    Browse the repository at this point in the history

  8. add extra and flash attention options to readme

    @amakropoulos
    amakropoulos committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    8f5679d View commit details
    Browse the repository at this point in the history