Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GGUF Support #3

Closed
sammcj opened this issue Aug 26, 2023 · 2 comments
Closed

GGUF Support #3

sammcj opened this issue Aug 26, 2023 · 2 comments

Comments

@sammcj
Copy link

sammcj commented Aug 26, 2023 •
edited
Loading

Howdy,

GGUF support has now been merged into llama-cpp-python, I believe this project might need a new release to add the support in.

(related to oobabooga/text-generation-webui#3676)
@sammcj sammcj mentioned this issue Aug 26, 2023
Closed
@jllllll
Copy link
Owner

jllllll commented Aug 26, 2023

Yeah, I know. Been building wheels for the past 5 hours. Github's runners seem to be somewhat slower than usual lately.

One thing to keep in mind with this, is that llama-cpp-python will no longer support GGML and only support GGUF.
Another thing to note is that ctransformers has already been updated in the webui with GGUF support.

Regardless, wheels will be uploaded soon.

@jllllll jllllll closed this as completed Aug 26, 2023
@sammcj
Copy link
Author

sammcj commented Aug 26, 2023

ohhh I just saw the actions tab and that you've been rate limited 😅 , thanks, appreciate your work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sammcj @jllllll