Installation #26
Unanswered
MichaelMartinez
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello again!
I am using your fork exclusively now and I am not sure if I have it installed correctly. I am using Windows WSL2... please help me find any problems (this is a mix of various guides I've found):
NVidia CUDA Toolkit fix for bitsandbytes
chmod u+x $HOME/fix_cuda.sh
sudo
command execution passwordlessIn editor change line
to
Save file (
Ctrl+O
) and exit (Ctrl+X
)To check if everything works as intended run
sudo -ll
. Command has to execute without prompting for password/etc/environment
to add at the end of thePATH=
string:/usr/local/cuda-11.7/bin
/etc/ld.so.conf.d/cuda-11-7.conf
to add at the end of the file additional line/usr/local/cuda-11.7/lib64
Thankfully these changes seems to be permanent
Installation of textgen specific libraries and helpers:
1. Create new conda environment
The following two lines are optional to speed up installation process of prerequisites
More here - https://www.anaconda.com/blog/a-faster-conda-for-a-growing-community
Activate newly created environment:
2. Install prerequisites
For oobabooga/text-generation-webui
For finetuning
3. Install ph0rk0z textgen webUI
Testing that PEFT fork may not be needed anylonger...
May need to recompile cuda binaries with xformers install
Beta Was this translation helpful? Give feedback.
All reactions