Skip to content

Issues: axolotl-ai-cloud/axolotl

Improve Adapter/LoRA handling
#1095 opened Jan 11, 2024 by winglian
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

231 Open 417 Closed
231 Open 417 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Using two 8xH100 nodes to train. encounter error bf16 requested, but AMP is not supported on this GPU. Requires Ampere series or above. bug Something isn't working
#1924 opened Sep 23, 2024 by michaellin99999
6 of 8 tasks
7
mistrall small support enhancement New feature or request
#1922 opened Sep 21, 2024 by win4r
5 tasks done
Gemma 2 chat template inserts eos_token after every chat turn bug Something isn't working
#1921 opened Sep 20, 2024 by Nero10578
6 of 8 tasks
Different training losses when flash_attention is on/off bug Something isn't working
#1918 opened Sep 18, 2024 by fly-dust
6 of 8 tasks
PR #1756 breaks last turn tokenization for phi-3.5 bug Something isn't working
#1916 opened Sep 13, 2024 by fozziethebeat
6 of 8 tasks
3
Add Support for Loading a Specific Dataset Revision enhancement New feature or request
#1911 opened Sep 12, 2024 by thomascleberg
5 tasks done
Running Example on Free T4 GPU through Google Colab bug Something isn't working
#1905 opened Sep 8, 2024 by hammad93
6 of 8 tasks
2
pretrain doesn't work on json\jsonl bug Something isn't working
#1895 opened Sep 5, 2024 by SicariusSicariiStuff
6 of 8 tasks
Llama 3.1 liger example is not working bug Something isn't working
#1892 opened Sep 4, 2024 by Stealthwriter
6 of 8 tasks
1
Preprocess --debug does not show newline \n token if previous string is ">" but shows if I add any other letter in the role fastchat bug Something isn't working
#1890 opened Sep 3, 2024 by Nero10578
7 of 8 tasks
2
Training with a large json dataset (>650K) throw error:pyarrow.lib.ArrowInvalid: offset overflow while concatenating arrays bug Something isn't working
#1888 opened Sep 3, 2024 by bofei5675
6 of 8 tasks
1
Load existing LORA and continue training it enhancement New feature or request
#1887 opened Sep 1, 2024 by Nero10578
5 tasks done
MixLoRA finetuning enhancement New feature or request
#1880 opened Aug 28, 2024 by winglian
5 tasks done
Unable to load ORPO dataset in a *.json file bug Something isn't working
#1868 opened Aug 26, 2024 by SicariusSicariiStuff
6 of 8 tasks
1
Model saving issue after training bug Something isn't working
#1842 opened Aug 21, 2024 by gothaleshubham
5 of 8 tasks
1
ORPO results in Cannot flatten integer dtype tensors bug Something isn't working
#1838 opened Aug 20, 2024 by maziyarpanahi
6 of 8 tasks
3
inst chat jinja template does not match prompt format used while training with conversation: mistral bug Something isn't working
#1832 opened Aug 18, 2024 by nyxkrage
6 of 8 tasks
Edge case for local dataset loading if its a folder enhancement New feature or request
#1830 opened Aug 17, 2024 by ccdv-ai
5 tasks done
Pass trust_remote_code to load_dataset(...) for datasets>=2.20.0 enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#1829 opened Aug 17, 2024 by ccdv-ai
5 tasks done
autoawq 0.2.6 causing conflicting dependencies bug Something isn't working
#1819 opened Aug 9, 2024 by Mr-Jeffery
6 of 8 tasks
5
Mistral Nemo 12B training CUDA Out of memory only when enabling EVAL. On 2x3090Ti FSDP. bug Something isn't working
#1813 opened Aug 6, 2024 by Nero10578
6 of 8 tasks
3
A wrapper of RESTful API - Web server on the top of Axolotl enhancement New feature or request
#1807 opened Aug 4, 2024 by ulhaqi12
5 tasks done
2
Zamba2AttentionDecoderLayer.forward() takes from 4 to 10 positional arguments but 11 were given bug Something isn't working wontfix This will not be worked on
#1799 opened Jul 30, 2024 by lucyknada
6 of 8 tasks
2
unhandled prompt tokenization strategy: sharegpt.load_glaive bug Something isn't working
#1787 opened Jul 26, 2024 by hasan9090
6 of 8 tasks
deprecate dataset_processes in preference of dataset_num_proc enhancement New feature or request
#1783 opened Jul 24, 2024 by winglian
5 tasks done
ProTip! Mix and match filters to narrow down what you’re looking for.