The LLaMA PR has been merged into transformers

huggingface/transformers#21955 The tokenizer class has been changed from "LLaMATokenizer" to "LlamaTokenizer" It is necessary to edit this change in every tokenizer_config.json that you had for LLaMA so far.
Ph0rk0z · Mar 16, 2023 · a5b007c · a5b007c
1 parent 51b67a0
commit a5b007c
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/requirements.txt b/requirements.txt
@@ -9,4 +9,4 @@ rwkv==0.4.2
 safetensors==0.3.0
 sentencepiece
 tqdm
-git+https://github.com/zphang/transformers.git@68d640f7c368bcaaaecfc678f11908ebbd3d6176
+git+https://github.com/huggingface/transformers