Exception: Could not find the transformer layer class to wrap in the model.

[Cloopen-ReLiNK]

Traceback (most recent call last):
File "/root/train.py", line 231, in
train()
File "/root/train.py", line 225, in train
trainer.train()
File "/root/anaconda3/envs/test/lib/python3.10/site-packages/transformers/trainer.py", line 1628, in train
return inner_training_loop(
File "/root/anaconda3/envs/test/lib/python3.10/site-packages/transformers/trainer.py", line 1715, in _inner_training_loop
model = self._wrap_model(self.model_wrapped)
File "/root/anaconda3/envs/test/lib/python3.10/site-packages/transformers/trainer.py", line 1442, in _wrap_model
raise Exception("Could not find the transformer layer class to wrap in the model.")
Exception: Could not find the transformer layer class to wrap in the model.

transformers installed from huggingface/transformers#21955

[Vivecccccc]

same issue here

[Vivecccccc]

wonder if you could execute these two with python which is instructed by huggingface/transformers#21955

tokenizer = transformers.LLaMATokenizer.from_pretrained("/output/path/tokenizer/")
model = transformers.LLaMAForCausalLM.from_pretrained("/output/path/llama-7b/")

I discovered that I couldn't, so I consider it might be due to the installation of that forked transformers...

[Vivecccccc]

Found possible solution here #58 (comment)