RWKV

/

rwkv-5-world-3b

Like 24

Follow

RWKV 314

I tried to fine tune the model with autotrain advanced, I got this exception:

File "/home/knut/transformers/lib/python3.9/site-packages/autotrain/utils.py", line 280, in wrapper
return func(*args, **kwargs)
File "/home/knut/transformers/lib/python3.9/site-packages/autotrain/trainers/clm/main.py", line 197, in train
model.resize_token_embeddings(len(tokenizer))
File "/home/knut/transformers/lib/python3.9/site-packages/transformers/modeling_utils.py", line 1563, in resize_token_embeddings
model_embeds = self._resize_token_embeddings(new_num_tokens, pad_to_multiple_of)
File "/home/knut/transformers/lib/python3.9/site-packages/transformers/modeling_utils.py", line 1577, in _resize_token_embeddings
old_embeddings = self.get_input_embeddings()
File "/home/knut/transformers/lib/python3.9/site-packages/transformers/modeling_utils.py", line 1354, in get_input_embeddings
raise NotImplementedError
NotImplementedError

Got an idea what's going on here?