cohere extension experiment to the paper : One Tokenizer to Rule Them All
you can support my work here
training run for the universal tokenizer finetune :
Demon-Sheriff/shared_bias_tokenizer
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation