How to generate my own wordpiece.json #7
Description
Hello, I have found that there are many semantic unrelated tokens in mimic_wordpiece.json. So I want to generate my own wordpiece file. How could I achieve it?
{{ message }}
Hello, I have found that there are many semantic unrelated tokens in mimic_wordpiece.json. So I want to generate my own wordpiece file. How could I achieve it?