-
Notifications
You must be signed in to change notification settings - Fork 57
Open
Labels
3rd party packageIssue related to 3rd party packages, but not ExecuTorch, e.g. ExpoIssue related to 3rd party packages, but not ExecuTorch, e.g. ExpofeaturePRs that implement a new featurePRs that implement a new featureideaNew idea to enhance the library, suggestion, etc.New idea to enhance the library, suggestion, etc.modelIssues related to exporting, improving, fixing ML modelsIssues related to exporting, improving, fixing ML models
Description
Problem Description
As it stands for now, the RNE implementation of the Kokoro model supports 2 languages: 🇺🇸 American English and 🇬🇧 British English. Hovewer, the Kokoro model itself provides a support for many other languages, such as:
- 🇪🇸 Spanish
- 🇫🇷 French
- 🇮🇹 Italian
- 🇧🇷 Brazilian Portuguese
- 🇨🇳 Mandarin Chinese
The only significant requirement to support those languages is to provide an appropriate phonemization, similar to the one for English.
There is also a possibility of adding an external language, not supported by Kokoro originally, by finetuning the model and training a new voice.
What should be done
In case of a language already supported by Kokoro:
- Implement phonemization for given language in the phonemization package
In case of an external language:
- Implement phonemization for given language in the phonemization package
- Select an appropriate dataset containing speech samples for given language
- Finetune the model to produce a new voice for given language
Benefits to React Native ExecuTorch
Expands the Text to Speech function accessability for non-english users.
Metadata
Metadata
Assignees
Labels
3rd party packageIssue related to 3rd party packages, but not ExecuTorch, e.g. ExpoIssue related to 3rd party packages, but not ExecuTorch, e.g. ExpofeaturePRs that implement a new featurePRs that implement a new featureideaNew idea to enhance the library, suggestion, etc.New idea to enhance the library, suggestion, etc.modelIssues related to exporting, improving, fixing ML modelsIssues related to exporting, improving, fixing ML models