feat: text to speech (#546) #710

IgorSwat · 2026-01-09T08:46:21Z

Description

Introduces a breaking change?

Yes
No

Type of change

Bug fix (change which fixes an issue)
New feature (change which adds functionality)
Documentation update (improves or adds clarity to existing documentation)
Other (chores, tests, code style improvements etc.)

Tested on

iOS
Android

Testing instructions

Screenshots

Related issues

Checklist

I have performed a self-review of my code
I have commented my code, particularly in hard-to-understand areas
I have updated the documentation accordingly
My changes generate no new warnings

Additional notes

There are still a few side things to be done on this feature.

msluszniak

Please apply changes to all applicable places, I didn't repeated these comments. But overall, it looks really cool, these suggestions are just very small nits ;)

packages/react-native-executorch/common/rnexecutorch/data_processing/Sequential.h

packages/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Decoder.cpp

packages/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Decoder.h

packages/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Constants.h

...act-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/DurationPredictor.cpp

...ges/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Partitioner.cpp

packages/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Utils.cpp

chmjkb

Left some nits for the moment, I feel like we need to add docs to have a solid understanding of the public API layer. However, this looks like really a lot of solid work, congrats!

Haven't finished reviewing tho :D

apps/speech/screens/TextToSpeechScreen.tsx

packages/react-native-executorch/scripts/create-package.sh

packages/react-native-executorch/src/types/tts.ts

packages/react-native-executorch/src/constants/modelUrls.ts

Removed unnecessary Log.h include from RnExecutorchInstaller.h

Removed unnecessary iostream include from BaseModel.cpp

packages/react-native-executorch/src/types/tts.ts

packages/react-native-executorch/src/modules/natural_language_processing/TextToSpeechModule.ts

...act-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/DurationPredictor.cpp

...react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/DurationPredictor.h

packages/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Encoder.h

packages/react-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/Kokoro.cpp

msluszniak · 2026-01-13T09:49:36Z

Please also fix all the alerts that are right now.

IgorSwat · 2026-01-13T09:59:15Z

Please also fix all the alerts that are right now.

No alerts on my screen 🤷

packages/react-native-executorch/src/modules/natural_language_processing/TextToSpeechModule.ts

msluszniak · 2026-01-14T10:00:25Z

...act-native-executorch/common/rnexecutorch/models/text_to_speech/kokoro/DurationPredictor.cpp

+  std::priority_queue<std::pair<float, int>>
+      remainders; // Sorted by the first value
+  int64_t scaledSum = 0;
+  for (int i = 0; i < nTokens; i++) {


Change int to uint32_t

IgorSwat and others added 27 commits January 9, 2026 09:27

implement Kokoro components

15728a7

restructurize kokoro submodules

13da30f

main model logic

3a4a787

more progress...

9278ae0

kokoro main inference implemented

427fca8

text to speech prototype

d30a309

chore: remove create-package.sh

6799333

various fixes & improvements

66730cb

Temporary testing screen

2f233a9

reorganize DurationPredictor data flow

ca8a1b2

text-to-speech mvp

a31a20c

add ios support

98dfda9

implement fallback phonemization (US)

b3a38b4

fix 'ed' phonemization bug

3f706d7

add british support

dc52f73

add cropping audio vector

1a98997

small refactor

0415505

demo app finished

d78c936

update model input variants

d65e87a

implement input partitioning

a38a1c1

native side streaming

6cfad82

audio streaming fixed

bb27b40

enable additional model options

8299362

fix reload bug

e4025b4

update phonemis binaries

18c5da3

reduce phonemis android binaries size & other small fixes

050cbc7

implement a demo quiz app

f9ff668

IgorSwat requested review from benITo47, chmjkb and msluszniak January 9, 2026 08:46

IgorSwat requested a review from mkopcins January 9, 2026 08:46

msluszniak reviewed Jan 9, 2026

View reviewed changes

IgorSwat force-pushed the @is/text-to-speech branch from 571fada to 9eb0629 Compare January 9, 2026 13:58

This comment was marked as resolved.

Sign in to view

chmjkb requested changes Jan 9, 2026

View reviewed changes

chmjkb and others added 6 commits January 12, 2026 10:55

fix: revert legacy imports

e1f4d0b

chore: remove create-package.sh

bd9d83f

small code refactor

79eea5f

Remove Log.h include from RnExecutorchInstaller.h

ca76a5c

Removed unnecessary Log.h include from RnExecutorchInstaller.h

Remove unused iostream include

8f594d1

Removed unnecessary iostream include from BaseModel.cpp

remove doubled commits

2b633eb

IgorSwat force-pushed the @is/text-to-speech branch from 9eb0629 to 2b633eb Compare January 12, 2026 10:01

chmjkb requested changes Jan 12, 2026

View reviewed changes

apply review suggestions

c4c6f7c

msluszniak assigned IgorSwat Jan 13, 2026

msluszniak added the feature PRs that implement a new feature label Jan 13, 2026

msluszniak reviewed Jan 13, 2026

View reviewed changes

packages/react-native-executorch/src/modules/natural_language_processing/TextToSpeechModule.ts Outdated Show resolved Hide resolved

packages/react-native-executorch/src/modules/natural_language_processing/TextToSpeechModule.ts Outdated Show resolved Hide resolved

apply review suggestions

90ec4b9

IgorSwat force-pushed the @is/text-to-speech branch from 3871e1e to 90ec4b9 Compare January 13, 2026 10:41

msluszniak linked an issue Jan 13, 2026 that may be closed by this pull request

Text-to-Speech #546

Open

update phonemis library

7df0ae8

msluszniak reviewed Jan 14, 2026

View reviewed changes

feat: text to speech (#546) #710

Are you sure you want to change the base?

feat: text to speech (#546) #710

Uh oh!

Conversation

IgorSwat commented Jan 9, 2026

Description

Introduces a breaking change?

Type of change

Tested on

Testing instructions

Screenshots

Related issues

Checklist

Additional notes

Uh oh!

msluszniak left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

chmjkb left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

msluszniak commented Jan 13, 2026

Uh oh!

IgorSwat commented Jan 13, 2026

Uh oh!

Uh oh!

Uh oh!

msluszniak Jan 14, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

msluszniak left a comment •

edited

Loading

chmjkb left a comment •

edited

Loading