Updated Speechmatics STT integration #4359

sam-s10s · 2025-12-22T11:04:00Z

What's Changed?

Migrated from Speechmatics Real-Time SDK to new Voice SDK
Improved performance of the STT engine
Improved handling of speaker start / end events
Better handing of background speakers when in focus mode

Deprecation Warning

The end_of_utterance_mode has been changed to turn_detection_mode to reduce ambiguity
Use TurnDetectionMode.EXTERNAL (default) for any VAD within LiveKit
Use TurnDetectionMode.ADAPTIVE or TurnDetectionMode.SMART_TURN to use the plugin VAD / turn detection

longcw

LGTM! could you help to resolve the conflicts with the main branch. and something nit:

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

chenghao-mou · 2026-01-06T17:15:36Z

~~/test-stt~~

devin-ai-integration

Devin Review found 4 potential issues.

View issues and 7 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 12 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 12 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 2 new potential issues.

View issues and 13 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 14 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 15 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 16 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 4 new potential issues.

View issues and 19 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

commit c46013d Author: Long Chen <[email protected]> Date: Tue Feb 3 20:02:57 2026 +0800 add exclude_config_update to ChatContext copy (livekit#4700) commit 7849a8c Author: Chenghao Mou <[email protected]> Date: Tue Feb 3 09:51:07 2026 +0000 fix: commit user turn with STT and realtime (livekit#4663) commit edfa391 Author: Chenghao Mou <[email protected]> Date: Tue Feb 3 09:48:36 2026 +0000 add STT usage for google (livekit#4599) commit 34d0d62 Author: Long Chen <[email protected]> Date: Tue Feb 3 15:53:42 2026 +0800 fix gemini live tool execution interrupted by generation_complete event (livekit#4699) commit 1725929 Author: Long Chen <[email protected]> Date: Tue Feb 3 11:08:27 2026 +0800 prevent tool cancellation when AgentTask is called inside it (livekit#4586)

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 28 additional flags in Devin Review.

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 28 additional flags in Devin Review.

livekit-agents/livekit/agents/voice/agent.py

devin-ai-integration

Devin Review found 1 new potential issue.

View issue and 29 additional flags in Devin Review.

devin-ai-integration · 2026-02-03T15:29:51Z

livekit-agents/livekit/agents/voice/agent.py

+            old_allow_interruptions = speech_handle.allow_interruptions
+            speech_handle.allow_interruptions = False
+
        blocked_tasks = [current_task]
        if (
            old_activity._on_enter_task


🔴 SpeechHandle.allow_interruptions not restored if session._update_activity raises

In the InlineTask.__await_impl__ method, speech_handle.allow_interruptions is set to False before entering the try block, but restoration only occurs in the finally block. If session._update_activity() raises an exception (line 790), the finally block never executes and allow_interruptions remains permanently disabled.

Click to expand

Code flow showing the issue:

# Line 768-769: allow_interruptions is set to False old_allow_interruptions = speech_handle.allow_interruptions speech_handle.allow_interruptions = False # Lines 770-790: Various setup code runs OUTSIDE try block blocked_tasks = [current_task] # ... await session._update_activity(...) # If this raises, finally won't run! # Line 801-806: try/finally starts here try: return await asyncio.shield(self.__fut) finally: if speech_handle: speech_handle.allow_interruptions = old_allow_interruptions # Never reached if above throws

Impact:

If _update_activity fails for any reason (network issues, invalid state, etc.), the speech handle will be stuck with allow_interruptions=False, preventing all future interruptions for that speech. This could cause the agent to become uninterruptible, leading to a poor user experience where users cannot stop the agent from speaking.

(Refers to lines 768-790)

Recommendation: Move the speech_handle.allow_interruptions = False assignment inside the try block, or wrap the entire section from line 768 to the try block in a try/finally to ensure restoration happens regardless of where exceptions occur.

Was this helpful? React with 👍 or 👎 to provide feedback.

sam-s10s · 2026-02-03T15:34:43Z

LGTM! could you help to resolve the conflicts with the main branch. and something nit:

I have closed this PR and created a new one as the code base was far a drift from master.

#4703

sam-s10s added 8 commits December 22, 2025 10:53

Updated to use Voice SDK.

4259538

Include missing updates

d4d1662

format update

7655115

remove messages not needed

c43b6d9

mypy fixes

7681cd2

Updated for using FIXED as an end of turn mode.

096fc27

Ann START_ and END_OF_TURN messages by default

fd59362

remove extra debugging

d047bad

longcw approved these changes Jan 5, 2026

View reviewed changes

chenghao-mou reviewed Jan 5, 2026

View reviewed changes

sam-s10s added 3 commits January 20, 2026 10:23

Resolved comments in PR.

c9dd7cf

support for external VAD (e.g. Silero)

9959505

remove debug code

5bd61c5

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

sam-s10s added 5 commits February 2, 2026 18:20

doc update

8c96976

updated docs

3bf80a8

merged with PR

d2e7dbc

fixes from Devin AI

8576e2f

Merge branch 'main' into smx/stt-voice-sdk

8d221b1

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Outdated Show resolved Hide resolved

sam-s10s added 3 commits February 2, 2026 18:58

linting updates from CI

ee807ac

doc update

1569d05

fix from Devin AI

e306249

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Outdated Show resolved Hide resolved

Updated Devin AI errors

f1932e5

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Outdated Show resolved Hide resolved

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Show resolved Hide resolved

Added support for audio metrics

6ed69eb

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Outdated Show resolved Hide resolved

remove redundant disconnect() on Speechmatics client

a3d36dc

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Outdated Show resolved Hide resolved

restore disconnect()

24d4a6b

devin-ai-integration bot reviewed Feb 2, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Show resolved Hide resolved

attribute error

a8afc2d

davidzhao reviewed Feb 3, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Show resolved Hide resolved

Show deprecation warnings for migrated parameters.

628091c

devin-ai-integration bot reviewed Feb 3, 2026

View reviewed changes

sam-s10s added 4 commits February 3, 2026 11:49

type checking

f939ccc

fix to AgentServerMessageType

ba68543

fix missing dependency

38ed1b9

devin-ai-integration bot reviewed Feb 3, 2026

View reviewed changes

livekit-plugins/livekit-plugins-speechmatics/livekit/plugins/speechmatics/stt.py Outdated Show resolved Hide resolved

remove debug messages

434500d

devin-ai-integration bot reviewed Feb 3, 2026

View reviewed changes

livekit-agents/livekit/agents/voice/agent.py Show resolved Hide resolved

ignore on message

3b01689

sam-s10s closed this Feb 3, 2026

devin-ai-integration bot reviewed Feb 3, 2026

View reviewed changes

sam-s10s deleted the smx/stt-voice-sdk branch February 3, 2026 15:30

Updated Speechmatics STT integration #4359

Updated Speechmatics STT integration #4359

Uh oh!

Conversation

sam-s10s commented Dec 22, 2025 • edited by devin-ai-integration bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What's Changed?

Deprecation Warning

Uh oh!

longcw left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

chenghao-mou commented Jan 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

devin-ai-integration bot left a comment

Choose a reason for hiding this comment

Uh oh!

devin-ai-integration bot Feb 3, 2026

Choose a reason for hiding this comment

Code flow showing the issue:

Impact:

Uh oh!

sam-s10s commented Feb 3, 2026

Uh oh!

Reviewers

sam-s10s commented Dec 22, 2025 •

edited by devin-ai-integration bot

Loading

chenghao-mou commented Jan 6, 2026 •

edited

Loading