Preemtive generation still not working with Soniox STT (turn detection mode=STT)

[vvv-001]

Bug Description

Hi,

Looking at this issue:
#5536

And this fix:
#5553

It seems that preemptive generation is still not working with the Soniox plugin. We keep getting this warning message and see that preemptive generation is not working:

21:30:05.112 WARNING livekit.agents preemptive generation enabled but chat context or tools have changed afteron_user_turn_completed

When for turn detection mode the livekit end of turn model is selected it works, but when STT is selected it doesn't work and the above warning keeps appearing. This should also work for STT mode actually.

Expected Behavior

We checked against our own custom Soniox STT plugin, and see correctly preemptive generation working in turn detection STT mode.

21:27:39.982 DEBUG livekit.agents using preemptive generation

Reproduction Steps

1. Use Soniox STT from livekit plugins
2. Set turn detection mode to STT

Operating System

MacOS, Linux

Models Used

Any LLM, Soniox STT

Package Versions

livekit agents and livekit plugins Soniox, OpenAI, Soniox TTS 1.5.8

Session/Room/Call IDs

No response

Proposed Solution

Additional Context

No response

Screenshots and Recordings

No response

[longcw]

the warning means user transcript or chat context changed since the preemptive generation started.

actually, I cannot trigger preemptive generation when turn detection in on stt mode with Soniox STT. Soniox STT emits END_OF_SPEECH right after FINAL_TRANSCRIPT, so when final transcript receives it shouldn't meet the criteria for starting preemptive generation which needs either not stt turn detection mode or the END_OF_SPEECH received. can you share your config or example to reproduce this issue?

[vvv-001]

Hi @longcw the settings used are as follows:
Turn detection: enabled
Turn detection mode: STT
Min end pointing delay: 0.8
End pointing mode: fixed
Max end pointing delay: 2.8
Preemptive generation: enabled
Interruption mode: VAD

Does this help by any chance?