Bug: The bot generates repeated sentences #2594
Description
I'm adding this here for visibility / discussion / so we don't forget about this. The core issue is that the bot generated a repeated sentence and didn't stop until the ouptut context window was saturated. This in turn caused downstream issues. See the last message from this chat as an example. In fact, this happened twice in this chat, where the first one wasn't as severe. First on message 11 and then on message 13.
From the langfuse trace, it seems like the LLM is generating repeated sentences as apposed to it being due to some langchain / ocs bug.