Truncated Response number or date with open-mixtral-8x7b on "la plateforme" #35
Description
Hello, Could you do something for the open-mixtral-8x7b model to fix the truncation bug on "la plateforme".
Here they explain what they did to solve it on a vllm server (with spacing between <s> and [INST]).
On api where they are in completion I solved the bug by following the issue resolution.