模型需要在BF16下工作，FP16无法正常工作 #771
-
|
在推理模型时，确保设备支持BF16 |
Beta Was this translation helpful? Give feedback.
Answered by
zRzRzRzRzRzRzR
May 7, 2025
Replies: 1 comment
-
|
使用FP16出现以下现象: 属于正常情况。 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
zRzRzRzRzRzRzR
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
使用FP16出现以下现象:
属于正常情况。
如果在vLLM中使用BF16也遇到上述问题，请尝试更新到原代码安装vLLM。