Skip to content

Conversation

@zxpdemonio
Copy link
Contributor

support configurable gpu count and memory fraction:

  • gpu count is set equal to the _world_size, which could be configured by environment variable WORLD_SIZE
  • mem fraction could be configured when ParameterServer initialized, and the deafult value is 0.9

@stmatengss
Copy link
Contributor

For improved formatting, use pre-commit run --all-files to pass CI.

Signed-off-by: Cruz Zhao <[email protected]>
@weixiao-huang weixiao-huang merged commit 8a60e65 into MoonshotAI:main Oct 13, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants