Skip to content

pjin/hross/mt-verifiers-dev-20251202 #432

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
pjin-nvidia wants to merge 100 commits into
base: main
Choose a base branch
from
Draft

pjin/hross/mt-verifiers-dev-20251202 #432

pjin-nvidia wants to merge 100 commits into from

Conversation

@pjin-nvidia
Copy link
Contributor

@pjin-nvidia pjin-nvidia commented Dec 3, 2025

No description provided.

@pjin-nvidia
Miscellaneous infra.
316d43e 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Ray utils.
dd953b0 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
No cover.
5717d7a 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Remove DEBUG. Comment.
4ecd8d3 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Comment about ray package extra.
8103dbf 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
The.
dc493d5 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/misc-infra
f9e5d8f 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Fix test (?).
9502d82 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Initial support for server pyproject.toml (WIP).
0475d5e 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Fix pyproject.toml check.
d86756b 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Working directory Path.
79028a6 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Install a server venv from pyproject.toml if available.
7e62b1d 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Deprecated vllm_model requirements.txt.
36efb94 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Consistently use dashes in package names.
8d49b95 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Lint.
6fb0a95 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Cleanup.
7231efa 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
VLLM server spinup.
8fc0d9d 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
VLLM server host and port.
8975e98 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Allocate the free port for VLLM in the model server process.
51ba6fc 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Type.
aa97796 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Fix for pyproject.toml (this works lol).
6ec9325 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
VLLM server "routing" (just re-using the existing multiple clients).
33ec3f9 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Better order.
77cda85 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/ray-utils
44dcee1 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
WIP.
a85f4f0 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Comment.
7201c8f 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Default to "mp" backend.
834d9b9 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Cleanup.
5ee8b57 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Cleanup.
10b5295 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Non-async VLLM server heartbeat to avoid early asyncio event loop.
e4c5573 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Merge remote-tracking branch 'origin/main' into pjin/ray-utils
d4b8074 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Matching the misc infra PR.
8fe389f 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
No cover.
613efb4 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Global scheduling helper to track free GPUs of schedulable ray nodes.
7575eb6 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Rename.
d7e1683 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Print.
f7c1937 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Avoid an unnecessary ray import.
2d37d17 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Try to pass the linter.
a35f58d 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Test.
1b53089 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Tests.
6327760 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Fix test.
f5466f9 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Fix test.
7a7e952 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Unfix test.
eab68a0 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Revert to just cd into working dir.
66b788d 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Deduplicate.
a78f226 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Also add explicit check for requirements.txt.
fdb54fe 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Revert format.
3fb2911 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
VLLMModel refresh.
d62ab6c 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Merge remote-tracking branch 'origin/pjin/misc-infra' into pjin/hross…
243ba60 
…/mt-verifiers-dev-20251202

Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Add vllm_model pyproject.toml (depends on PR #317).
7809170 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Unpin vllm version.
156f039 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Consolidated ray actor env vars setup.
21ba79e 
Signed-off-by: Peter Jin <[email protected]>
@pjin-nvidia
Merge remote-tracking branch 'origin/pjin/ray-utils' into pjin/hross/…
8c70fa1 
…mt-verifiers-dev-20251202

Signed-off-by: Peter Jin <[email protected]>
@copy-pr-bot
Copy link

copy-pr-bot bot commented Dec 3, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@pjin-nvidia @kbhardwaj-nvidia