Search results

Low concurrency timeouts

Status: Open.

#269 In mlcommons/endpoints;

· arekay-nv opened on Apr 3, 2026

Phase 2 - Model selection

Status: Open.

#268 In mlcommons/endpoints;

· arekay-nv opened on Apr 3, 2026

Handling failed requests

Status: Open.

#254 In mlcommons/endpoints;

· arekay-nv opened on Apr 1, 2026

feat: multi-turn implementation

Status: Open.

#232 In mlcommons/endpoints;

· tianmu-li opened on Mar 31, 2026

Endpoints test environment

Status: Open.

#229 In mlcommons/endpoints;

· merlinf31 opened on Mar 30, 2026

Endpoints Vision document

Status: Open.

#228 In mlcommons/endpoints;

· merlinf31 opened on Mar 30, 2026

Add additional DB and Object Store elements from Requirements Doc

Status: Open.

#227 In mlcommons/endpoints;

· merlinf31 opened on Mar 30, 2026

feat: multiple performance configs in a submission config

Status: Open.

#224 In mlcommons/endpoints;

· tianmu-li opened on Mar 27, 2026

[Roadmap] Inference Endpoints Phase 2 Roadmap

RoadmapRoadmap for the projectsRoadmap for the projects

Status: Open.

#223 In mlcommons/endpoints;

· arekay-nv opened on Mar 27, 2026

test: KVStore, ServiceLauncher, and MetricsAggregator services lack integration tests

P1Priority 1: Something that is great to havePriority 1: Something that is great to have

testingTest coverage or test infrastructureTest coverage or test infrastructure

Status: Open.

#222 In mlcommons/endpoints;

· arekay-nv opened on Mar 27, 2026

bug: RuntimeSettings stores Random objects making benchmarks non-reproducible and non-serializable

bugSomething isn't workingSomething isn't working

P1Priority 1: Something that is great to havePriority 1: Something that is great to have

Status: Open.

#221 In mlcommons/endpoints;

· arekay-nv opened on Mar 27, 2026

test: SGLang adapter integration tests are permanently skipped

P1Priority 1: Something that is great to havePriority 1: Something that is great to have

testingTest coverage or test infrastructureTest coverage or test infrastructure

Status: Open.

#220 In mlcommons/endpoints;

· arekay-nv opened on Mar 27, 2026