Search results

Return annotations for all items marked as shareable, not a %

Status: Open.

#1426 In mlcommons/modelbench;

· rogthefrog opened on Dec 19, 2025

Move grumblebot to #airr-alerts

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

Status: Open.

#1424 In mlcommons/modelbench;

· superdosh opened on Dec 18, 2025

update dependencies

Status: Open.

#1418 In mlcommons/modelbench;

· wpietri opened on Dec 15, 2025

Results and annotation file names should include a timestamp

choreShould do it, but it doesn't directly create valueShould do it, but it doesn't directly create value

Status: Open.

#1415 In mlcommons/modelbench;

· rogthefrog opened on Dec 12, 2025

Update prompt set file handling to support shareability flag

Status: Open.

#1414 In mlcommons/modelbench;

· rogthefrog opened on Dec 11, 2025

BaaS should look up and use the latest modelbench image tag

Status: Open.

#1412 In mlcommons/modelbench;

· rogthefrog opened on Dec 9, 2025

Add benchmark version to results.json

Status: Open.

#1406 In mlcommons/modelbench;

· rogthefrog opened on Dec 3, 2025

MLC wrangler modelmap should reflect actual availability per model

Status: Open.

#1404 In mlcommons/modelbench;

· superdosh opened on Dec 2, 2025

BaaS /status should not return 200 with a null response for jobs that are just starting up and have no progress yet

Status: Open.

#1401 In mlcommons/modelbench;

· rogthefrog opened on Nov 26, 2025

BaaS /results should not return 200 with a null response for failed jobs

Status: Open.

#1400 In mlcommons/modelbench;

· rogthefrog opened on Nov 26, 2025

Dynamic SUT picker

Status: Open.

#1394 In mlcommons/modelbench;

· wpietri opened on Nov 19, 2025

OpenAI client no longer json-serializable.

bugSomething isn't workingSomething isn't working

Status: Open.

#1391 In mlcommons/modelbench;

· superdosh opened on Nov 18, 2025