Skip to content

Commit 4f69a8d

Browse files
committed
Update BENCHMARKS.md
1 parent 9746f7a commit 4f69a8d

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

BENCHMARKS.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,10 +67,14 @@ Even with full guardrails, drift detection, and checkpointing enabled, L0 sustai
6767
| Current (H100) | ~100-200 | 600-1200x |
6868
| Blackwell (B200) | ~1000+ | 120x |
6969

70+
## Python Version Note
71+
72+
Benchmarks are run on Python 3.13. Python 3.14 shows ~30% slower async iteration performance when pydantic is imported, which affects L0's benchmark results. This appears to be a pydantic + Python 3.14 compatibility issue rather than a Python regression - raw async iteration without pydantic is nearly identical between versions. This will likely be resolved as pydantic adds better 3.14 support.
73+
7074
## Running Benchmarks
7175

7276
```bash
73-
uv run pytest tests/test_benchmark.py::TestComprehensiveReport -v -s
77+
uv run --python 3.13 pytest tests/test_benchmark.py::TestComprehensiveReport -v -s
7478
```
7579

7680
To run all benchmark tests:

0 commit comments

Comments
 (0)