Skip to content

chore(ci): update system tests ref sha#17516

Open
juanjux wants to merge 2 commits intomainfrom
juanjux/update-systemtest-hash-new
Open

chore(ci): update system tests ref sha#17516
juanjux wants to merge 2 commits intomainfrom
juanjux/update-systemtest-hash-new

Conversation

@juanjux
Copy link
Copy Markdown
Collaborator

@juanjux juanjux commented Apr 14, 2026

Description

Update system tests ref sha.

@juanjux
update system tests ref sha
65db2c8 
Signed-off-by: Juanjo Alvarez <juanjo.alvarezmartinez@datadoghq.com>
@juanjux juanjux self-assigned this Apr 14, 2026
@juanjux juanjux added the changelog/no-changelog A changelog entry is not required for this PR. label Apr 14, 2026
@juanjux juanjux requested review from a team as code owners April 14, 2026 13:19
@juanjux juanjux requested review from Yun-Kim and emmettbutler April 14, 2026 13:19
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 14, 2026

Performance SLOs

Comparing candidate juanjux/update-systemtest-hash-new (7b3d220) with baseline main (0a9ca52)

❌ Test Failures (1 suite)
❌ codeprovenancefork - 1/2

❌ fork-10

Time: ❌ 2.344s (SLO: <2.300s +1.9%) vs baseline: +2.8%

Memory: ✅ 17.419MB (SLO: <20.000MB 📉 -12.9%) vs baseline: +4.9%

📈 Performance Regressions (3 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 103.498µs (SLO: <130.000µs 📉 -20.4%) vs baseline: +2.4%

Memory: ✅ 43.899MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%

✅ add_inplace_aspect

Time: ✅ 101.335µs (SLO: <130.000µs 📉 -22.1%) vs baseline: -0.3%

Memory: ✅ 43.928MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%

✅ add_inplace_noaspect

Time: ✅ 28.380µs (SLO: <40.000µs 📉 -29.0%) vs baseline: +0.6%

Memory: ✅ 43.797MB (SLO: <46.000MB -4.8%) vs baseline: +5.0%

✅ add_noaspect

Time: ✅ 48.778µs (SLO: <70.000µs 📉 -30.3%) vs baseline: -2.3%

Memory: ✅ 43.937MB (SLO: <46.000MB -4.5%) vs baseline: +5.6%

✅ bytearray_aspect

Time: ✅ 252.750µs (SLO: <400.000µs 📉 -36.8%) vs baseline: -7.9%

Memory: ✅ 43.864MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ bytearray_extend_aspect

Time: ✅ 653.654µs (SLO: <800.000µs 📉 -18.3%) vs baseline: -0.7%

Memory: ✅ 43.920MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%

✅ bytearray_extend_noaspect

Time: ✅ 265.577µs (SLO: <400.000µs 📉 -33.6%) vs baseline: -0.2%

Memory: ✅ 43.937MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%

✅ bytearray_noaspect

Time: ✅ 139.764µs (SLO: <300.000µs 📉 -53.4%) vs baseline: -2.2%

Memory: ✅ 44.045MB (SLO: <46.000MB -4.2%) vs baseline: +5.9%

✅ bytes_aspect

Time: ✅ 220.536µs (SLO: <300.000µs 📉 -26.5%) vs baseline: -6.9%

Memory: ✅ 43.863MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ bytes_noaspect

Time: ✅ 133.654µs (SLO: <200.000µs 📉 -33.2%) vs baseline: -3.3%

Memory: ✅ 43.871MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ bytesio_aspect

Time: ✅ 3.824ms (SLO: <5.000ms 📉 -23.5%) vs baseline: -1.4%

Memory: ✅ 43.886MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%

✅ bytesio_noaspect

Time: ✅ 315.987µs (SLO: <420.000µs 📉 -24.8%) vs baseline: +0.2%

Memory: ✅ 43.911MB (SLO: <46.000MB -4.5%) vs baseline: +5.8%

✅ capitalize_aspect

Time: ✅ 88.075µs (SLO: <300.000µs 📉 -70.6%) vs baseline: -1.0%

Memory: ✅ 43.860MB (SLO: <46.000MB -4.7%) vs baseline: +5.1%

✅ capitalize_noaspect

Time: ✅ 262.642µs (SLO: <300.000µs 📉 -12.5%) vs baseline: +1.2%

Memory: ✅ 43.856MB (SLO: <46.000MB -4.7%) vs baseline: +5.4%

✅ casefold_aspect

Time: ✅ 88.593µs (SLO: <500.000µs 📉 -82.3%) vs baseline: -0.7%

Memory: ✅ 43.809MB (SLO: <46.000MB -4.8%) vs baseline: +5.2%

✅ casefold_noaspect

Time: ✅ 304.468µs (SLO: <500.000µs 📉 -39.1%) vs baseline: -2.2%

Memory: ✅ 43.849MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%

✅ decode_aspect

Time: ✅ 86.941µs (SLO: <100.000µs 📉 -13.1%) vs baseline: +0.3%

Memory: ✅ 43.864MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%

✅ decode_noaspect

Time: ✅ 157.774µs (SLO: <210.000µs 📉 -24.9%) vs baseline: +1.4%

Memory: ✅ 43.908MB (SLO: <46.000MB -4.5%) vs baseline: +5.3%

✅ encode_aspect

Time: ✅ 84.530µs (SLO: <200.000µs 📉 -57.7%) vs baseline: ~same

Memory: ✅ 43.827MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%

✅ encode_noaspect

Time: ✅ 143.097µs (SLO: <200.000µs 📉 -28.5%) vs baseline: -2.1%

Memory: ✅ 43.941MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%

✅ format_aspect

Time: ✅ 14.565ms (SLO: <19.200ms 📉 -24.1%) vs baseline: -0.3%

Memory: ✅ 43.943MB (SLO: <46.000MB -4.5%) vs baseline: +5.1%

✅ format_map_aspect

Time: ✅ 16.388ms (SLO: <21.500ms 📉 -23.8%) vs baseline: ~same

Memory: ✅ 43.957MB (SLO: <46.000MB -4.4%) vs baseline: +5.1%

✅ format_map_noaspect

Time: ✅ 383.572µs (SLO: <500.000µs 📉 -23.3%) vs baseline: +2.5%

Memory: ✅ 43.941MB (SLO: <46.000MB -4.5%) vs baseline: +5.7%

✅ format_noaspect

Time: ✅ 313.768µs (SLO: <500.000µs 📉 -37.2%) vs baseline: ~same

Memory: ✅ 43.872MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%

✅ index_aspect

Time: ✅ 139.682µs (SLO: <300.000µs 📉 -53.4%) vs baseline: 📈 +10.4%

Memory: ✅ 43.842MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%

✅ index_noaspect

Time: ✅ 41.272µs (SLO: <300.000µs 📉 -86.2%) vs baseline: +1.8%

Memory: ✅ 43.847MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%

✅ join_aspect

Time: ✅ 209.798µs (SLO: <300.000µs 📉 -30.1%) vs baseline: -4.3%

Memory: ✅ 43.962MB (SLO: <46.000MB -4.4%) vs baseline: +5.5%

✅ join_noaspect

Time: ✅ 142.767µs (SLO: <300.000µs 📉 -52.4%) vs baseline: -2.0%

Memory: ✅ 43.877MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%

✅ ljust_aspect

Time: ✅ 503.497µs (SLO: <700.000µs 📉 -28.1%) vs baseline: -2.2%

Memory: ✅ 44.021MB (SLO: <46.000MB -4.3%) vs baseline: +5.5%

✅ ljust_noaspect

Time: ✅ 276.063µs (SLO: <300.000µs -8.0%) vs baseline: +3.2%

Memory: ✅ 43.874MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%

✅ lower_aspect

Time: ✅ 297.216µs (SLO: <500.000µs 📉 -40.6%) vs baseline: -4.7%

Memory: ✅ 43.862MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%

✅ lower_noaspect

Time: ✅ 233.124µs (SLO: <300.000µs 📉 -22.3%) vs baseline: -3.0%

Memory: ✅ 43.874MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ lstrip_aspect

Time: ✅ 0.272ms (SLO: <3.000ms 📉 -90.9%) vs baseline: -1.3%

Memory: ✅ 43.810MB (SLO: <46.000MB -4.8%) vs baseline: +5.3%

✅ lstrip_noaspect

Time: ✅ 0.176ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -1.5%

Memory: ✅ 43.893MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ modulo_aspect

Time: ✅ 14.214ms (SLO: <18.750ms 📉 -24.2%) vs baseline: -0.4%

Memory: ✅ 43.981MB (SLO: <46.000MB -4.4%) vs baseline: +5.3%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.743ms (SLO: <19.350ms 📉 -23.8%) vs baseline: -0.1%

Memory: ✅ 43.983MB (SLO: <46.000MB -4.4%) vs baseline: +5.3%

✅ modulo_aspect_for_bytes

Time: ✅ 14.320ms (SLO: <18.900ms 📉 -24.2%) vs baseline: -0.4%

Memory: ✅ 43.984MB (SLO: <46.000MB -4.4%) vs baseline: +5.2%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.545ms (SLO: <19.150ms 📉 -24.0%) vs baseline: ~same

Memory: ✅ 43.934MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%

✅ modulo_noaspect

Time: ✅ 0.366ms (SLO: <3.000ms 📉 -87.8%) vs baseline: -1.7%

Memory: ✅ 43.795MB (SLO: <46.000MB -4.8%) vs baseline: +5.1%

✅ replace_aspect

Time: ✅ 18.336ms (SLO: <24.000ms 📉 -23.6%) vs baseline: -0.2%

Memory: ✅ 43.909MB (SLO: <46.000MB -4.5%) vs baseline: +5.3%

✅ replace_noaspect

Time: ✅ 291.225µs (SLO: <400.000µs 📉 -27.2%) vs baseline: +1.4%

Memory: ✅ 43.936MB (SLO: <46.000MB -4.5%) vs baseline: +5.6%

✅ repr_aspect

Time: ✅ 328.800µs (SLO: <420.000µs 📉 -21.7%) vs baseline: -3.5%

Memory: ✅ 43.889MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%

✅ repr_noaspect

Time: ✅ 47.196µs (SLO: <90.000µs 📉 -47.6%) vs baseline: +0.8%

Memory: ✅ 43.902MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ rstrip_aspect

Time: ✅ 378.601µs (SLO: <500.000µs 📉 -24.3%) vs baseline: -3.9%

Memory: ✅ 43.905MB (SLO: <46.000MB -4.6%) vs baseline: +5.4%

✅ rstrip_noaspect

Time: ✅ 182.788µs (SLO: <300.000µs 📉 -39.1%) vs baseline: -0.3%

Memory: ✅ 43.979MB (SLO: <46.000MB -4.4%) vs baseline: +5.4%

✅ slice_aspect

Time: ✅ 184.620µs (SLO: <300.000µs 📉 -38.5%) vs baseline: ~same

Memory: ✅ 43.764MB (SLO: <46.000MB -4.9%) vs baseline: +5.2%

✅ slice_noaspect

Time: ✅ 54.066µs (SLO: <90.000µs 📉 -39.9%) vs baseline: +0.3%

Memory: ✅ 43.869MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%

✅ stringio_aspect

Time: ✅ 4.470ms (SLO: <5.000ms 📉 -10.6%) vs baseline: 📈 +13.8%

Memory: ✅ 43.852MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%

✅ stringio_noaspect

Time: ✅ 347.888µs (SLO: <500.000µs 📉 -30.4%) vs baseline: -1.6%

Memory: ✅ 43.916MB (SLO: <46.000MB -4.5%) vs baseline: +5.5%

✅ strip_aspect

Time: ✅ 271.404µs (SLO: <350.000µs 📉 -22.5%) vs baseline: -0.8%

Memory: ✅ 44.021MB (SLO: <46.000MB -4.3%) vs baseline: +5.8%

✅ strip_noaspect

Time: ✅ 176.618µs (SLO: <240.000µs 📉 -26.4%) vs baseline: -1.2%

Memory: ✅ 43.849MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%

✅ swapcase_aspect

Time: ✅ 331.593µs (SLO: <500.000µs 📉 -33.7%) vs baseline: -5.0%

Memory: ✅ 43.857MB (SLO: <46.000MB -4.7%) vs baseline: +5.5%

✅ swapcase_noaspect

Time: ✅ 270.964µs (SLO: <400.000µs 📉 -32.3%) vs baseline: -1.7%

Memory: ✅ 43.849MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%

✅ title_aspect

Time: ✅ 325.421µs (SLO: <500.000µs 📉 -34.9%) vs baseline: -2.4%

Memory: ✅ 44.023MB (SLO: <46.000MB -4.3%) vs baseline: +5.7%

✅ title_noaspect

Time: ✅ 259.598µs (SLO: <400.000µs 📉 -35.1%) vs baseline: -2.1%

Memory: ✅ 43.908MB (SLO: <46.000MB -4.5%) vs baseline: +4.9%

✅ translate_aspect

Time: ✅ 496.314µs (SLO: <700.000µs 📉 -29.1%) vs baseline: -3.2%

Memory: ✅ 43.872MB (SLO: <46.000MB -4.6%) vs baseline: +5.2%

✅ translate_noaspect

Time: ✅ 429.633µs (SLO: <500.000µs 📉 -14.1%) vs baseline: -2.5%

Memory: ✅ 43.922MB (SLO: <46.000MB -4.5%) vs baseline: +5.4%

✅ upper_aspect

Time: ✅ 301.145µs (SLO: <500.000µs 📉 -39.8%) vs baseline: -5.8%

Memory: ✅ 43.881MB (SLO: <46.000MB -4.6%) vs baseline: +5.1%

✅ upper_noaspect

Time: ✅ 237.027µs (SLO: <400.000µs 📉 -40.7%) vs baseline: -2.1%

Memory: ✅ 43.832MB (SLO: <46.000MB -4.7%) vs baseline: +5.4%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 534.201µs (SLO: <700.000µs 📉 -23.7%) vs baseline: 📈 +23.8%

Memory: ✅ 43.817MB (SLO: <46.000MB -4.7%) vs baseline: +5.4%

✅ ospathbasename_noaspect

Time: ✅ 441.348µs (SLO: <700.000µs 📉 -37.0%) vs baseline: +0.4%

Memory: ✅ 43.770MB (SLO: <46.000MB -4.8%) vs baseline: +5.5%

✅ ospathjoin_aspect

Time: ✅ 630.252µs (SLO: <700.000µs -10.0%) vs baseline: -1.8%

Memory: ✅ 43.837MB (SLO: <46.000MB -4.7%) vs baseline: +5.6%

✅ ospathjoin_noaspect

Time: ✅ 644.682µs (SLO: <700.000µs -7.9%) vs baseline: -2.0%

Memory: ✅ 43.819MB (SLO: <46.000MB -4.7%) vs baseline: +5.7%

✅ ospathnormcase_aspect

Time: ✅ 352.696µs (SLO: <700.000µs 📉 -49.6%) vs baseline: -2.1%

Memory: ✅ 43.848MB (SLO: <46.000MB -4.7%) vs baseline: +5.8%

✅ ospathnormcase_noaspect

Time: ✅ 363.830µs (SLO: <700.000µs 📉 -48.0%) vs baseline: -1.5%

Memory: ✅ 43.840MB (SLO: <46.000MB -4.7%) vs baseline: +5.2%

✅ ospathsplit_aspect

Time: ✅ 493.273µs (SLO: <700.000µs 📉 -29.5%) vs baseline: -2.8%

Memory: ✅ 43.961MB (SLO: <46.000MB -4.4%) vs baseline: +6.5%

✅ ospathsplit_noaspect

Time: ✅ 512.640µs (SLO: <700.000µs 📉 -26.8%) vs baseline: -1.0%

Memory: ✅ 43.811MB (SLO: <46.000MB -4.8%) vs baseline: +5.4%

✅ ospathsplitdrive_aspect

Time: ✅ 376.324µs (SLO: <700.000µs 📉 -46.2%) vs baseline: -2.3%

Memory: ✅ 43.918MB (SLO: <46.000MB -4.5%) vs baseline: +5.8%

✅ ospathsplitdrive_noaspect

Time: ✅ 73.327µs (SLO: <700.000µs 📉 -89.5%) vs baseline: +0.4%

Memory: ✅ 43.862MB (SLO: <46.000MB -4.6%) vs baseline: +5.9%

✅ ospathsplitext_aspect

Time: ✅ 470.082µs (SLO: <700.000µs 📉 -32.8%) vs baseline: +0.5%

Memory: ✅ 43.727MB (SLO: <46.000MB -4.9%) vs baseline: +5.3%

✅ ospathsplitext_noaspect

Time: ✅ 472.822µs (SLO: <700.000µs 📉 -32.5%) vs baseline: -0.3%

Memory: ✅ 43.859MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.360µs (SLO: <20.000µs 📉 -88.2%) vs baseline: 📈 +10.7%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ 1-count-metrics-100-times

Time: ✅ 156.700µs (SLO: <220.000µs 📉 -28.8%) vs baseline: +1.6%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.1%

✅ 1-distribution-metric-1-times

Time: ✅ 2.446µs (SLO: <20.000µs 📉 -87.8%) vs baseline: -2.6%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.6%

✅ 1-distribution-metrics-100-times

Time: ✅ 165.890µs (SLO: <230.000µs 📉 -27.9%) vs baseline: -1.2%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.2%

✅ 1-gauge-metric-1-times

Time: ✅ 1.970µs (SLO: <20.000µs 📉 -90.2%) vs baseline: -1.8%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%

✅ 1-gauge-metrics-100-times

Time: ✅ 138.256µs (SLO: <150.000µs -7.8%) vs baseline: -0.6%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.6%

✅ 1-rate-metric-1-times

Time: ✅ 2.301µs (SLO: <20.000µs 📉 -88.5%) vs baseline: +1.6%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%

✅ 1-rate-metrics-100-times

Time: ✅ 171.001µs (SLO: <250.000µs 📉 -31.6%) vs baseline: +0.8%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.8%

✅ 100-count-metrics-100-times

Time: ✅ 15.572ms (SLO: <22.000ms 📉 -29.2%) vs baseline: -0.3%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.5%

✅ 100-distribution-metrics-100-times

Time: ✅ 1.755ms (SLO: <2.550ms 📉 -31.2%) vs baseline: -1.7%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.2%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.445ms (SLO: <1.550ms -6.8%) vs baseline: +0.6%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.0%

✅ 100-rate-metrics-100-times

Time: ✅ 1.770ms (SLO: <2.550ms 📉 -30.6%) vs baseline: +2.4%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.4%

✅ flush-1-metric

Time: ✅ 3.633µs (SLO: <20.000µs 📉 -81.8%) vs baseline: +2.9%

Memory: ✅ 36.569MB (SLO: <38.000MB -3.8%) vs baseline: +6.1%

✅ flush-100-metrics

Time: ✅ 174.681µs (SLO: <250.000µs 📉 -30.1%) vs baseline: -0.6%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +6.6%

✅ flush-1000-metrics

Time: ✅ 2.196ms (SLO: <2.500ms 📉 -12.2%) vs baseline: -0.6%

Memory: ✅ 37.002MB (SLO: <38.750MB -4.5%) vs baseline: +5.2%

🟡 Near SLO Breach (5 suites)
🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 21.003ms (SLO: <22.300ms -5.8%) vs baseline: -0.2%

Memory: ✅ 71.372MB (SLO: <73.500MB -2.9%) vs baseline: +5.1%

✅ exception-replay-enabled

Time: ✅ 1.372ms (SLO: <1.450ms -5.4%) vs baseline: ~same

Memory: ✅ 69.663MB (SLO: <71.500MB -2.6%) vs baseline: +5.4%

✅ iast

Time: ✅ 21.023ms (SLO: <22.250ms -5.5%) vs baseline: -0.1%

Memory: ✅ 71.376MB (SLO: <75.000MB -4.8%) vs baseline: +5.4%

✅ profiler

Time: ✅ 15.260ms (SLO: <16.550ms -7.8%) vs baseline: +0.5%

Memory: ✅ 60.153MB (SLO: <61.000MB 🟡 -1.4%) vs baseline: +5.7%

✅ resource-renaming

Time: ✅ 20.826ms (SLO: <21.750ms -4.2%) vs baseline: +0.7%

Memory: ✅ 71.296MB (SLO: <73.500MB -3.0%) vs baseline: +5.1%

✅ span-code-origin

Time: ✅ 20.700ms (SLO: <28.200ms 📉 -26.6%) vs baseline: +1.1%

Memory: ✅ 71.446MB (SLO: <75.000MB -4.7%) vs baseline: +5.3%

✅ tracer

Time: ✅ 21.034ms (SLO: <21.750ms -3.3%) vs baseline: +0.2%

Memory: ✅ 71.351MB (SLO: <75.000MB -4.9%) vs baseline: +5.1%

✅ tracer-and-profiler

Time: ✅ 21.041ms (SLO: <23.500ms 📉 -10.5%) vs baseline: +0.1%

Memory: ✅ 73.260MB (SLO: <75.000MB -2.3%) vs baseline: +5.1%

✅ tracer-dont-create-db-spans

Time: ✅ 21.056ms (SLO: <21.500ms -2.1%) vs baseline: -0.6%

Memory: ✅ 71.315MB (SLO: <75.000MB -4.9%) vs baseline: +5.2%

✅ tracer-minimal

Time: ✅ 18.020ms (SLO: <18.500ms -2.6%) vs baseline: +0.9%

Memory: ✅ 71.407MB (SLO: <75.000MB -4.8%) vs baseline: +5.2%

✅ tracer-native

Time: ✅ 20.903ms (SLO: <21.750ms -3.9%) vs baseline: -0.4%

Memory: ✅ 71.359MB (SLO: <72.500MB 🟡 -1.6%) vs baseline: +5.2%

✅ tracer-no-caches

Time: ✅ 18.895ms (SLO: <19.650ms -3.8%) vs baseline: +0.3%

Memory: ✅ 71.277MB (SLO: <75.000MB -5.0%) vs baseline: +5.1%

✅ tracer-no-databases

Time: ✅ 20.609ms (SLO: <21.100ms -2.3%) vs baseline: ~same

Memory: ✅ 71.272MB (SLO: <75.000MB -5.0%) vs baseline: +5.1%

✅ tracer-no-middleware

Time: ✅ 20.683ms (SLO: <21.500ms -3.8%) vs baseline: -0.3%

Memory: ✅ 71.311MB (SLO: <75.000MB -4.9%) vs baseline: +5.2%

✅ tracer-no-templates

Time: ✅ 21.020ms (SLO: <22.000ms -4.5%) vs baseline: +1.4%

Memory: ✅ 71.276MB (SLO: <73.500MB -3.0%) vs baseline: +5.2%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.841ms (SLO: <47.150ms 📉 -13.4%) vs baseline: -0.7%

Memory: ✅ 41.239MB (SLO: <47.000MB 📉 -12.3%) vs baseline: +5.4%

✅ add-metrics

Time: ✅ 236.798ms (SLO: <344.800ms 📉 -31.3%) vs baseline: -0.1%

Memory: ✅ 45.678MB (SLO: <47.500MB -3.8%) vs baseline: +5.5%

✅ add-tags

Time: ✅ 278.282ms (SLO: <330.000ms 📉 -15.7%) vs baseline: +2.2%

Memory: ✅ 45.750MB (SLO: <47.500MB -3.7%) vs baseline: +5.3%

✅ get-context

Time: ✅ 83.728ms (SLO: <92.350ms -9.3%) vs baseline: ~same

Memory: ✅ 41.484MB (SLO: <46.500MB 📉 -10.8%) vs baseline: +5.1%

✅ is-recording

Time: ✅ 39.244ms (SLO: <44.500ms 📉 -11.8%) vs baseline: ~same

Memory: ✅ 41.007MB (SLO: <47.500MB 📉 -13.7%) vs baseline: +5.1%

✅ record-exception

Time: ✅ 61.233ms (SLO: <67.650ms -9.5%) vs baseline: -0.3%

Memory: ✅ 41.797MB (SLO: <47.000MB 📉 -11.1%) vs baseline: +5.7%

✅ set-status

Time: ✅ 45.319ms (SLO: <50.400ms 📉 -10.1%) vs baseline: ~same

Memory: ✅ 41.177MB (SLO: <47.000MB 📉 -12.4%) vs baseline: +5.6%

✅ start

Time: ✅ 40.471ms (SLO: <44.500ms -9.1%) vs baseline: +4.2%

Memory: ✅ 41.042MB (SLO: <47.000MB 📉 -12.7%) vs baseline: +5.0%

✅ start-finish

Time: ✅ 90.070ms (SLO: <92.000ms -2.1%) vs baseline: +0.1%

Memory: ✅ 38.633MB (SLO: <46.500MB 📉 -16.9%) vs baseline: +5.2%

✅ start-finish-telemetry

Time: ✅ 91.733ms (SLO: <93.000ms 🟡 -1.4%) vs baseline: ~same

Memory: ✅ 38.732MB (SLO: <46.500MB 📉 -16.7%) vs baseline: +5.3%

✅ update-name

Time: ✅ 40.343ms (SLO: <45.150ms 📉 -10.6%) vs baseline: ~same

Memory: ✅ 41.147MB (SLO: <47.000MB 📉 -12.5%) vs baseline: +5.0%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 312.457ms (SLO: <320.950ms -2.6%) vs baseline: ~same

Memory: ✅ 37.434MB (SLO: <38.750MB -3.4%) vs baseline: +5.3%

✅ deep-profiled

Time: ✅ 328.019ms (SLO: <359.150ms -8.7%) vs baseline: -0.6%

Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +5.3%

✅ medium

Time: ✅ 7.381ms (SLO: <7.450ms 🟡 -0.9%) vs baseline: -0.4%

Memory: ✅ 36.156MB (SLO: <38.000MB -4.9%) vs baseline: +5.1%

✅ shallow

Time: ✅ 1.048ms (SLO: <1.050ms 🟡 -0.2%) vs baseline: +1.8%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +5.4%

🟡 span - 26/26

✅ add-event

Time: ✅ 19.573ms (SLO: <22.500ms 📉 -13.0%) vs baseline: -1.2%

Memory: ✅ 38.492MB (SLO: <53.000MB 📉 -27.4%) vs baseline: +5.8%

✅ add-metrics

Time: ✅ 89.480ms (SLO: <93.500ms -4.3%) vs baseline: +0.6%

Memory: ✅ 42.939MB (SLO: <53.000MB 📉 -19.0%) vs baseline: +5.4%

✅ add-tags

Time: ✅ 147.534ms (SLO: <155.000ms -4.8%) vs baseline: -0.2%

Memory: ✅ 42.922MB (SLO: <53.000MB 📉 -19.0%) vs baseline: +5.4%

✅ get-context

Time: ✅ 18.805ms (SLO: <20.500ms -8.3%) vs baseline: -1.8%

Memory: ✅ 38.287MB (SLO: <53.000MB 📉 -27.8%) vs baseline: +5.2%

✅ is-recording

Time: ✅ 18.843ms (SLO: <20.500ms -8.1%) vs baseline: -1.9%

Memory: ✅ 38.326MB (SLO: <53.000MB 📉 -27.7%) vs baseline: +5.4%

✅ record-exception

Time: ✅ 38.467ms (SLO: <41.000ms -6.2%) vs baseline: -1.2%

Memory: ✅ 38.812MB (SLO: <53.000MB 📉 -26.8%) vs baseline: +5.3%

✅ set-status

Time: ✅ 20.714ms (SLO: <22.000ms -5.8%) vs baseline: -0.9%

Memory: ✅ 38.412MB (SLO: <53.000MB 📉 -27.5%) vs baseline: +5.8%

✅ start

Time: ✅ 19.668ms (SLO: <20.500ms -4.1%) vs baseline: +4.4%

Memory: ✅ 38.345MB (SLO: <53.000MB 📉 -27.7%) vs baseline: +5.8%

✅ start-finish

Time: ✅ 58.080ms (SLO: <58.500ms 🟡 -0.7%) vs baseline: -0.4%

Memory: ✅ 36.156MB (SLO: <38.000MB -4.9%) vs baseline: +5.0%

✅ start-finish-telemetry

Time: ✅ 59.248ms (SLO: <60.000ms 🟡 -1.3%) vs baseline: -1.3%

Memory: ✅ 36.156MB (SLO: <38.000MB -4.9%) vs baseline: +5.2%

✅ start-finish-traceid128

Time: ✅ 60.360ms (SLO: <62.000ms -2.6%) vs baseline: -1.2%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.5%

✅ start-traceid128

Time: ✅ 18.798ms (SLO: <22.500ms 📉 -16.5%) vs baseline: -1.1%

Memory: ✅ 38.317MB (SLO: <53.000MB 📉 -27.7%) vs baseline: +5.2%

✅ update-name

Time: ✅ 19.238ms (SLO: <22.000ms 📉 -12.6%) vs baseline: -1.4%

Memory: ✅ 38.435MB (SLO: <53.000MB 📉 -27.5%) vs baseline: +5.4%

🟡 tracer - 6/6

✅ large

Time: ✅ 33.094ms (SLO: <33.950ms -2.5%) vs baseline: -0.6%

Memory: ✅ 37.847MB (SLO: <39.250MB -3.6%) vs baseline: +6.1%

✅ medium

Time: ✅ 3.346ms (SLO: <3.500ms -4.4%) vs baseline: +0.2%

Memory: ✅ 36.215MB (SLO: <38.750MB -6.5%) vs baseline: +5.5%

✅ small

Time: ✅ 386.288µs (SLO: <390.000µs 🟡 -1.0%) vs baseline: +3.5%

Memory: ✅ 36.274MB (SLO: <38.750MB -6.4%) vs baseline: +5.3%

⚠️ Unstable Tests (2 suites)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.602µs (SLO: <20.000µs 📉 -32.0%) vs baseline: +0.1%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%

✅ context_with_data_no_listeners

Time: ✅ 3.573µs (SLO: <10.000µs 📉 -64.3%) vs baseline: -1.3%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%

✅ get_item_exists

Time: ✅ 0.584µs (SLO: <10.000µs 📉 -94.2%) vs baseline: ~same

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.5%

✅ get_item_missing

Time: ✅ 0.639µs (SLO: <10.000µs 📉 -93.6%) vs baseline: +0.5%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.2%

✅ set_item

Time: ✅ 24.512µs (SLO: <30.000µs 📉 -18.3%) vs baseline: -0.8%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 154.800µs (SLO: <170.000µs -8.9%) vs baseline: -0.6%

Memory: ✅ 41.115MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +4.4%

✅ import_many_cached

Time: ✅ 121.581µs (SLO: <130.000µs -6.5%) vs baseline: +0.5%

Memory: ✅ 41.558MB (SLO: <46.000MB -9.7%) vs baseline: +6.2%

✅ import_many_stdlib

Time: ✅ 0.801ms (SLO: <1.750ms 📉 -54.2%) vs baseline: +0.2%

Memory: ✅ 41.132MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +5.2%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.186ms (SLO: <1.100ms 📉 -83.1%) vs baseline: +0.2%

Memory: ✅ 41.177MB (SLO: <46.000MB 📉 -10.5%) vs baseline: +4.4%

✅ import_many_unknown

Time: ✅ 834.881µs (SLO: <890.000µs -6.2%) vs baseline: +0.8%

Memory: ✅ 41.586MB (SLO: <46.000MB -9.6%) vs baseline: +6.1%

✅ import_many_unknown_cached

Time: ✅ 795.167µs (SLO: <870.000µs -8.6%) vs baseline: +0.3%

Memory: ✅ 41.353MB (SLO: <46.000MB 📉 -10.1%) vs baseline: +4.4%

✅ import_one

Time: ✅ 19.854µs (SLO: <30.000µs 📉 -33.8%) vs baseline: +0.8%

Memory: ✅ 41.450MB (SLO: <46.000MB -9.9%) vs baseline: +4.8%

✅ import_one_cache

Time: ✅ 6.346µs (SLO: <10.000µs 📉 -36.5%) vs baseline: +0.8%

Memory: ✅ 41.120MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +5.2%

✅ import_one_stdlib

Time: ✅ 18.733µs (SLO: <20.000µs -6.3%) vs baseline: ~same

Memory: ✅ 41.131MB (SLO: <46.000MB 📉 -10.6%) vs baseline: +5.4%

✅ import_one_stdlib_cache

Time: ✅ 6.280µs (SLO: <10.000µs 📉 -37.2%) vs baseline: +0.3%

Memory: ✅ 41.075MB (SLO: <46.000MB 📉 -10.7%) vs baseline: +4.8%

✅ import_one_unknown

Time: ✅ 45.376µs (SLO: <50.000µs -9.2%) vs baseline: -0.1%

Memory: ✅ 41.182MB (SLO: <46.000MB 📉 -10.5%) vs baseline: +5.3%

✅ import_one_unknown_cache

Time: ✅ 6.299µs (SLO: <10.000µs 📉 -37.0%) vs baseline: +0.3%

Memory: ✅ 41.087MB (SLO: <43.000MB -4.4%) vs baseline: +4.9%

✅ All Tests Passing (15 suites)
✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 17.525ms (SLO: <19.850ms 📉 -11.7%) vs baseline: +0.1%

Memory: ✅ 70.780MB (SLO: <75.000MB -5.6%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 17.514ms (SLO: <19.400ms -9.7%) vs baseline: ~same

Memory: ✅ 70.820MB (SLO: <75.000MB -5.6%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 17.592ms (SLO: <19.450ms -9.6%) vs baseline: +1.2%

Memory: ✅ 70.676MB (SLO: <75.000MB -5.8%) vs baseline: +4.7%

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.123ms (SLO: <2.300ms -7.7%) vs baseline: +0.1%

Memory: ✅ 58.211MB (SLO: <60.000MB -3.0%) vs baseline: +4.8%

✅ errortracking-enabled-user

Time: ✅ 2.130ms (SLO: <2.250ms -5.3%) vs baseline: +0.3%

Memory: ✅ 58.169MB (SLO: <60.000MB -3.1%)

✅ tracer-enabled

Time: ✅ 2.125ms (SLO: <2.300ms -7.6%) vs baseline: +0.4%

Memory: ✅ 58.073MB (SLO: <60.000MB -3.2%) vs baseline: +4.6%

✅ flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.397ms (SLO: <4.750ms 📉 -28.5%) vs baseline: -0.6%

Memory: ✅ 58.589MB (SLO: <66.500MB 📉 -11.9%) vs baseline: +5.4%

✅ appsec-post

Time: ✅ 2.917ms (SLO: <6.750ms 📉 -56.8%) vs baseline: +0.4%

Memory: ✅ 58.550MB (SLO: <66.500MB 📉 -12.0%) vs baseline: +5.5%

✅ appsec-telemetry

Time: ✅ 3.433ms (SLO: <4.750ms 📉 -27.7%) vs baseline: +0.9%

Memory: ✅ 58.543MB (SLO: <66.500MB 📉 -12.0%) vs baseline: +5.5%

✅ debugger

Time: ✅ 1.883ms (SLO: <2.000ms -5.8%) vs baseline: ~same

Memory: ✅ 49.371MB (SLO: <51.500MB -4.1%) vs baseline: +5.7%

✅ iast-get

Time: ✅ 1.875ms (SLO: <2.000ms -6.2%) vs baseline: ~same

Memory: ✅ 46.108MB (SLO: <49.000MB -5.9%) vs baseline: +5.8%

✅ profiler

Time: ✅ 1.914ms (SLO: <2.100ms -8.9%) vs baseline: -0.3%

Memory: ✅ 51.985MB (SLO: <53.500MB -2.8%) vs baseline: +5.4%

✅ resource-renaming

Time: ✅ 3.385ms (SLO: <3.650ms -7.3%) vs baseline: -0.4%

Memory: ✅ 58.529MB (SLO: <60.000MB -2.5%) vs baseline: +5.5%

✅ tracer

Time: ✅ 3.425ms (SLO: <3.650ms -6.2%) vs baseline: +0.8%

Memory: ✅ 58.574MB (SLO: <60.000MB -2.4%) vs baseline: +5.4%

✅ tracer-native

Time: ✅ 3.405ms (SLO: <3.650ms -6.7%) vs baseline: +0.3%

Memory: ✅ 58.491MB (SLO: <60.000MB -2.5%) vs baseline: +5.3%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.121ms (SLO: <4.200ms 📉 -49.5%) vs baseline: ~same

Memory: ✅ 58.328MB (SLO: <66.000MB 📉 -11.6%) vs baseline: +5.1%

✅ iast-enabled

Time: ✅ 2.128ms (SLO: <2.800ms 📉 -24.0%) vs baseline: +0.3%

Memory: ✅ 58.255MB (SLO: <62.500MB -6.8%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.116ms (SLO: <2.250ms -6.0%) vs baseline: +0.2%

Memory: ✅ 58.336MB (SLO: <60.000MB -2.8%) vs baseline: +5.0%

✅ forktime - 4/4

✅ baseline

Time: ✅ 1.930ms (SLO: <3.000ms 📉 -35.7%) vs baseline: +5.0%

Memory: ✅ 29.236MB (SLO: <33.000MB 📉 -11.4%) vs baseline: +5.1%

✅ configured

Time: ✅ 9.324ms (SLO: <13.000ms 📉 -28.3%) vs baseline: +0.1%

Memory: ✅ 58.450MB (SLO: <60.000MB -2.6%) vs baseline: +5.3%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 81.732µs (SLO: <100.000µs 📉 -18.3%) vs baseline: +4.8%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.0%

✅ b3_headers

Time: ✅ 12.958µs (SLO: <20.000µs 📉 -35.2%) vs baseline: +1.1%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.0%

✅ b3_single_headers

Time: ✅ 11.982µs (SLO: <20.000µs 📉 -40.1%) vs baseline: +0.4%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.7%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 60.975µs (SLO: <80.000µs 📉 -23.8%) vs baseline: +0.1%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 64.326µs (SLO: <80.000µs 📉 -19.6%) vs baseline: +0.4%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%

✅ empty_headers

Time: ✅ 1.292µs (SLO: <10.000µs 📉 -87.1%) vs baseline: -0.2%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ full_t_id_datadog_headers

Time: ✅ 21.747µs (SLO: <30.000µs 📉 -27.5%) vs baseline: +0.2%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.7%

✅ invalid_priority_header

Time: ✅ 5.942µs (SLO: <10.000µs 📉 -40.6%) vs baseline: +0.2%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ invalid_span_id_header

Time: ✅ 5.940µs (SLO: <10.000µs 📉 -40.6%) vs baseline: +0.2%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%

✅ invalid_tags_header

Time: ✅ 5.904µs (SLO: <10.000µs 📉 -41.0%) vs baseline: -0.3%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.6%

✅ invalid_trace_id_header

Time: ✅ 5.953µs (SLO: <10.000µs 📉 -40.5%) vs baseline: -0.4%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%

✅ large_header_no_matches

Time: ✅ 27.359µs (SLO: <30.000µs -8.8%) vs baseline: +0.2%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.3%

✅ large_valid_headers_all

Time: ✅ 28.297µs (SLO: <40.000µs 📉 -29.3%) vs baseline: +0.6%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.2%

✅ medium_header_no_matches

Time: ✅ 9.229µs (SLO: <20.000µs 📉 -53.9%) vs baseline: -0.6%

Memory: ✅ 36.412MB (SLO: <38.000MB -4.2%) vs baseline: +5.7%

✅ medium_valid_headers_all

Time: ✅ 10.707µs (SLO: <20.000µs 📉 -46.5%) vs baseline: -0.3%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%

✅ none_propagation_style

Time: ✅ 1.388µs (SLO: <10.000µs 📉 -86.1%) vs baseline: ~same

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%

✅ tracecontext_headers

Time: ✅ 33.051µs (SLO: <40.000µs 📉 -17.4%) vs baseline: +0.6%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.3%

✅ valid_headers_all

Time: ✅ 5.968µs (SLO: <10.000µs 📉 -40.3%) vs baseline: +0.7%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ valid_headers_basic

Time: ✅ 5.505µs (SLO: <10.000µs 📉 -45.0%) vs baseline: +0.1%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%

✅ wsgi_empty_headers

Time: ✅ 1.300µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.2%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.3%

✅ wsgi_invalid_priority_header

Time: ✅ 6.014µs (SLO: <10.000µs 📉 -39.9%) vs baseline: +0.4%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.1%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.304µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.5%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.5%

✅ wsgi_invalid_tags_header

Time: ✅ 6.010µs (SLO: <10.000µs 📉 -39.9%) vs baseline: ~same

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.5%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.017µs (SLO: <10.000µs 📉 -39.8%) vs baseline: -0.2%

Memory: ✅ 36.392MB (SLO: <38.000MB -4.2%) vs baseline: +5.3%

✅ wsgi_large_header_no_matches

Time: ✅ 28.663µs (SLO: <40.000µs 📉 -28.3%) vs baseline: -0.7%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ wsgi_large_valid_headers_all

Time: ✅ 30.006µs (SLO: <40.000µs 📉 -25.0%) vs baseline: +0.3%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ wsgi_medium_header_no_matches

Time: ✅ 9.519µs (SLO: <20.000µs 📉 -52.4%) vs baseline: +0.3%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.072µs (SLO: <20.000µs 📉 -44.6%) vs baseline: +0.6%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +4.8%

✅ wsgi_valid_headers_all

Time: ✅ 6.008µs (SLO: <10.000µs 📉 -39.9%) vs baseline: ~same

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ wsgi_valid_headers_basic

Time: ✅ 5.559µs (SLO: <10.000µs 📉 -44.4%) vs baseline: +0.3%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.2%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 20.902µs (SLO: <30.000µs 📉 -30.3%) vs baseline: +3.9%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.0%

✅ with_all

Time: ✅ 26.978µs (SLO: <40.000µs 📉 -32.6%) vs baseline: -0.4%

Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%

✅ with_dd_origin

Time: ✅ 23.828µs (SLO: <30.000µs 📉 -20.6%) vs baseline: -0.1%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%

✅ with_priority_and_origin

Time: ✅ 23.378µs (SLO: <40.000µs 📉 -41.6%) vs baseline: +0.1%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.6%

✅ with_sampling_priority

Time: ✅ 19.993µs (SLO: <30.000µs 📉 -33.4%) vs baseline: -0.4%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ with_tags

Time: ✅ 25.072µs (SLO: <40.000µs 📉 -37.3%) vs baseline: -0.2%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.1%

✅ with_tags_invalid

Time: ✅ 26.686µs (SLO: <40.000µs 📉 -33.3%) vs baseline: +0.8%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +4.7%

✅ with_tags_max_size

Time: ✅ 25.647µs (SLO: <40.000µs 📉 -35.9%) vs baseline: +0.5%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +4.9%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 165.911µs (SLO: <250.000µs 📉 -33.6%) vs baseline: +6.6%

Memory: ✅ 43.892MB (SLO: <46.000MB -4.6%) vs baseline: +5.3%

✅ rsplit_noaspect

Time: ✅ 165.017µs (SLO: <250.000µs 📉 -34.0%) vs baseline: +2.2%

Memory: ✅ 43.951MB (SLO: <46.000MB -4.5%) vs baseline: +5.8%

✅ split_aspect

Time: ✅ 157.620µs (SLO: <250.000µs 📉 -37.0%) vs baseline: +2.8%

Memory: ✅ 43.835MB (SLO: <46.000MB -4.7%) vs baseline: +5.4%

✅ split_noaspect

Time: ✅ 159.098µs (SLO: <250.000µs 📉 -36.4%) vs baseline: +0.5%

Memory: ✅ 43.867MB (SLO: <46.000MB -4.6%) vs baseline: +5.5%

✅ splitlines_aspect

Time: ✅ 152.305µs (SLO: <250.000µs 📉 -39.1%) vs baseline: +1.7%

Memory: ✅ 43.809MB (SLO: <46.000MB -4.8%) vs baseline: +4.9%

✅ splitlines_noaspect

Time: ✅ 156.726µs (SLO: <250.000µs 📉 -37.3%) vs baseline: -1.6%

Memory: ✅ 43.902MB (SLO: <46.000MB -4.6%) vs baseline: +5.6%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 49.172µs (SLO: <60.000µs 📉 -18.0%) vs baseline: ~same

Memory: ✅ 40.010MB (SLO: <42.000MB -4.7%) vs baseline: +5.1%

✅ propagation_enabled

Time: ✅ 137.205µs (SLO: <190.000µs 📉 -27.8%) vs baseline: +0.4%

Memory: ✅ 39.970MB (SLO: <42.000MB -4.8%) vs baseline: +5.2%

✅ propagation_enabled_100

Time: ✅ 1.567ms (SLO: <2.300ms 📉 -31.9%) vs baseline: +1.5%

Memory: ✅ 40.029MB (SLO: <42.000MB -4.7%) vs baseline: +5.2%

✅ propagation_enabled_1000

Time: ✅ 28.881ms (SLO: <34.550ms 📉 -16.4%) vs baseline: -1.1%

Memory: ✅ 39.990MB (SLO: <42.000MB -4.8%) vs baseline: +5.0%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.874ms (SLO: <42.000ms -2.7%) vs baseline: +1.4%

Memory: ✅ 39.007MB (SLO: <40.750MB -4.3%) vs baseline: +6.1%

✅ add-link

Time: ✅ 36.567ms (SLO: <38.550ms -5.1%) vs baseline: +0.7%

Memory: ✅ 38.987MB (SLO: <40.750MB -4.3%) vs baseline: +6.1%

✅ add-metrics

Time: ✅ 219.469ms (SLO: <232.000ms -5.4%) vs baseline: +0.7%

Memory: ✅ 39.027MB (SLO: <40.750MB -4.2%) vs baseline: +5.6%

✅ add-tags

Time: ✅ 210.267ms (SLO: <221.600ms -5.1%) vs baseline: -1.0%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.0%

✅ get-context

Time: ✅ 29.554ms (SLO: <31.300ms -5.6%) vs baseline: +1.1%

Memory: ✅ 38.987MB (SLO: <40.750MB -4.3%) vs baseline: +6.0%

✅ is-recording

Time: ✅ 29.507ms (SLO: <31.000ms -4.8%) vs baseline: +0.5%

Memory: ✅ 39.105MB (SLO: <40.750MB -4.0%) vs baseline: +6.3%

✅ record-exception

Time: ✅ 63.424ms (SLO: <65.850ms -3.7%) vs baseline: ~same

Memory: ✅ 39.046MB (SLO: <40.750MB -4.2%) vs baseline: +6.1%

✅ set-status

Time: ✅ 32.032ms (SLO: <34.150ms -6.2%) vs baseline: +0.3%

Memory: ✅ 39.105MB (SLO: <40.750MB -4.0%) vs baseline: +6.2%

✅ start

Time: ✅ 29.511ms (SLO: <30.150ms -2.1%) vs baseline: +1.3%

Memory: ✅ 38.987MB (SLO: <40.750MB -4.3%) vs baseline: +5.7%

✅ start-finish

Time: ✅ 34.233ms (SLO: <35.350ms -3.2%) vs baseline: +0.8%

Memory: ✅ 39.046MB (SLO: <40.750MB -4.2%) vs baseline: +5.8%

✅ start-finish-telemetry

Time: ✅ 34.094ms (SLO: <35.450ms -3.8%) vs baseline: +0.4%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.4%

✅ update-name

Time: ✅ 31.142ms (SLO: <33.400ms -6.8%) vs baseline: -0.5%

Memory: ✅ 39.007MB (SLO: <40.750MB -4.3%) vs baseline: +5.8%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 344.766ms (SLO: <354.300ms -2.7%) vs baseline: +0.3%

Memory: ✅ 42.416MB (SLO: <46.000MB -7.8%) vs baseline: +5.3%

✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.6%

Memory: ✅ 41.012MB (SLO: <46.000MB 📉 -10.8%) vs baseline: +5.5%

✅ rand - 2/2

✅ rand128bits

Time: ✅ 0.181µs (SLO: <21.000µs 📉 -99.1%) vs baseline: -2.7%

✅ rand64bits

Time: ✅ 0.124µs (SLO: <15.000µs 📉 -99.2%) vs baseline: +5.1%

✅ ratelimiter - 11/11

✅ defaults

Time: ✅ 2.355µs (SLO: <10.000µs 📉 -76.5%) vs baseline: +0.6%

Memory: ✅ 36.569MB (SLO: <38.000MB -3.8%) vs baseline: +6.5%

✅ high_rate_limit

Time: ✅ 2.444µs (SLO: <10.000µs 📉 -75.6%) vs baseline: +2.0%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +6.3%

✅ long_window

Time: ✅ 2.349µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.8%

Memory: ✅ 36.549MB (SLO: <38.000MB -3.8%) vs baseline: +6.6%

✅ low_rate_limit

Time: ✅ 2.377µs (SLO: <10.000µs 📉 -76.2%) vs baseline: +0.9%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +6.3%

✅ no_rate_limit

Time: ✅ 0.830µs (SLO: <10.000µs 📉 -91.7%) vs baseline: -0.1%

Memory: ✅ 36.549MB (SLO: <38.000MB -3.8%) vs baseline: +6.1%

✅ short_window

Time: ✅ 2.509µs (SLO: <10.000µs 📉 -74.9%) vs baseline: +0.4%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 169.346µs (SLO: <300.000µs 📉 -43.6%) vs baseline: ~same

Memory: ✅ 36.078MB (SLO: <38.000MB -5.1%) vs baseline: +4.7%

✅ high_match

Time: ✅ 214.842µs (SLO: <480.000µs 📉 -55.2%) vs baseline: -1.5%

Memory: ✅ 36.097MB (SLO: <38.000MB -5.0%) vs baseline: +5.1%

✅ low_match

Time: ✅ 121.981µs (SLO: <130.000µs -6.2%) vs baseline: +2.4%

Memory: ✅ 701.598MB (SLO: <780.000MB 📉 -10.1%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 3.121ms (SLO: <9.000ms 📉 -65.3%) vs baseline: +0.3%

Memory: ✅ 78.704MB (SLO: <85.000MB -7.4%) vs baseline: +4.9%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.542µs (SLO: <20.000µs 📉 -47.3%) vs baseline: -0.8%

Memory: ✅ 37.198MB (SLO: <38.750MB -4.0%) vs baseline: +6.0%

✅ all-enabled

Time: ✅ 39.664µs (SLO: <50.000µs 📉 -20.7%) vs baseline: +1.5%

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.5%

✅ collectipvariant_exists

Time: ✅ 39.870µs (SLO: <50.000µs 📉 -20.3%) vs baseline: +0.2%

Memory: ✅ 37.297MB (SLO: <38.750MB -3.8%) vs baseline: +5.8%

✅ no-collectipvariant

Time: ✅ 39.090µs (SLO: <50.000µs 📉 -21.8%) vs baseline: +0.3%

Memory: ✅ 37.120MB (SLO: <38.750MB -4.2%) vs baseline: +5.4%

✅ no-useragentvariant

Time: ✅ 37.738µs (SLO: <50.000µs 📉 -24.5%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <38.750MB -4.1%) vs baseline: +5.5%

✅ obfuscation-no-query

Time: ✅ 39.527µs (SLO: <50.000µs 📉 -20.9%) vs baseline: +0.3%

Memory: ✅ 37.120MB (SLO: <38.750MB -4.2%) vs baseline: +5.6%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.964µs (SLO: <90.000µs 📉 -15.6%) vs baseline: +0.1%

Memory: ✅ 37.434MB (SLO: <38.750MB -3.4%) vs baseline: +5.2%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.401µs (SLO: <90.000µs 📉 -15.1%) vs baseline: ~same

Memory: ✅ 37.532MB (SLO: <38.750MB -3.1%) vs baseline: +5.4%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.692µs (SLO: <170.000µs -9.0%) vs baseline: ~same

Memory: ✅ 37.532MB (SLO: <38.750MB -3.1%) vs baseline: +5.1%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.604µs (SLO: <160.000µs -7.1%) vs baseline: -0.5%

Memory: ✅ 37.572MB (SLO: <38.750MB -3.0%) vs baseline: +5.5%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.170µs (SLO: <170.000µs -8.7%) vs baseline: ~same

Memory: ✅ 37.356MB (SLO: <38.750MB -3.6%) vs baseline: +5.0%

✅ useragentvariant_exists_1

Time: ✅ 38.581µs (SLO: <50.000µs 📉 -22.8%) vs baseline: +0.2%

Memory: ✅ 37.218MB (SLO: <38.750MB -4.0%) vs baseline: +5.8%

✅ useragentvariant_exists_2

Time: ✅ 39.644µs (SLO: <50.000µs 📉 -20.7%) vs baseline: -0.2%

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.5%

✅ useragentvariant_exists_3

Time: ✅ 39.038µs (SLO: <50.000µs 📉 -21.9%) vs baseline: -0.4%

Memory: ✅ 37.159MB (SLO: <38.750MB -4.1%) vs baseline: +5.5%

✅ useragentvariant_not_exists_1

Time: ✅ 38.587µs (SLO: <50.000µs 📉 -22.8%) vs baseline: -0.5%

Memory: ✅ 37.061MB (SLO: <38.750MB -4.4%) vs baseline: +4.7%

✅ useragentvariant_not_exists_2

Time: ✅ 38.623µs (SLO: <50.000µs 📉 -22.8%) vs baseline: -0.6%

Memory: ✅ 37.336MB (SLO: <38.750MB -3.6%) vs baseline: +6.3%

ℹ️ Scenarios Missing SLO Configuration (46 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • iast_aspects-re_expand_aspect
  • iast_aspects-re_expand_noaspect
  • iast_aspects-re_findall_aspect
  • iast_aspects-re_findall_noaspect
  • iast_aspects-re_finditer_aspect
  • iast_aspects-re_finditer_noaspect
  • iast_aspects-re_fullmatch_aspect
  • iast_aspects-re_fullmatch_noaspect
  • iast_aspects-re_group_aspect
  • iast_aspects-re_group_noaspect
  • iast_aspects-re_groups_aspect
  • iast_aspects-re_groups_noaspect
  • iast_aspects-re_match_aspect
  • iast_aspects-re_match_noaspect
  • iast_aspects-re_search_aspect
  • iast_aspects-re_search_noaspect
  • iast_aspects-re_sub_aspect
  • iast_aspects-re_sub_noaspect
  • iast_aspects-re_subn_aspect
  • iast_aspects-re_subn_noaspect
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Yun-Kim Yun-Kim Awaiting requested review from Yun-Kim Yun-Kim is a code owner automatically assigned from DataDog/python-guild

@emmettbutler emmettbutler Awaiting requested review from emmettbutler emmettbutler is a code owner automatically assigned from DataDog/apm-core-python

At least 1 approving review is required to merge this pull request.

Assignees

@juanjux juanjux

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@juanjux