Skip to content

Activate Java SDK flag eval metrics system tests #6706

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gh-worker-dd-mergequeue-cf854d merged 15 commits into from
Apr 17, 2026
+30 −1
Merged

Activate Java SDK flag eval metrics system tests #6706

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
dca3ff5
feat(java): activate flag eval metrics system tests
typotter Apr 8, 2026
f045950
chore(java): fix manifest key order and long-line formatting
typotter Apr 13, 2026
69609c3
bug(java): annotate 10 failing ffe eval metric tests as bug (FFL-1972)
typotter Apr 13, 2026
018f691
fix(java): remove passing tests from bug list, fix malformed YAML, fo…
typotter Apr 14, 2026
bf6542f
chore: apply yamlfmt formatting to manifest
typotter Apr 14, 2026
287b8e8
bug(java): re-add 11 failing ffe eval metric tests as bug (FFL-1972)
typotter Apr 15, 2026
54d5b60
fix(java): activate 10 FFE eval metrics tests passing in dd-trace-jav…
typotter Apr 15, 2026
4bdd464
test(java): activate eval metrics tests at dd-trace-java@42f154d
typotter Apr 16, 2026
7c98340
test(java): activate eval metrics tests at dd-trace-java@42f154d (v1.…
typotter Apr 16, 2026
3813bd5
ci: retrigger with [java@main] target branch
typotter Apr 16, 2026
9d7aa50
fix(java): mark all 17 FFE eval metrics tests as bug (FFL-1972)
typotter Apr 16, 2026
abfb0ef
ci: retrigger after runner infrastructure failure
typotter Apr 16, 2026
0240b32
ci: retrigger after repeated runner infrastructure failures
typotter Apr 16, 2026
f18d5d0
fix(java): mark eval metrics tests as missing_feature until release
typotter Apr 16, 2026
6121c7b
ci: retrigger after prod vertx4 runner crash
typotter Apr 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 20 additions & 1 deletion manifests/java.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3125,7 +3125,26 @@ manifest:
"*": irrelevant
spring-boot: v1.56.0
tests/ffe/test_exposures.py::Test_FFE_EXP_5_Missing_Targeting_Key: bug (FFL-1729)
tests/ffe/test_flag_eval_metrics.py: missing_feature
tests/ffe/test_flag_eval_metrics.py: missing_feature (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Config_Exists_Flag_Missing::test_ffe_eval_config_exists_flag_missing: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Lowercase_Consistency::test_ffe_lowercase_error_type: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Lowercase_Consistency::test_ffe_lowercase_reason: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Basic::test_ffe_eval_metric_basic: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Count::test_ffe_eval_metric_count: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Different_Flags::test_ffe_eval_metric_different_flags: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Numeric_To_Integer::test_ffe_eval_metric_numeric_to_integer: bug (FFL-1972)
? tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Parse_Error_Invalid_Regex::test_ffe_eval_metric_parse_error_invalid_regex
: bug (FFL-1972)
? tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Parse_Error_Variant_Type_Mismatch::test_ffe_eval_metric_parse_error_variant_type_mismatch
: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Type_Mismatch::test_ffe_eval_metric_type_mismatch: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Nested_Attributes_Ignored::test_ffe_eval_nested_attributes_ignored: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_No_Config_Loaded::test_ffe_eval_no_config_loaded: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Reason_Default::test_ffe_eval_reason_default: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Reason_Disabled::test_ffe_eval_reason_disabled: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Reason_Split::test_ffe_eval_reason_split: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Reason_Targeting::test_ffe_eval_reason_targeting: bug (FFL-1972)
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Targeting_Key_Optional::test_ffe_eval_targeting_key_optional: bug (FFL-1972)
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
tests/integration_frameworks/llm/openai/test_openai_apm.py: v1.61.0
tests/integration_frameworks/llm/openai/test_openai_llmobs.py: v1.61.0
Expand Down
10 changes: 10 additions & 0 deletions utils/build/docker/java/spring-boot/pom.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,6 +60,16 @@
<artifactId>opentelemetry-api</artifactId>
<version>1.41.0</version>
</dependency>
<dependency>
<groupId>io.opentelemetry</groupId>
<artifactId>opentelemetry-sdk-metrics</artifactId>
<version>1.41.0</version>
</dependency>
<dependency>
<groupId>io.opentelemetry</groupId>
<artifactId>opentelemetry-exporter-otlp</artifactId>
<version>1.41.0</version>
</dependency>
<dependency>
<groupId>io.opentracing</groupId>
<artifactId>opentracing-api</artifactId>
Expand Down
Loading