For type: pass-fail
- Apply
{input, output}_validator_flagsfromtestdata.yamlto the respective testcase when validating - Collect testcase verdicts, infer testdata verdicts for each testgroup
- Update UI to report testgroup verdicts
For type: scoring:
- Allow testcase verdicts to have numerical
score - Apply
gradingflags fromtestdata.yamlto respective testcase scores - Apply aggregation rules from
gradingintestdata.yaml - Update UI to report aggregate scores for testgroups
Expectations:
- Read and parse
expectations.yaml - Compare testcase verdicts with expectations
- Compare testgroup verdicts with expectations
List view
0 issues of 1 selected
- Status: Draft (not ready).RagnarGrootKoerkamp/BAPCtoolsnumber 307#307 In RagnarGrootKoerkamp/BAPCtools;