-
Notifications
You must be signed in to change notification settings - Fork 22
Description
There is a mismatch between the test execution duration shown in the pipeline logs and the duration value sent in the automated email report. The highlighted pipeline step "Run Playwright Tests" shows a duration of approximately 10m 45s for test execution (see attached screenshot), while the email report displays a much shorter duration (e.g., 3m 25s), which does not reflect the actual time taken by the test run.
Steps to Reproduce:
- Execute a Playwright test pipeline in Azure DevOps.
- Observe the duration for "Run Playwright Tests" in the job timeline and logs.
- Check the duration reported in the test summary HTML or email report generated by the pipeline.
Expected Behavior:
The duration shown in the email report should match the actual test execution time as recorded in the pipeline job (highlighted as 10m 45s).
Actual Behavior:
The email report displays a duration much shorter than the test execution time shown in the logs (example: 3m 25s).
Additional Details:
- This causes confusion as recipients see a test duration in the email that vastly differs from what's shown in the pipeline.
- Screenshots attached for reference:
- Pipeline job log showing 10m 45s for "Run Playwright Tests"
- Email report summary displaying 3m 25s for test execution
Attachments:
Pipeline job screenshot (shows true test execution time)
Email report screenshot (shows incorrect duration)
Request:
Please investigate why the test duration value in the email report does not match the actual test execution time and update the report logic to reflect the true duration.