Skip to content

Duration in Email Report Is Incorrect Compared to Actual Test Execution Time #117

@dipal07

Description

@dipal07

There is a mismatch between the test execution duration shown in the pipeline logs and the duration value sent in the automated email report. The highlighted pipeline step "Run Playwright Tests" shows a duration of approximately 10m 45s for test execution (see attached screenshot), while the email report displays a much shorter duration (e.g., 3m 25s), which does not reflect the actual time taken by the test run.

Steps to Reproduce:

  1. Execute a Playwright test pipeline in Azure DevOps.
  2. Observe the duration for "Run Playwright Tests" in the job timeline and logs.
  3. Check the duration reported in the test summary HTML or email report generated by the pipeline.

Expected Behavior:
The duration shown in the email report should match the actual test execution time as recorded in the pipeline job (highlighted as 10m 45s).

Actual Behavior:
The email report displays a duration much shorter than the test execution time shown in the logs (example: 3m 25s).

Additional Details:

  • This causes confusion as recipients see a test duration in the email that vastly differs from what's shown in the pipeline.
  • Screenshots attached for reference:
  • Pipeline job log showing 10m 45s for "Run Playwright Tests"
  • Email report summary displaying 3m 25s for test execution

Attachments:

Pipeline job screenshot (shows true test execution time)

Image

Email report screenshot (shows incorrect duration)

Image

Request:
Please investigate why the test duration value in the email report does not match the actual test execution time and update the report logic to reflect the true duration.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions