Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Dec 5, 2025

Display tester agent messages in agent-to-agent test logs, controlled by a new global flag.

Agent-to-agent tests using OpenAI only showed responses from the Voiceflow agent under test, not messages generated by the tester agent. This made it difficult to understand how the tester agent generates its messages based on goal and persona.

Changes

  • Added --show-tester-messages global flag (default: true)

    • Controls visibility of tester agent messages in both OpenAI and Voiceflow agent-to-agent tests
    • No short flag to avoid CLI convention conflicts
  • Updated AgentTestRunner (OpenAI tester)

    • Logs tester responses: "Tester agent message: <message>"
    • Optimized to trim response string once instead of twice
  • Updated VoiceflowAgentTestRunner (Voiceflow tester)

    • Applies same flag for consistent behavior
    • Logs: "Tester agent says: <message>"
  • Updated server mode (cmd/server.go)

    • Explicitly sets ShowTesterMessages = true when server starts for better observability in API-based test execution

Usage

# Tester messages shown by default
voiceflow test execute suite.yaml

# Disable for less verbose output
voiceflow test execute suite.yaml --show-tester-messages=false

# Server mode automatically enables tester messages
voiceflow server

Related to agent-to-agent testing improvements and test observability.

Original prompt

This section details on the original issue you should resolve

<issue_title>Output the message by the tester agent (a2a)</issue_title>
<issue_description>### Is your feature request related to a problem? Please describe.

Currently when we run agent-to-agent tests using OpenAI. We only see the responses from the VoiceFlow agent that we are testing. Not the messages sent by the Tester agent.

Describe the solution you'd like

Output the messages in the logs generated by the OpenAI tester agent. Perhaps add a global CLI argument to enable this.

Describe alternatives you've considered

No alternative to be found

Search

  • I did search for other open and closed issues before opening this.

Code of Conduct

  • I agree to follow this project's Code of Conduct

Additional context

I believe having this is essential to see how the Tester agent generates its messages based on its goal and persona. </issue_description>

Comments on the Issue (you are @copilot in this section)


💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.

@coderabbitai
Copy link

coderabbitai bot commented Dec 5, 2025

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Comment @coderabbitai help to get the list of available commands and usage tips.

Copilot AI changed the title [WIP] Add logging for messages from tester agent Add --show-tester-messages flag to display tester agent output in a2a tests Dec 5, 2025
Copilot AI requested a review from xavidop December 5, 2025 10:07
@xavidop
Copy link
Owner

xavidop commented Dec 5, 2025

@copilot set ShowTesterMessages when teh server mode starts

Copy link
Contributor Author

Copilot AI commented Dec 5, 2025

@copilot set ShowTesterMessages when teh server mode starts

Done in d36c242. The server mode now explicitly sets ShowTesterMessages = true for better observability when running agent-to-agent tests through the API.

@xavidop xavidop marked this pull request as ready for review December 5, 2025 10:15
@xavidop xavidop merged commit 2ba0d38 into main Dec 5, 2025
10 checks passed
@xavidop xavidop deleted the copilot/output-tester-agent-messages branch December 5, 2025 11:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Output the message by the tester agent (a2a)

2 participants