55.1 Playground Tools Panel

The Playground side panel contains three testing areas:

  • Scenario
  • Page context
  • Diagnostics

On smaller screens these controls are available through the Playground Tools panel.

55.2 Scenario Testing

The Scenario area lets you test the Agent under a selected Site Type and Language context without permanently changing the Agent.

A Site Type override is identified in the Playground header with an (override) indicator.

55.3 Site Type Override

Use Site Type override when you need to test how the same Agent behaves under another vertical configuration.

This is especially useful before changing the Agent's actual Site Type or when evaluating whether a preset better matches the website.

55.4 Language Override

The Scenario panel also supports a Language override.

When active, the Playground header identifies the override so you can distinguish test behavior from the Agent's normal Language configuration.

55.5 Sample Prompts

Playground provides sample prompts based on the effective vertical.

Select a sample prompt to place it into the Chat input, or enter a custom question that better represents your real visitor traffic.

55.6 Page Context

The Page context tab lets you simulate information about the webpage where a visitor might be chatting.

Page context can include page-level information such as URL, Title, description, headings, visible text, structured metadata, and supported commerce context.

This makes it possible to test page-aware behavior without navigating a real visitor through every production page.

55.7 Why Page Context Matters

An Agent may produce different answers depending on the page the visitor is currently viewing.

Use Page Context to verify that page-specific information improves the answer rather than introducing irrelevant assumptions.

55.8 Diagnostics

After a Playground turn, the Diagnostics tab exposes technical information that shaped the response.

The interface identifies diagnostics including:

  • First-token latency.
  • Total response latency.
  • Retrieval confidence.
  • Configured confidence threshold.
  • Retrieved Chunks.
  • ANN and rerank scores.
  • The exact System prompt used.
  • Tool calls fired during the turn.
  • Inline blocks emitted by the Agent.
  • The applied vertical.
  • The response Language.
  • Conversation history-turn count.

55.9 Reading Retrieved Sources

The Diagnostics panel lists retrieved Sources and can show:

  • The Source URL.
  • A text snippet.
  • ANN similarity score.
  • Rerank score when available.

Use this information to determine whether the Agent retrieved the right Knowledge for the test question.

55.10 Low Confidence

A completed Playground reply can display a Low confidence badge.

When this appears, inspect Diagnostics and the underlying Knowledge before simply lowering the confidence threshold. The better correction may be to improve the Agent's Sources.

55.11 Workflow and Curated Answer Badges

Playground can mark replies with:

  • Workflow
  • Curated answer

These labels help confirm which response path handled the visitor message.

55.12 Side-by-Side Compare

Select Compare to test two vertical configurations side-by-side.

The same visitor message is sent through both comparison paths, allowing you to review the resulting Conversations together.

On desktop, the two responses appear in parallel columns. On smaller screens, A and B tabs let you switch between the two comparison results.

55.13 Choosing the Compare Vertical

The primary side represents the effective main Site Type. Select a different Site Type for the comparison side.

Use this to compare response quality before changing the Agent's permanent vertical.

55.14 Regenerate and Reset During Diagnostics

Use Regenerate to re-run the last visitor message under the currently selected test configuration.

Use Reset when you need a completely clean Conversation and Diagnostics state.

Write Your Comment