> ## Documentation Index
> Fetch the complete documentation index at: https://confidence.spotify.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Reviews

> Reviews allow you to give feedback on and signal to your teammates that an experiment is ready for launch or not. Surfaces can optionally require approval before allowing experiments to launch.

## Overview

The review process for A/B tests and rollouts can happen in several ways in
Confidence:

* You can request a review from a teammate by clicking the plus icon
  in the **Reviews** section on the sidebar.
* You can request a review from an AI review agent that provides automated
  feedback on your experiment design.
* Anyone that has read rights to your experiment can decide to leave a review
  by clicking the thumbs-up-and-down icon in the **Reviews** section on the
  sidebar.
* A surface that you run your experiment on can suggest or require reviewers on
  your experiment. If your experiment runs on surfaces that require reviewers, you can't launch
  the experiment unless at least one reviewer from each surface has approved the
  experiment.

<Note>
  Get pinged on Slack when someone mentions you or replies to your comment
  by [connecting your personal Slack account with
  Confidence](/docs/how-to-guides/connect-personal-slack).
</Note>

### Required and Optional Reviewers

All reviewers that you add on the experiment design page are optional in the
sense that you can launch the experiment without approval. Required reviewers
only come from [surfaces](/docs/surfaces/surface-settings).

<Warning>
  AI agent approvals are informational only and do not count toward required
  reviews. At least one human reviewer from each surface must approve before
  you can launch the experiment.
</Warning>

#### Experiment Changes After Approval

Changes to approved experiments reset the approvals. This means that
required reviewers must approve the experiment again before you can launch it.
Changes that reset the approvals are:

* Changing the flag, flag variants, or adding more variants.
* Changing any settings in the audience section, including the allocation percentage.

### Add Reviewers for a Surface

The surface owner can add suggested or required reviewers to the surface. Configure reviewers on the [surface settings page](/docs/surfaces/surface-settings).

## Request a Review

Request a review from a teammate by clicking the plus sign icon in the **Reviews**
section on the right sidebar of the experiment design page. Reviewers can
approve or reject the experiment design and leave comments.

Request reviews from surface reviewers by clicking **Request review** next to
their name. To request a review from all reviewers on a surface, click **Request
review** next to the surface name.

Reviews from optional reviewers are only informational and do not block
launching experiments. You should discuss with your team how to work with
reviews.

<Note>
  If a reviewer requests your review for an experiment, there is a
  banner on top of the experiment page when you visit the experiment to remind
  you to leave your review. This banner disappears for already approved
  experiments.
</Note>

## Review an Experiment

To review an experiment, click the comment icon at the top right corner on the
experiment page. After you have added comments on sections you want to discuss
or request changes to, submit the review by making an overall judgment
on the experiment design and approve or reject it.

To review an experiment:

1. Go to an A/B test or a rollout.
2. Click the thumbs-up-and-down icon at the top of the **Reviews** section on the right sidebar.
3. Select the outcome of the review in the review dialog. Add a comment if needed.
4. Click **Save**.

## AI Review Agents <Badge color="orange">Beta</Badge>

<Tip>
  AI review agents are currently in beta. If you don't see the **Agents** page in
  your organization, contact
  [experimentation-cs@spotify.com](mailto:experimentation-cs@spotify.com) to
  request access.
</Tip>

AI review agents provide automated feedback on experiment designs. Create
custom agents with specific instructions tailored to your team's review
criteria. When you request a review from an agent, it analyzes the experiment
design and posts comments on individual sections where it has feedback.

Agents can review both A/B tests and rollouts. Each agent has instructions
that define what to check for in each section of the experiment design, such
as hypothesis quality, metric configuration, audience targeting, and sample
size calculations.

Agent reviews are informational and don't count toward required reviews.
An AI agent approval does not meet the required reviewer requirement
for launching—at least one human reviewer must approve.

<Card title="Use Review Agents" href="/docs/how-to-guides/create-review-agent" icon="robot">
  Learn how to create and use AI review agents
</Card>

## Related Resources

<CardGroup cols={2}>
  <Card title="Use Review Agents" href="/docs/how-to-guides/create-review-agent">
    Create and use AI review agents
  </Card>

  <Card title="Configure Reviews" href="/docs/how-to-guides/configure-surface-reviews">
    Set up surface review requirements
  </Card>

  <Card title="Comments" href="/docs/experiments/comments">
    Add comments to experiments
  </Card>

  <Card title="Connect Personal Slack" href="/docs/how-to-guides/connect-personal-slack">
    Get review notifications
  </Card>

  <Card title="Surface Settings" href="/docs/surfaces/surface-settings">
    Configure surface reviewers
  </Card>
</CardGroup>