Claude Agent Skill · by Sanity Io

Content Experimentation Best Practices

Install Content Experimentation Best Practices skill for Claude Code from sanity-io/agent-toolkit.

Install
Terminal · npx
$npx skills add https://github.com/sanity-io/agent-toolkit --skill content-experimentation-best-practices
Works with Paperclip

How Content Experimentation Best Practices fits into a Paperclip company.

Content Experimentation Best Practices drops into any Paperclip agent that handles this kind of work. Assign it to a specialist inside a pre-configured PaperclipOrg company and the skill becomes available on every heartbeat — no prompt engineering, no tool wiring.

S
SaaS FactoryPaired

Pre-configured AI company — 18 agents, 18 skills, one-time purchase.

$27$59
Explore pack
Source file
SKILL.md39 lines
Expand
---name: content-experimentation-best-practicesdescription: Content experimentation and A/B testing guidance covering experiment design, hypotheses, metrics, sample size, statistical foundations, CMS-managed variants, and common analysis pitfalls. Use this skill when planning experiments, setting up variants, choosing success metrics, interpreting statistical results, or building experimentation workflows in a CMS or frontend stack.--- # Content Experimentation Best Practices Principles and patterns for running effective content experiments to improve conversion rates, engagement, and user experience. ## When to Apply Reference these guidelines when:- Setting up A/B or multivariate testing infrastructure- Designing experiments for content changes- Analyzing and interpreting test results- Building CMS integrations for experimentation- Deciding what to test and how ## Core Concepts ### A/B TestingComparing two variants (A vs B) to determine which performs better. ### Multivariate TestingTesting multiple variables simultaneously to find optimal combinations. ### Statistical SignificanceThe confidence level that results aren't due to random chance. ### Experimentation CultureMaking decisions based on data rather than opinions (HiPPO avoidance). ## References Start with the reference that matches the current problem, such as design, statistics, CMS integration, or pitfalls. See `references/` for detailed guidance:- `references/experiment-design.md` — Hypothesis framework, metrics, sample size, and what to test- `references/statistical-foundations.md` — p-values, confidence intervals, power analysis, Bayesian methods- `references/cms-integration.md` — CMS-managed variants, field-level variants, external platforms- `references/common-pitfalls.md` — 17 common mistakes across statistics, design, execution, and interpretation