How to Evaluate Your Creative Agency's Performance

Evaluating a creative agency's performance requires measuring both the quality of their creative output (hook rates, hold rates, CTR) and the downstream business impact (CPA improvements, purchase volume), not just counting deliverables or judging subjective aesthetic quality. Last updated: February 2026

Table of Contents

The Right Framework for Creative Agency Evaluation

Most brands evaluate their creative agency by asking: "Do I like the ads they make?" This is the wrong question. An ad you love that gets 0.4% CTR and $95 CPA is a failed creative. An ad you find visually unremarkable that gets 2.1% CTR and $18 CPA is an excellent creative.

Creative agency performance should be evaluated through three lenses:

    • Output quality: Are the creatives they produce technically strong on pre-click metrics?
    • Outcome quality: Do those creatives drive business results (CPA, ROAS, revenue)?
    • Operational quality: Are they reliable, communicative, and responsive?
All three matter. An agency that produces great creatives but is chaotic in execution creates operational drag. An agency that is professionally smooth but produces poor-performing creatives is not doing their job.

Output Metrics: Creative Quality

These metrics measure creative performance before the click, attributable directly to the creative itself:

Thumb Stop Rate / Hook Rate (3-second views / impressions): This is the metric most directly under the creative agency's control. Strong hooks reflect deep understanding of your audience. Hold Rate (average % of video watched): Hold rate reflects the quality of the body content, not just the opener. A high hook rate with low hold rate means the agency writes good openers but weak follow-through. Link CTR: Creative Volume Delivered: Did the agency deliver the agreed number of concepts on time? Volume is a basic operational metric that reveals execution reliability.

Outcome Metrics: Business Impact

Output metrics tell you about creative quality. Outcome metrics tell you about business impact.

Cost Per Acquisition (CPA): Is CPA trending toward target? Use 30-day rolling averages to smooth weekly variance. Compare against your pre-agency baseline. Return on Ad Spend (ROAS): Is blended ROAS improving over time? Improving ROAS indicates the creative system is getting better. Creative win rate: What percentage of creatives tested reach target CPA? MHI Media benchmarks suggest strong creative agencies achieve 25-35% creative win rates (1 in 3-4 tested creatives hits target performance). Below 15% win rate suggests weak creative strategy. Velocity of improvement: How fast is performance improving month-over-month? Strong agencies produce a measurable trajectory of improvement. Flat performance after 3+ months suggests a capability ceiling.

Process Metrics: Operational Quality

Delivery reliability: Did they deliver the agreed creative volume on time? Track scheduled vs delivered. Consistent late delivery indicates workflow problems. Revision quality: When you request revisions, do they nail it in 1-2 rounds? More than 2 revision cycles per creative suggests poor brief comprehension or communication. Briefing quality: Are their creative briefs insightful and specific, reflecting genuine understanding of your customer? Or are they generic templates? Proactive communication: Do they surface problems before you notice them? Proactive agencies flag declining hook rates and propose replacement creative before you have to ask. Response time: For routine questions: same business day. For urgent issues: within 4 hours. Consistent slow response times indicate you are not a priority client.

The Monthly Agency Scorecard

Create a simple one-page scorecard reviewed monthly:

Output Score (40% weight): Outcome Score (40% weight): Process Score (20% weight): Overall score: 0-100. Red: below 50. Yellow: 50-70. Green: 70+.

Review the scorecard in your monthly agency meeting. Sharing it with the agency creates transparency and shared understanding of performance expectations.

When to Give Feedback vs When to Terminate

Give feedback and expect improvement when: Escalate to formal review when: Terminate when:

FAQ

How long should I give a new agency before evaluating results? 30 days for initial operational assessment (are they reliable and responsive?). 60-90 days for creative quality assessment (are their hook rates and CTR strong?). 90+ days for business outcome assessment (is CPA improving?). Do not draw business conclusions in the first 30 days. What if the agency's creative looks great but CPA is not improving? Separate creative performance from CPA performance. Check hook rates and CTR: if these are strong and CPA is still poor, the issue may be your offer, landing page, or fundamental audience economics rather than the creative. Do not blame the agency for problems outside their scope. Should I share the scorecard with the agency? Yes, absolutely. The scorecard should be a shared tool, not a secret evaluation. Agencies that object to transparent performance measurement are agencies with something to hide. How do I benchmark against competitors when I cannot see their metrics? Use category benchmarks from industry reports, ask your network of DTC founders about their experience, and use Meta's own benchmarking tools in Ads Manager. MHI Media publishes category benchmarks periodically that can serve as reference points. Can a creative agency improve if their initial performance is poor? Sometimes. Agencies that start slowly but show genuine learning, improving metrics over 2-3 months, often end up as strong long-term partners. Agencies that show no improvement trajectory after 90 days with clear feedback are unlikely to change.