1Freeze the job
Three briefs, three sessions each, identical source assets and a 30-minute operator limit. Every workflow produces the same 15-second deliverable.
2Keep the misses
Log every request and retry. Preserve raw files, receipts, exact prompts, settings and edit time. Uncertain requests are reconciled before more paid work.
3Review without the price
Two independent people review anonymized exports against the brief. Product, copy and technical gates must pass. Disagreements get a third review.
4Cost all the work
Divide the full batch cost, including failures, by accepted ads. Show generation spending separately from the assumed dollar value of human time.
Acceptance criteria and scoring
Exact product identity and approved copy; no blocking geometry, label, framing or claim error; readable copy at phone size. H.264, 720 × 1280, 24 fps, 15 ± 0.1 seconds, silent and decodable. Human fidelity, legibility, motion and brief-fit scores must each be at least 4/5. Both blind reviewers must accept, or a third adjudicates.
Sample limits and freshness
The first cohort uses one fictional bottle across introduction, detail and retargeting briefs. Nine sessions per workflow cannot establish a universal reliability ranking. It measures production acceptance, not ad performance. The protocol and source prices were checked September 23, 2026; new controlled trials have no test date yet. New model versions, materially different assets or changed workflow settings need a new cohort.
Independence and commercial disclosure
The proposed agency fee buys testing and a readout, never a favorable score. Providers cannot suppress failures. Kingy's wider media business accepts sponsorships; any supplied credits, affiliate relationships or sponsorship relevant to a test will be disclosed with that cohort. No provider funded this launch, and no paid pilot customer has validated the offer.
Kingy editorial and sponsorship standardsWhy begin with product ads?
It is a repeatable job with concrete brand-approval gates and visible editing costs. IAB's 2025 research reported that 86% of surveyed buyers used or planned to use GenAI for video creative. That is a category signal, not proof that agencies will pay for this product. Kingy's existing asset and pilot make it a practical first test.
We considered captioned shorts, support answers and coding-agent work. Product ads offered the best combination of existing Kingy material and a narrowly testable buyer decision. The conclusion remains a hypothesis.
IAB source · Commercial research and alternativesCorrections and version history
v1.1 · September 23, 2026: agency pilot capped at US$500 total for one brief and nine sessions.
v1.0 · September 23, 2026: protocol, system demonstration and historical evidence audit published. No new paid benchmark results.
Corrections retain the old record and identify affected totals. The ledger regenerates JSON, CSV and report together. Price updates become dated scenarios; historical consumption stays fixed. Send a correction through the inquiry form and identify the record.