Interactive issue / Side-by-side reader / Illustrative
More Plays Is Not the Whole Test
Two similar tracks appear in a fictional visibility test. The worksheet uses invented account amounts, not platform rates or program terms. Examine counts, receipts and the untreated reference together.
Switch between the observed lines before deciding what the test can support.
Track under test rises from 400 to 900 plays; unchanged reference rises from 420 to 660.
Exposure counts: The test track grew more on this count, but the reference also grew. Demand may have changed independently.
Test track rises from $8 to $9 while reference rises from $8 to $12.
Receipts comparison: More plays did not translate to a larger receipt increase. Check what was posted and in which period.
Takeaway: See why more plays alone cannot establish incrementality or even a higher modeled return.