Michael S. answered 04/05/26
MIT-Trained Math Tutor and AI Systems
Ok, practical Use Case..
Marketing (A/B testing)
You run two campaigns:
- Version A converts at 40%
- Version B converts at 35%
Looks better, right? But your interval says: “This could actually be worse… or better… we don’t know yet.”
What do you do reporting this??
From the trenches (30 years).
This is what happens
It went up, ship it
They see:
- 35% → 40%
And say: “That’s a 5% lift. Roll it out.” I guarantee it.
No stats. No interval. Just vibes. How do you sway them?
that's the real value here