Maxim Borisik partners with teams, finds solutions to a challenging cases and provides the best innovative decisions - that is what he is passionate about! Now he is a product lead in Adapty.io, a revenue manage­ment platform for mobile apps.

The Talk

When Manual Experimentation Becomes the Bottleneck

Manual experimentation is how most mobile teams try to improve monetization. Run more A/B tests, tweak prices, adjust paywalls. This works early on, but it quietly breaks as products grow.

In this talk, I’ll share a real product story from building a Monetization Autopilot at Adapty. We expected the hardest problems to be pricing strategy or data quality. Instead, the real issue showed up earlier. Teams simply could not keep up with the number of experiments and decisions they needed to make. Testing slowed down, confidence in results dropped, and advanced monetization features stopped being used.

I’ll walk through what broke when manual experimentation stopped scaling, what we tried first and why it did not help, and what changed when we started treating monetization as a system rather than a set of isolated tests.

This topic is relevant for the product and makers community because many teams are already at this breaking point, even if they have not named it yet. The talk is about real tradeoffs, mistakes, and lessons from building and shipping a complex product in production.

What You Will Learn

• How to recognize the moment when manual experimentation stops scaling

• Why running more tests often makes things worse instead of better

• What teams usually try next and why it rarely works