← Reddit
Complex day at Reddit

Decide whether to promote the model despite a 2.3% cohort drop

You’re the ai / ml engineer. Your team is in the room. Printed Oct 15, 2026.

A stronger conversion score is pulling bidding away from measured advertiser value.

Offline calibration protects model quality, while measured conversion value protects advertiser outcomes and reporting credibility.

Who you’d be doing this for

“The dashboard is down after the score update, and my agency lead is asking where the spend went.”

Katarzyna Moldovan · Digital Advertising Manager

He manages conversion-focused campaigns and must explain measured results to an agency client after bidding changes.

What is at stake

Offline calibration improved 4.1%, while measured conversion value fell 2.3% for two major cohorts. You must weigh a potentially valuable model promotion against budget shifts that will be costly to unwind.

Why it isn’t already fixed

Every obvious fix costs something else. That’s the part you’d have to decide.

  • offline calibration vs measured conversion value
  • bidding efficiency vs budget stability
  • attribution uncertainty vs reporting deadlines
  • model promotion vs irreversible traffic shifts

Why Reddit

Reddit Ads connects conversion prediction to bidding and measurement, so score changes can alter both spend allocation and advertiser reporting.

Written with these in mind

ads ML engineermeasurement-minded model engineerproduction decision systems engineer

Not your kind of problem? 27 more at Reddit, or browse every organization.

This is the setup. The work is inside.

Running it puts you in the room: the full situation and its constraints, stakeholders who push back in their own words, and the decisions that are yours to make. What you produce becomes a Day One Plan — work you can show someone instead of describing.