Something new at Twilio

Flag unresolved conversations without chasing every returning customer

Published Oct 29, 2026

You’re the ai / ml engineer. Your team is in the room.

The setting

supplies cloud software that lets developers and businesses build messaging, voice, and email into their applications. Its gathers these tools, along with identity checks and customer data.

A polite conversation ending does not establish that the customer received help.

Selective follow-up protects service continuity, while restraint protects customers who have nothing left to resolve.

Who you’d be doing this for

“Yesterday our agent said goodbye, then the customer opened another chat asking the exact same question.”

Fatemeh Aydin · Application Engineer at an online retailer · a character in this brief

Builds the service agent and the workflow that offers customers additional assistance.

What is at stake

In a sample of 2,000 service conversations, 18% of customers returned within 48 hours, but only some still needed help. You must weigh a useful signal of unfinished service against unnecessary follow-ups and labels that confuse a new question with an old problem.

Why it isn’t already fixed

Every obvious fix costs something else. That’s the part you’d have to decide.

  • missed unresolved needs vs unnecessary follow-ups
  • predictive coverage vs explicit evidence
  • customer-specific patterns vs generalization
  • timely predictions vs isolation from live retrieval

Why Twilio

Structured conversation memory supplies context across voice and messaging, but a return visit alone does not establish that the earlier interaction failed.

Written with these in mind

Applied ML engineersConversation-model buildersExperiment-minded production engineers

Not your kind of problem? 41 more at Twilio, or browse every organization.

Where the organization context comes fromThe postings this brief was written from, and the reporting read before it.

The organization context comes from public information. The situation and characters are written for the brief.

Job postings it was written from

Public descriptions of the work at Twilio. They are listed as sources, not as openings. The lines under a posting are its own words, where it meets this brief.

  • Staff Machine Learning Engineer (opens in a new tab)
    • This position is needed to build the foundational AI/ML capabilities and common platform tooling that power intelligent engagement experiences across Twilio.
    • You will influence the design and evolution of our company-wide ML/AI Ops foundation, ensuring every AI capability incorporates rigorous offline and online evals to maintain exceptionally high quality.
  • Machine Learning Engineer 2 (opens in a new tab)
    • Build the extraction pipeline that turns raw data into structured memory, tuning the LLM prompts and schemas that decide what an AI agent remembers about a customer and what it forgets.
    • This position is needed to build and scale the pipelines that turn raw conversation data into structured, searchable customer memory, and the evaluation systems that keep that memory accurate as the product evolves.

This is the setup. The work is inside.

Running it puts you in the room: the full situation and its constraints, stakeholders who push back in their own words, and the decisions that are yours to make. What you produce becomes a Day One Plan — work you can show someone instead of describing.

Other live briefs connected to this one, and what connects them.

Similar problems at other organizations

Like this one, each of these turns on deciding on evidence that's still thin.

The same setting, from another role

Each is set around Twilio’s Twilio Customer Engagement Platform, written for a different role. They’re separate briefs, not the same scenario.

Other problems with a similar purpose

In each of these, as in this one, the aim is using evidence and inquiry to uncover the true problem worth solving before committing craft or budget to an answer.