Quick numbers first so you can roast me:
The piece I did not expect to matter: 3 AM nudges.
Half of the retained users light up between 1 AM and 4 AM. Shift workers, parents, insomniacs. Standard quit-smoking apps go quiet at night — Allen Carr style "stay strong" copy is daylight-coded. So I wrote a tiny generator: when a user logs a craving past midnight, the next nudge is shorter (≤ 14 words), less moralizing, and references something concrete from their last 3 logs ("you said the patio at 2 AM was the trigger — try the kitchen tonight").
That single change moved day-7 retention from 9% to 23% in two weeks. Sample is small, I know. But the directional signal is too clean to ignore.
What I am still wrong about:
Anyone here built behavior-change products? How did you handle the relapse cohort without making the success cohort feel boxed in?
(I am also building TokRepo on the side — an agent skill marketplace. That is where I source the prompt-engineering bits for nudge generation.)
I actually know a few product builders who have experience with behavior-change products personally. I bet they'd be willing to answer some of your questions for free if you want to pass them along.