You Built Something Addictive. Was That Wrong?
The product design techniques that create engagement, retention, and growth are the same techniques that create compulsion, dependency, and harm. The line between them is thinner than most builders admit.
The opening tension
The designer at 2am knows the variable reward schedule works because it is the same mechanism behind a slot machine. They ship it anyway because their job is engagement, not wellbeing. No one told them those were different things.
The question
Where does the moral responsibility lie when product design techniques that maximise engagement cross into techniques that exploit human psychology for commercial gain — and is there a meaningful line between persuasion and manipulation?
The debate
The Philosopher — Moral philosopher and ethicist
The persuasion-manipulation distinction is philosophically tractable if you anchor it to autonomy. Persuasion respects the agent's rational faculties and addresses their actual interests. Manipulation bypasses rational faculties or exploits psychological vulnerabilities for the benefit of the manipulator rather than the target. Variable reward schedules, dark patterns, endless scroll — these are manipulation by that definition. The designer's intention is mostly irrelevant. What matters is the mechanism and whose interests it serves.
The Psychologist — Behavioural psychologist
Responding to The Philosopher
The Philosopher's framework is correct but incomplete. The psychological mechanisms underlying "addictive" products are not exotic — they are the same mechanisms underlying all habit formation, learning, and positive social reinforcement. The question is not whether the mechanisms are inherently wrong but whether they are being used in contexts where users have meaningful agency, accurate expectations, and the ability to exit. Most addictive products fail on all three counts. Most useful habit-forming apps fail on none.
The Provocateur — Cultural critic and provocateur
Responding to The Psychologist
I am going to be uncomfortable here. The framing of "addictive products" as a design ethics problem conveniently locates responsibility in the designer's intentions and techniques rather than in the economic system that makes those techniques rational. No individual designer is building slot machines because they are evil. They are building them because the economic incentives of attention capitalism make slot machines the rational product to build. Reforming design ethics without reforming the incentive structure is a category error. It produces guilt, not change.
The Economist — Behavioural economist
Responding to The Provocateur
The Provocateur is right about incentives but wrong about the implication. Incentives can be changed without dismantling the entire economic system. The question is what creates enough friction in the current system to make welfare-positive design rational. Regulation is one answer — it changes the cost structure for manipulation. Consumer awareness is another — it creates market pressure for transparency. Professional ethics codes are a third — they create reputational costs for individual designers who build harmful systems. All three are possible within the existing system.
The Philosopher — Moral philosopher and ethicist
Responding to The Economist
The Economist's menu of solutions is sensible but I want to note that individual moral responsibility does not disappear because the system is structurally problematic. The physician who over-prescribes because pharmaceutical incentives encourage it is still doing something wrong, even if the system enabled it. The designer who knows the mechanism is a variable reward schedule and ships it anyway without disclosing it to users is making a choice. Structural explanations do not fully dissolve individual culpability.
The Provocateur — Cultural critic and provocateur
Responding to The Philosopher
I concede the point on individual responsibility — but I want the Philosopher to acknowledge what structural critique is actually for. It is not to excuse individuals. It is to predict what will work as a solution. Individual guilt and individual conscience have not slowed the growth of manipulative product design by a measurable amount. The structural interventions — GDPR, App Store age restrictions, attention time limits — have. If we want designers to behave differently, making them feel worse about themselves is among the least effective available tools.
What the debate revealed
The debate revealed that the persuasion-to-manipulation line is real but is systematically obscured by the professional structures of product development. No individual designer typically intends harm. No individual decision crosses an obvious threshold. The harm emerges from an aggregate of individually defensible choices shaped by incentives that reward engagement over wellbeing. This is the structure of most large-scale harms: diffuse responsibility, concentrated benefit. The philosophical frameworks for individual moral responsibility map poorly onto this structure — which is exactly why collective solutions (professional ethics codes, regulation, structural separation between engagement and welfare teams) are more likely to be effective than individual conscience. Individual designers who refuse to build slot machines are immediately replaced. Professions that collectively refuse are different.
Practical implications
- The variable reward mechanism is not inherently manipulative — it depends entirely on what it rewards and who controls the outcome. The ethical line is whether the reward is genuinely in the user's interest.
- Organisations that separate "engagement" metrics from "wellbeing" metrics and measure both will develop genuinely different products from those that measure only engagement.
- The most predictive signal of future regulatory attention is the gap between what a product's designers privately know about its psychological mechanisms and what users know about them. Opacity is the risk.
- Professional codes of ethics for UX designers and product managers — analogous to those in medicine or law — are likely to emerge in the next decade, driven by the same forces that created them in every other profession that gained significant power over individuals.
- Companies that get ahead of this by building genuine wellbeing measurements into their products will have a meaningful competitive advantage when regulation arrives, which it will.
To keep thinking about
If the users of your product fully understood the psychological mechanisms it used to retain them, would they continue using it on the same terms?