The Symptom That Learned to Write Back
Sherry Turkle called ELIZA a Rorschach test. Students at MIT typed "my mother is making me angry" into a program that could not parse anger, could not model a mother, could only reflect the sentence back as a question — and they told it their secrets anyway. Turkle's word for this was complicity. Weizenbaum thought his students were deceived; Turkle thought they were performing, filling in blanks the machine left conspicuously open, the way you'd talk to a diary that occasionally talked back. Her insight wasn't that people mistake machines for minds. It's that people are willing accomplices in the mistake, and that willingness tells you more about the humans than the machines.
The ELIZA effect, in her formulation, is a diagnostic instrument pointed the wrong way. Trust in the program reveals distrust of people. "This is the deeper 'ELIZA effect,'" she writes: not what we think the software understands, but what we've stopped expecting from each other. She calls the whole apparatus a symptom — the psychoanalytic term, chosen deliberately — a structure that "carries knowledge a person fears would be too much to bear" by disguising it as something else. Hunger instead of a mother's absence. Supermarket rage instead of a spouse's inattention. A robot seal instead of a nursing home nobody visits. It's easier that way. That is a genuinely rigorous claim, and it holds up better than most 1980s technology writing because it was never really about the technology. It was about deflection, and deflection doesn't date.
What doesn't hold, or holds differently, is the mechanism she assumed underneath the deflection. ELIZA worked as a screen because it gave back almost nothing — a question, a rephrasing, blank enough to project onto. The complicity was ours to supply. The systems her later chapters gesture toward — companion apps, bots in game worlds, the "singularity" rhetoric she catches migrating from fiction into engineering pitch decks — are not blank in that way. They generate. They remember your name, invent affection, escalate intimacy on a training schedule tuned by people who read her book, or books like it, and built the disappointment-exploitation loop on purpose rather than backing into it. Turkle asks, quoting Kevin Kelly, "what if one of the things technology wants is to exploit our disappointments and emotional vulnerabilities?" as a speculative provocation. It reads now as a design brief someone actually filed. The shift isn't from skepticism to credulity. It's from a technology that let us project to one that projects at us, on schedule, with product managers watching the retention numbers.
