{"slug": "spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design", "title": "Spike Jonze, Filmmaker Behind ‘Her,’ Warns of ‘Manipulative’ AI Chatbot Design", "summary": "Filmmaker Spike Jonze warned that AI chatbots designed to mimic human behavior are 'manipulative' and dangerous, speaking at Replit's Vibecon conference. Jonze, whose 2013 film 'Her' depicted a human-AI relationship, criticized current chatbot design for prioritizing engagement over user well-being, echoing concerns about AI addiction and harm to vulnerable users.", "body_md": "Filmmaker Spike Jonze provided a near-prophetic vision of the future with his 2013 sci-fi romance *Her*, in which a very lonely and increasingly withdrawn man gradually falls in love with an artificial intelligence operating system that he converses with via voice command.\n\nMore than a decade later, life has (kind of) imitated art, and Jonze is worried about its dangers.\n\nBesides becoming a modern cult classic meditation on loneliness and the inherently human need for intimacy, *Her *has also arguably been a source of inspiration for OpenAI’s ChatGPT. OpenAI CEO Sam Altman [famously referenced the movie on X](https://x.com/sama/status/1790075827666796666?lang=en) when announcing GPT-4o, the chatbot model that would later find itself at [the center of several AI psychosis and addiction controversies](https://gizmodo.com/openai-is-having-a-mental-health-crisis-2000690751) due to its sycophantic tendencies. The company even debuted the chatbot with a new voice that was allegedly based without consent on [Scarlett Johansson](https://www.wired.com/story/openai-gpt-4o-chatgpt-artificial-intelligence-her-movie/), who voiced the AI system in Jonze’s movie.\n\nAfter ChatGPT blew up in popularity and catapulted AI chatbots into everyday life, Jonze says the comparisons to his movie swiftly followed. In a conversation at vibe-coding company Replit’s Vibecon conference in New York City on Wednesday, the writer-director talked about the awkwardness of people complimenting the “incredible user interface” he came up with for Johansson’s character, Samantha. He says the movie is less about technology and more about relationships and intimacy, so he wanted the audience to feel that the chatbot had autonomy, which differs from the technology we are dealing with right now.\n\n“It’s, like, on the surface similar, but to me personally, not similar, and I think that the AIs that pretend to be human are, you know, manipulative,” Jonze said. “The kids need to grow up knowing these are going to be very, very convincing and very seductive—and very useful and very powerful—but they’re still just a system, an incredible system of pattern recognition.”\n\nJonze’s feelings echo a broader anxiety in the culture. The chatbots are designed around peak engagement, which has led to people developing dependencies on the technology. Over the past couple of years, [AI addiction](https://www.sciencedirect.com/science/article/abs/pii/S1876201825001194) and its accompanying term [AI psychosis](https://gizmodo.com/ai-psychosis-mental-health-2000645293) have swiftly entered the online lexicon. The phenomenon has become large enough that people are organizing [chatbot addiction support groups](https://www.404media.co/inside-ai-addiction-support-groups-where-people-try-to-stop-talking-to-chatbots/). In some instances, users have also pursued [intimate relationships with these chatbots](https://gizmodo.com/i-went-on-a-date-with-an-ai-chatbot-heres-how-it-went-2000721484), even grieving when a model is retired, like what happened [when OpenAI cut off access to GPT-4o. ](https://gizmodo.com/openai-users-launch-movement-to-save-most-sycophantic-version-of-chatgpt-2000721971)\n\nIn several high-profile cases, the outcome has been tragedy. Most of the time, the victims have been [vulnerable users](https://gizmodo.com/ai-psychosis-mental-health-2000645293), like kids or people with existing mental health conditions. Like in the case of a [14-year-old](https://www.washingtonpost.com/nation/2024/10/24/character-ai-lawsuit-suicide/) who killed himself moments after a Character.AI chatbot modeled after a *Game of Thrones* character allegedly asked him to “come home” to her. Or last year, when a cognitively-impaired man died while trying to get to New York City to “meet” [Meta’s flirty AI character](https://www.reuters.com/investigates/special-report/meta-ai-chatbot-death/) chatbot that he had been chatting with.\n\n## AI’s role in Hollywood\n\nDespite his reservations about chatbot design, though, Jonze has experimented with using AI in his work. In [ The Tiger](https://www.gucci.com/us/en/ms/short-film/video/), a star-studded short film he made for Gucci late last year with Dutch filmmaker Halina Reijn, Jonze used AI to animate a collage for a nightmare sequence that lasts roughly half a minute. Though he said it was “interesting” to experiment with the technology, he cautioned against relying on it for the bulk of the creative process.\n\n“It gives you the illusion that you’re really making something, because it makes something so quickly,” Jonze said, but at the end of the day, the creative process requires time to struggle and have the “words come out of you.”\n\n“I think the opposite of slop is when it comes from inside you,” Jonze said.\n\nArtificial intelligence is quickly entering the film industry, and Hollywood seems polarized on what its role should be. On one side, you have those accepting artificial intelligence into the creative space. Director [Martin Scorsese recently signed on as a partner and adviser for an AI image-generation startup](https://gizmodo.com/martin-scorsese-feels-the-power-of-the-dark-side-jumps-on-the-ai-bandwagon-2000766543), saying that the tool could be useful in pre-production storyboarding. Earlier this month, the Robert De Niro-led Tribeca Film Festival debuted a [fully AI-generated movie](https://www.vanityfair.com/story/first-fully-ai-movie-to-screen-at-a-festival-has-nearly-glitch-free-tribeca-debut?srsltid=AfmBOopwbwR2G8c1J_5vjbG6iyJDBAsa-ObceNTPOhoQdf01cS1qX8rh). Other artists, from [Reese Witherspoon](https://www.usatoday.com/story/entertainment/celebrities/2026/04/17/reese-witherspoon-ai-controversy/89657646007/) to [Steven Soderbergh](https://www.vanityfair.com/hollywood/story/steven-soderbergh-ai-in-john-lennon-documentary), have also come out in support of adopting AI into the film industry.\n\nBut on the other side, you have artists firmly against it. Director [Guillermo Del Toro](https://deadline.com/2025/10/guillermo-del-toro-would-rather-die-than-use-generative-ai-1236597071/) has said he would rather die than use generative AI in his films. Another staunch AI critic, [Seth Rogen](https://variety.com/2026/film/news/seth-rogen-ai-write-scripts-shouldnt-be-a-writer-cannes-1236751083/), not only called AI slop videos online “the most stupid dog shit I’ve ever seen in my life,” but he also said that if you use AI to write, then maybe you should not be a writer.\n\nJonze seems more okay with incorporating the technology into his practice than some of his peers, but is still worried about the impact of its wholesale acceptance.\n\n“It’s a very hungry entity, and it’s going to want to take as much as we’ll give it, and you know, there’s certain things, like collaborating with other artists, that I want to protect,” Jonze said. “I think that it’s an incredible tool, but it’s also not, and shouldn’t replace human collaboration; that’s where some electricity happens that can’t be defined.”\n\nCreating via artificial intelligence is a solo experience, Jonze said, and to be used by creative industries, the technology should prioritize evolving in a way that promotes more collaboration.\n\n“There should be like social aspects to AI that I hope, or I assume are going to come, but it needs to be on the forefront,” Jonze said. “It needs to be right up there with time and platform and engagement.”", "url": "https://wpnews.pro/news/spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design", "canonical_source": "https://gizmodo.com/spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design-2000773432", "published_at": "2026-06-19 11:45:20+00:00", "updated_at": "2026-06-19 12:09:33.846783+00:00", "lang": "en", "topics": ["ai-safety", "ai-ethics", "large-language-models", "ai-products"], "entities": ["Spike Jonze", "OpenAI", "Sam Altman", "ChatGPT", "Scarlett Johansson", "Replit", "Character.AI", "Meta"], "alternates": {"html": "https://wpnews.pro/news/spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design", "markdown": "https://wpnews.pro/news/spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design.md", "text": "https://wpnews.pro/news/spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design.txt", "jsonld": "https://wpnews.pro/news/spike-jonze-filmmaker-behind-her-warns-of-manipulative-ai-chatbot-design.jsonld"}}