By Parmy Olson
WHEN you’re building artificial intelligence (AI) to benefit humanity, you might have to compromise. AI is expensive, so you from investors like Microsoft Corp., Nvidia Corp., and the United Arab Emirates. As you strive to build super-intelligent computers that will cure cancer, you also need to make money for your backers. So, after pitching your powerful chatbot technology to businesses, your next option may be monetizing your enormous user base of 800 million weekly visitors — with a sex bot.
That’s the ignoble trajectory of OpenAI under Sam Altman, who’s made a career of justifying opportunistic business moves — like inflating the AI bubble with or — with the promise that his tech will eventually, one day, solve intractable human problems. There’s little evidence that OpenAI’s systems will do that, but in the short term it can make some money, especially with erotic roleplay.
This December, ChatGPT will be imbued with more personality and the ability to engage in “erotica” with verified adult users, Altman brazenly announced on X. The news was met with some repulsion on X but celebrated on Reddit, where many ChatGPT users have spent the last two years sharing tricks for jailbreaking the bot to sext with it.
OpenAI has batted off criticism that its bot causes mental health problems and dependency, and was by the parents of a teenage boy who followed instructions on the bot . Altman said, with no further explanation, that those mental health risks had now been “mitigated” and it would relax ChatGPT’s restrictions “in most cases.”
Chatbot romance was around for years before Altman brought ChatGPT to the world in November 2022, and it’s a confirmed money maker. Replika launched in 2017 as a friendship bot — until most of its users started treating it like a virtual girlfriend or boyfriend and its growth soared. Elon Musk’s Grok, a chatbot made by his company xAI, counts two hyper-sexualized manga characters .
Ads for AI girlfriends have Facebook and Instagram, and a by academics from Oxford and Cambridge Universities found that the 110 most popular AI companion apps were “ around heterosexual male fantasies.” In aggregate, those dating-themed AI chatbots captured 88 million monthly visits globally (more than the 75.8 million visits that social media platform Bluesky gets), a conservative estimate that didn’t include popular, general-purpose companion apps like Character.ai. (Character.ai, which had around 20 million monthly users earlier this year, had also been heavily used for sexual role-play up until the company recently put new restrictions in place.)
The makers of ChatGPT will have noticed this phenomenon. Roughly 30% of the prompts being typed into general purpose AI assistants including ChatGPT are romantic or sexual in nature, according to Lauren Kunze, chief executive officer of San Francisco-based AI chatbot company ICONIQ.
What’s with the appeal? Kunze, who’s been in the chatbot space for 20 years and recently launched a called Celeste, suggests there might be an evolutionary drive in humans to evaluate any seemingly sentient being as a potential mate. And historically, porn has driven mainstream tech adoption.
“The consumer demand is overwhelmingly there,” she says. Chatbot companies that don’t allow pornographic content often find it harder to stay in business. When Replika banned sexual roleplay in February 2023, its user numbers dropped from the single-digit millions to the hundreds of thousands. Character.ai also saw a usage drop when it did the same earlier this year.
Altman himself seems to have tried to resist all this. Here’s him on two months ago (and the specific ):
Altman: There’s a lot of short-term stuff we could do that would, like, really like juice growth or revenue or whatever and be very misaligned with [our] long-term goal… Sometimes we do get tempted.
Abram: Are there specific examples that come to mind?
Altman: Well, we haven’t put a sexbot avatar in ChatGPT yet.
Abram: That does seem like it would get time spent.
Altman: Apparently it does.
“Time spent” is a metric used by social media developers to gauge the stickiness of an app. OpenAI’s pivot to erotica points to an uncomfortable truth about the state of AI today — that for all its promise to transform industries and uplift civilization, the easiest way to commercialize it is still through the basest human instincts. Altman’s vigorous dealmaking has left him with few qualms about chasing them.
BLOOMBERG OPINION
