JOAQUIN PHOENIX in a scene from the 2013 movie Her.

HER. That was that OpenAI Chief Executive Officer Sam Altman posted as his lieutenants demoed a new ChatGPT with the same alluring vocal flourishes Scarlett Johansson used in the movie about a man who falls in love with his AI.

The most impressive thing about the new GPT-4o (the “o” stands for “omni”) is that it can discuss what it “sees” through your phone camera in real time, a skill that in a demo for its AI model last December. More startling was that it didn’t just sound human but … .

“Hey there,” the new version of ChatGPT said in a coy woman’s voice to a young man in the . “I see you’re rocking an OpenAI hoodie. Nice choice.”

In a live demo at OpenAI’s headquarters in San Francisco, the AI system surprised the audience when it suddenly said, “Wow, that’s quite the outfit you’ve got on,” to someone it was helping with an algebra problem. Bloomberg News, which was at the event, as “flٲپdzܲ.”

In another video demo, the AI, once again with a female voice, laughed coquettishly as an OpenAI staffer pretended to ask it for advice on what to wear for an interview. “Oh, Rocky!” it said giggling after he put on a silly hat. “That’s quite a statement piece!”

If OpenAI’s mostly male engineers are trying to build the perfect girlfriend, they seem to be on the right track. If the company is trying to build a more accurate and reliable AI model, however, they still have a ways to go. GPT-4o is still only slightly ahead on key AI benchmarks, and show it on key tasks.

The company has instead focused on leaping ahead with user experience, making GPT-4o more of a consumer play than one for enterprise customers. Its new model can infer emotions and respond to audio as quickly as a human would in conversation. That could fulfil a long-time goal in tech of “ambient computing,” which eschews having to stare into tiny screen and type with your thumbs for just talking and showing things to a computer.

There’s plenty of potential in that, from live tutoring to having a clever digital assistant analyze your computer screen as you work. But OpenAI’s efforts to make its AI so engaging are disconcerting.

What are the social and psychological consequences of regularly speaking to a flirty, fun, and ultimately agreeable artificial voice on your phone, and then encountering a very different dynamic with men and women in real life? What happens when emotionally vulnerable people develop an unhealthy attachment to GPT-4o?

OpenAI did not respond to these questions at the time of writing, or explain why it had given GPT-4o so much more personality. If its objective was to make its product more engaging with consumers — as it has — that could open a can of worms, threatening insidious effects on our collective mental health. Remember those priorities are what led Facebook to design algorithms that promoted the on its site to keep people scrolling, helping sow greater political division.

Yet you can see why Altman may be pushing to make his chatbot more sticky. User growth for ChatGPT , as competing bots like Anthropic’s Claude and Google’s Gemini race for market share. It’s likely why he’s also making GPT-4, OpenAI’s most advanced model on the market, .

OpenAI didn’t describe GPT-4o as a “personal assistant,” but that seems to be what the company and its rivals are now chasing. Google is expected to announce a similar tool on Tuesday.*

Elon Musk’s AI company x.AI is also working on an app that will act as a personal assistant, according to an April 2024 funding pitch deck seen by Bloomberg Opinion. The $20-a-month app, which will also have a free tier, aims to show an AI-generated feed of suggested news articles and reminders to, for instance, buy flowers at a nearby store for a friend’s birthday, or to buy concert tickets for a favorite band that is on tour, according to one slide. The deck adds that by integrating with personal data from X, it can create a “supercharged social experience.” Musk that a “major upgrade to Grok” was on its way.

Meta is also with cameras, and its Ray-Ban smart glasses .

As the tech giants converge on digital assistants, they may see personality as the new AI battleground. But racing to make chatbots more could have bizarre side effects. Pointing to Her was perhaps a fitting metaphor for Sam Altman: The movie doesn’t end well for humans.

BLOOMBERG OPINION

*One Google executive of his phone camera on Monday, pointing to a conference stage, with a disembodied female voice describing what it could “see.”