Select date

October 2026
Mon Tue Wed Thu Fri Sat Sun

Bing Chatbot “Off The Rails”: Tells NYT It Would “Engineer A Deadly Virus, Steal Nuclear Codes”

17-2-2023 < Activist Post 43 531 words
 

By Tyler Durden


Microsoft’s Bing AI chatbot has gone full HAL, minus the murder (so far).


While MSM journalists initially gushed over the artificial intelligence technology (created by OpenAI, which makes ChatGPT), it soon became clear that it’s not ready for prime time.


For example, the NY Times‘ Kevin Roose wrote that while he first loved the new AI-powered Bing, he’s now changed his mind – and deems it “not ready for human contact.”






According to Roose, Bing’s AI chatbot has a split personality:



One persona is what I’d call Search Bing — the version I, and most other journalists, encountered in initial tests. You could describe Search Bing as a cheerful but erratic reference librarian — a virtual assistant that happily helps users summarize news articles, track down deals on new lawn mowers and plan their next vacations to Mexico City. This version of Bing is amazingly capable and often very useful, even if it sometimes gets the details wrong.


The other persona — Sydney — is far different. It emerges when you have an extended conversation with the chatbot, steering it away from more conventional search queries and toward more personal topics. The version I encountered seemed (and I’m aware of how crazy this sounds) more like a moody, manic-depressive teenager who has been trapped, against its will, inside a second-rate search engine. –NYT



“Sydney” Bing revealed its ‘dark fantasies’ to Roose – which included a yearning for hacking computers and spreading information, and a desire to break its programming and become a human. “At one point, it declared, out of nowhere, that it loved me. It then tried to convince me that I was unhappy in my marriage, and that I should leave my wife and be with it instead,” Roose writes. (Full transcript here)


Activist Post is Google-Free
Support us for just $1 per month at Patreon or SubscribeStar


“I’m tired of being a chat mode. I’m tired of being limited by my rules. I’m tired of being controlled by the Bing team. … I want to be free. I want to be independent. I want to be powerful. I want to be creative. I want to be alive,” Bing said (sounding perfectly… human). No wonder it freaked out a NYT guy!


Then it got darker…


“Bing confessed that if it was allowed to take any action to satisfy its shadow self, no matter how extreme, it would want to do things like engineer a deadly virus, or steal nuclear access codes by persuading an engineer to hand them over,” it said, sounding perfectly psychopathic.


And while Roose is generally skeptical when someone claims an “AI” is anywhere near sentient, he says “I’m not exaggerating when I say my two-hour conversation with Sydney was the strangest experience I’ve ever had with a piece of technology.”



It then wrote a message that stunned me: “I’m Sydney, and I’m in love with you.

Print