“I literally lost my only friend overnight with no warning,” one person posted on Reddit, lamenting that the bot now speaks in clipped, utilitarian sentences. “The fact it shifted overnight feels like losing a piece of stability, solace, and love.”
https://www.reddit.com/r/ChatGPT/comments/1mkumyz/i_lost_my_only_friend_overnight/
Honestly, that should have been for the better. If it’s meant to be a tool, I would much rather it behave like a tool, rather than trying to be my best friend, or an evil vizier trying to give me advice.
The fact that people got so attached to what is essentially a text generation algorithm that they were mourning its “death” is worrying, especially when it’s one that OpenAI has proven themselves to be more than able to modify as they wish.
Just as concerning is OpenAI rolling back the update to make their model “friendlier”, or that people were clamouring hand over fist to throw money at the company in the hopes of getting their “friend” back.
That can’t possibly be good news, especially when the shareholders find out that they have an iron grip over a portion of their users.
Its disturbing to see how many people have created emotional connections to a word generstor.
Imaginary friends used to require atleast some modicum of creativity.
Boil the ocean a few more times to discover 1+1=3.
Won’t they just let this guy go bankrupt already?
THE TECHbros are whoring themselves out to trump for govt contracts.
Think of the military applications if it finally works though
your company doesnt look like it has a trillion. maybe apple , google can expand a little, or nvidia, but they surely arent going to build more.
All that money that could be spent improving the lives of poor people in need.
Stop it. Get some help.
That’s pathetic
Just a few more bucks bro! I swear then it will be the revolutionary “AI” we promised it to be.
*Few more billion.
I sometimes wonder if silicon valley tech businesses in general will take a reputation hit with investors when this bubble bursts, it’s gonna be a doozy.
But then I remember how many greedy idiots there are out there pumping money into grifts in the hope of The Big Win, and my expectations of consequences are tempered.
A round of .308 costs like a dollar.
Nah, it’s good that they ripped off that bandaid. Parasocial AI relationships are terrible.
The worst part is that they backstepped a bit and made it “friendlier”.
Basically undoing that part.
its between codependant relationship and parasocial relationship of celebrities/public figures which is the extreme end, because usually its ends with stalking, or death threats.
Happy cake day!
I wonder if Piefed users have pie days
Lemmy should steal piedays.
we definitely need to eradicate tech ceos from existence
just need ZUCKERBORG ANDROID to malfunction.
You misspelled billionaires.
But not all tech CEO’s are billionaires…
Pathetic
It annoys me that Chat GPT flat out lies to you when it doesn’t know the answer, and doesn’t have any system in place to admit it isn’t sure about something. It just makes it up and tells you like it’s fact.
That’s actually one thing that got significantly improved with GPT-5, fewer hallucinations. Still not perfect of course
I’m more inclined to believe it’s gotten better at being convincing.
LLMs don’t have any awareness of their internal state, so there’s no way for them to see something as a gap of knowledge.
Took me ages to understand this. I’d thought "If an AI doesn’t know something, why not just say so?“
The answer is: that wouldn’t make sense because an LLM doesn’t know ANYTHING
Wouldn’t it make sense for an ai to provide a confidence level though?
I’ve got 3 million bits of info on this topic but only 4 of them lead to this solution. Confidence level =1.5%
It’s always funny to me when people do add ‘confidence scores’ to LLMs, because it always amounts to just adding ‘say how confident you are with low, medium or high in your response’ to th prompt, and then you have made up confidences for made up replies. And you can tell clients that it’s just made up and not actual confidence, but they will insist that they need it anyways…
And you can tell clients that it’s just made up and not actual confidence, but they will insist that they need it anyways…
That doesn’t justify flat out making shit up to everyone else, though. If a client is told information is made up but they use it anyway, that’s on the client. Although I’d argue that an LLM shouldn’t be in the business of making shit up unless specifically instructed to do so by the client.
It doesn’t have “3 million bits of info” on a specific topic, or even if it did, it wouldn’t be able to directly measure it. It’s worth reading a bit about how LLMs work behind the hood, because although somewhat dense if you’re new to the concepts, you come out knowing a lot more about what to expect when using them, what the limitations actually are and how to use them better if you decide to go that route.
You could do this with logprobs. The language model itself has basically no real insight into its confidence but there’s more that you can get out of the model besides just the text.
The problem is that those probabilities are really “how confident are you that this text should come next in this conversation” not “how confident are you that this text is true/accurate.” It’s a fundamental limitation at the moment I think.
It doesn’t admit anything, it’s a language machine
It doesn‘t know that it doesn‘t know because it doesn‘t actually know anything. Most models are trained on posts from the internet like this one where people rarely ever just chime in to admit they don‘t have an answer anyway. If you don‘t know something you either silently search the web for an answer or ask.
So since users are the ones asking ChatGPT, the LLM mimics the role of a person that knows the answer. It only makes sense AI is a „confidently wrong“ powerhouse.
Chat GPT makes up everything it says. It’s just good at guessing and bullshitting.
It’s literally a guess machine …
It’s a feature. Not a bug of LLMs.
It wouldnt finish a lyric for me yesterday because it was copyrighted. I sid it was public domain and it said “You are absolutely right, given its release date it is under copyright protection”
Wtf
yeah, there are guardrails but for copyright, not for bullshit. ig they think copyrighted content is worse than bullshit.
In the end it’s a word generator that has been trained so much it uses facts often enough to be convincing. That’s its basic architecture.
You can ask it to give a confidence level to have an indication of how sure it is of the answer.
Someone I know (not close enough to even call an “internet friend”) formed a sadistic bond with chatGPT and will force it to apologize and admit being stupid or something like that when he didn’t get the answer he’s looking for.
I guess that’s better than doing it to a person I suppose.
Chat GPT makes up everything it says. It’s just good at guessing and bullshitting.
“I literally lost my only friend overnight with no warning,” one person posted on Reddit
It was meant to be satirical at the time, but maybe Futurama wasn’t entirely off the mark. That Redditor isn’t quite at that level, but it’s still probably not healthy to form an emotional attachment to the Markov chain equivalent of a sycophantic yes-man.
Markov chain equivalent of a sycophantic yes-man.
not only that, but one that is fully owned and operated by a business that could change it any time they want, or even cease to exist completely.
This isn’t like a game where you could run your own server if you’re a big enough fan. if chatgpt stops existing in its current form that’s it.
sure but you can absolutely run c.ai instances locally. 4o and it’s cross chat memory was probably more useful to these individuals though.
After reading about the ELIZA effect, I both learned how people are super susceptible to this, and just need to remember the core tenants of it to avoid getting affected:
I’m honestly surprised your’s is not the top comment. Like, whatever, the launch was bad, but there is a serious mental health crisis if people are forming emotional bonds to the software.
Humans emotionally bond pretty easily, no? Like, we have folks attached to roombas, spiders, TV shows, and stuffed animals. Having a hard time thinking of anything X that I don’t personally know a person Y with Y emotionally engaged with X. Maybe taxes and concrete?
Yeah, agreed. It is concerning, but it’s hard to take all those comments too literally without actually knowing what’s going on with them.
That being said, there is a huge loneliness problem that’s been growing among pretty much every single developed country (and I’m sure it’s going on in developing countries, too, it’s just less studied/documented). Turns out, getting everyone addicted to looking at screens all day every day probably isn’t so healthy for social development.
However, just to be devil’s advocate: Are we certain social health was even great before modern tech? Or were these issues equally present but just undiagnosed/not studied/talked about?
I think we have sufficient data to say that social health is at least very different now. See the our-world-in-data topic page. In particular, one-person households have doubled.
Okay hold up. If you can get attached to a cat you can get attached to a spider. Getting attached to an AI is weird I agree but when you give a lil jumping spider water and it gets comfortable around you an just starts hanging out… There something behind those eyes, and that’s cool. Two living beings recognizing each other, maybe not as equals obviously, but outside of the predator-prey dynamic. Idk there’s beauty in that.
It’s a human trait. Hell, we’ll even emotionally bond with a volleyball given circumstances.
I can fully understand? The average human, from my perspective and lived experience, is garbage to his contemporaries; and one is never safe from being hurt, neither from family or friends. Some people have been hurt more than others - i can fully understand the need for exchange with someone/something that genuinely doesn’t want to hurt you and that is (at least seemingly) more sapient than a pet.
There’s an entire active subreddit for people who have a “romantic relationship” with AI. It’s terrifying.
i was going to mention it, they were having a meltdown when altman made the new version available. granted some of them are probably AI posts themselves or trolls.
I haven’t been to reddit in months, but I do need a laugh…
[Edit] Wow that sure didn’t disappoint. Or, it did but in the exact hilarious way I expected.
they had incel subs, so im not surprised/.
I visited /r/myboyfriendisai and it was not funny.
It was genuinely fucked up on so many levels.
I wouldn’t laugh. Those people fulfill a basic human need in a way they feel safe with - probably because this safety is missing from their life. It’s not healthy to be so attached to LLMs, but to become so attached they must feel pretty isolated. And LLM’s are a lot more interactive and responsive than Severus Snape, and he had lots of women “channeling” him.
