self-help manual

All off topic discussions go here. Everything from the funny thing your cat did to your favorite tv shows. Non-programming computer questions are ok too.
nexos
Member
Member
Posts: 1100
Joined: Tue Feb 18, 2020 3:29 pm
Libera.chat IRC: nexos

Re: self-help manual

Post by nexos »

I'm gonna be completely honest, and I don't mean this as condescending, but rather with genuine concern as a moderator of this forum. It appears as if you may be tending towards the line of AI psychosis. Not saying you are there as I don't think that, but I see the tendencies that head in that direction. To an outside observer, thinking that an AI has solved the trolley problem with engineering principles sounds absurd. However, because you've entered the LLM echo chamber, it ends up sounding more reasonable than it is. Commercial LLMs have safeguards for reasons, that being that LLMs tend to conflate principles too easily and create odd lines of reasoning that sound good until you stop to think about it. Then they convince the user they have ground-breaking new ideas, when in reality the output makes no sense.

My suggestion would be to step back from the LLMs for a little bit. Don't even touch it for a week or so. Step back from whatever the AI has come up with. And then when you come back, you might have a different perspective on what your AI has come up with.
"How did you do this?"
"It's very simple — you read the protocol and write the code." - Bill Joy
Projects: NexNix | libnex | nnpkg
Octocontrabass
Member
Member
Posts: 6301
Joined: Mon Mar 25, 2013 7:01 pm

Re: self-help manual

Post by Octocontrabass »

kerravon wrote: ↑Fri Nov 13, 2026 9:48 pmI don't remember explicitly stating such a thing. Precisely because I don't want to be trapped into having defending anything other than "women have the right to not be raped". I added a TENTATIVE 1.5 "all men are created equal", to provide a GUIDE that OTHERS think is useful.
Why would you be trapped?
kerravon wrote: ↑Fri Nov 13, 2026 9:48 pm
I take the time to research and write my own posts. Using a LLM to write your reply shows that you think it isn't worth your time to do the same.
That's false.
Your intentions don't change how your actions are perceived.
kerravon wrote: ↑Fri Nov 13, 2026 9:48 pmIt SHOULD look like "wow - that's a very sophisticated tool use - amazing!".
It looks like you might not understand how LLMs work. Reminds me a bit of this, actually...
kerravon wrote: ↑Fri Nov 13, 2026 9:48 pmI used the LLM as a substitute for having a panel of evolutionary biologists, philosophers etc etc on hand to answer my questions.
How do you know the LLM is giving you the correct answers? Would you be able to tell if it gave you the wrong answer?
kerravon wrote: ↑Fri Nov 13, 2026 9:48 pmI have no idea what you are talking about here. I don't think that "AI bros" treat women as anything at all.
They certainly don't treat women as people.
User avatar
Solar
Member
Member
Posts: 7635
Joined: Thu Nov 16, 2006 12:01 pm
Location: Germany
Contact:

Re: self-help manual

Post by Solar »

Octocontrabass wrote: ↑Mon Nov 16, 2026 7:03 pm
kerravon wrote: ↑Fri Nov 13, 2026 9:48 pmI used the LLM as a substitute for having a panel of evolutionary biologists, philosophers etc etc on hand to answer my questions.
How do you know the LLM is giving you the correct answers? Would you be able to tell if it gave you the wrong answer?
Worse. A panel of scientists would be geared toward pointing out any problems with your work. A LLM is, first and foremost, geared toward giving the answer it guesses you want to hear.
Every good solution is obvious once you've found it.
User avatar
Demindiro
Member
Member
Posts: 167
Joined: Fri Jun 11, 2021 6:02 am
Libera.chat IRC: demindiro
Location: Belgium
Contact:

Re: self-help manual

Post by Demindiro »

nexos wrote: ↑Sun Nov 15, 2026 9:43 am It appears as if you may be tending towards the line of AI psychosis.
What surprised me the most about the LLM craze is how easily influenced people are by mere words. I now understand why advertising is such a huge industry.

I don't believe that LLMs by themselves are dangerous (and all the recent vulnerabilities being exposed is simply massive tech debt being forcibly brought to the surface) and I have no reason to believe they will achieve "general intelligence" or that "models editing weights" is meaningful. However, I am worried it is going to be weaponized to manipulate large chunks of the population into committing nefarious acts. I don't believe "AI safety" will be effective in addressing this as even small models that can easily be hosted locally seem sufficient for this purpose. (Heck, I can even run Deepseek-V4-Flash locally with just a fast SSD. It is slow but not so slow as to be unusable.)
GeneSYS exokernel (Codeberg)
Lemmings! micro-/multikernel (Github, Codeberg)
Waddle container tool (Codeberg)
Post Reply