Many (most?) classes of bugs involve the developer having the wrong mental image of what’s going on under the abstraction they’re working with. Seems to me like writing code by prompting an AI might be the ultimate invitation to this.
but the “ai” isn’t writing anything. It’s making a statistical pastiche.
It’s the code equivalent of word salad and only gets the simplest of use cases only mostly correct and only then because it’s regurgitating chunks of other people’s code…
We need to stoping talking about these LLMs as though there’s any intent or design behind what they do. It’s not helpful or backed up by what these system actually do — it’s the fetishization of a SciFi trope.
Hacker Memes
in reply to Wesley McGrew • • •looking forward to using AI to find vulnerabilities in AI code.
Let the war games begin
silverwizard
in reply to Hacker Memes • •Wesley McGrew
in reply to Wesley McGrew • • •silverwizard likes this.
Dave Spector
in reply to Wesley McGrew • • •but the “ai” isn’t writing anything. It’s making a statistical pastiche.
It’s the code equivalent of word salad and only gets the simplest of use cases only mostly correct and only then because it’s regurgitating chunks of other people’s code…
We need to stoping talking about these LLMs as though there’s any intent or design behind what they do. It’s not helpful or backed up by what these system actually do — it’s the fetishization of a SciFi trope.
silverwizard
in reply to Dave Spector • •