Technology

This is just hype. The marketing hype of these models has focused a huge amount of human effort on looking for vulnerabilities that we could have found before if CTOs could have been convinced that it was worth the time and resource investment to go looking for them.

We now have an industry full of executives who believe they will be the ones held responsible if they don't quickly respond to this "new threat" and so now the engineers who should have been given the time to address technical debt and look for security issues in their products years ago, actually have the remit from the suits to do so.

Any time one of these snake-oil companies tells you that their model found hundreds of security issues in a project, just realise that what it actually did is spit out thousands of useless pages of nonsense that a team of real engineers had to check, and in checking all of the nonsense they realised that hold on a minute, yes this particular function does have a vulnerability. The AI is just giving us permission to look, by pointing its sixth finger at every other line of code.

I've been told that the majority of cyberattacks now start after a disgruntled employee sells a login to hackers. And honestly with how bad most companies are treating their employees, that sounds about fair.

I wonder if ai is enabling new attacks primarily because they allow to find vulnerabilities and coding the exploits, or because companies are using ai at their systems and putting generated insecure code into production

Many independent cybersecurity experts have told me that these models are as or nearly as skilled as elite human hackers, which is why Anthropic and OpenAI didn’t release them publicly.

Citation needed.

Here's mine:

The bugs Anthropic used to justify a $100 million consortium, eleven Fortune-100 partners, a “too dangerous to release” decision, and global headlines that “frightened the British” — an open-weights 3.6B active-parameter model finds them too, for eleven cents per million tokens.

Why does this person have enough money in a saving account that buying gold with it instead would make much of a difference in their personal wealth?

They're losing far more to inflation than they are risking being stolen by some ai chatbot.

I wish these places made it easier for us to fully delete all our accounts and data on their sites instead of having things like 30 day wait periods for account deletion which is buried under 9 layers of menu on the security dashboard or whatever, let me get my data off your service before it gets hacked. The problem is that when these tools become as easy as writing a prompt it's no longer just "hackers" it's just ordinary everyday criminals who can pull this stuff off now, all of the skill required has been removed once again with no guard rails, let's see what happens this time.

Viruses that adapt on the fly is a nightmare scenario.

"It's too late, I'm in your RAM, now, Dave."

Yeah but now you need to protect your gold. Which is not the best feeling.