lol shut the fuck up NYT
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
I'm not a coder, so I can't speak to the quality of code generated by these models. I am a lawyer, and every time I see stuff that lay people think is impressive in my field, I can't help but guffaw and think "none of this is going to function, and no one will know for years. We're so fucked...and then one day we'll have to clean all this up and it's gonna be so much work." I kind of assume it'll be similar for code? Like...it'll obviously be somewhat better because there is a lot of testing you can actually do, whereas in law "testing" takes many years...and by the time you find out something doesn't work, the burden of having done it wrong all this time, thinking it was right is catastrophic (which is why lawyers are so conservative about language that they "know works."
I can see how little features can get added and these tools can deliver on those projects fast...but like...can they do bigger things with consistency? Can they like...set things up well? I'm not saying it's impossible, but...I guess i'm thinking about Go. It took a long time for neural networks to get to be good at 19 x 19. They got good at 9 x 9 pretty fast. But as the game gets more complicated, it's way WAY harder to do good long-term strategy. And the machines got there, no doubt. But the entire universe of Go is a 19x19 grid, on which the spaces are black or white or empty. How much more complicated is a language? Even a programming language? infinitely more complex, of course!
So I worry that we're going to have individual features that work well, but systems that cannot function...looking like the uhhh...weasley house in Harry Potter...but without the magic to hold it up lol.
I kind of assume it’ll be similar for code?
Yes.
Like…it’ll obviously be somewhat better because there is a lot of testing you can actually do
If your code can cost someone their life savings or get them maimed or killed, there's even more testing to do when using an LLM, since there's no demonstrable basis for the way the code is that it recommends.
I've been coding for a very long time. Now I'm mainly in software tech management, but I still code (proofs of concept, new visualizations, that sort of thing). In the field I'm in, we've put in a lot of effort to assess the value of large language models (LLMs) to assist in our coding. We're in a highly technical field. Because our use cases are not common, and some of our requirements are extreme, there are no good code examples to train an LLM on. Consequently, we have found that the LLM's recommendations in those cases are worthless time-wasting crap.
If you're doing something in a well-known language, in a well-known framework, with non-safety-critical requirements and with volumes, response times and reliability within moderate bounds, the training set will be much bigger and you'll probably have better luck with LLMs. But that means you could also just do a web search or look on something like StackOverflow.
We do have active machine learning (ML) efforts underway, and some of those look very promising for certain tricky problems within our domain. But ML is a whole different kettle of fish than LLMs.
Your observations on Go are regarding the size of the state space of the game, which is 19 times 19 times a few more dimensions and constraints that reflect the allowable state combinations and the transition rules from one position to the next. The 4th or 5th power of something (to be conservative) gets big really damn fast. Some problems are intrinsically intractable, and AI won't help with those, though quantum computing might in at least some cases.
The current state of LLMs is financially and environmentally unsustainable. I'm sure that in short time, additional technologies like neurosymbolic AI will prevent hallucinations and improve efficiency. But will they help AI vendors become profitable?
They AI bubble might pop or fizzle, but we'll see what developers do with their code bases when they don't have their toys at their disposal anymore.
It's good...and bad. I dunno. I asked ChatGPT to update some basic CRUD functions in client side javascript a couple days ago so that it followed a UML schematic more accurately... and it just took my entire code base and wrapped it in a single class....and that was it.
So then I was like no, here's some sample classes from the UML and here's some properties and how these methods map to these functions I wrote before, get it?
And then, yeah, it did the thing I wanted...so...cool? I mean, sure, you can call it skill issues with prompting, but man, I've been coding with this thing for some time now, and sometimes I'm just like, "I miss stack overflow man"...and shit...I never thought I'd ever say that.
Sure, coding was slower, and maybe you didn't find the thing you needed to fix your problem, but that friction taught you so much and you made friends (and enemies) as you tried to get an answer to your problem. Now we're all missing out on that and just making the AI sort of kind of not really better.
AI makes you dependent, and I'd never stake my life or wellbeing on it.
The dependency is by design. If what you do can be replicated well by AI, you need to upskill or you'll starve.
You know journalism is dead when they write an article using an LLM that is about how an industry is supposedly dying because of AI when it's actually exponentially growing because of the new capabilities of AI.
I'm willing to bet NYT has hired more Engineers than Journalists in the last few months.