LLM prices will continue to rise and they'll be stuck holding the bag
Technology
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
This is the part I’m waiting to see. My prediction; once AI providers have other companies by the nuts watch them hike prices and then we’ll hear CEO’s squealing about the unfairness of it even though they were the ones calling the shots.
It's going to be bad, too. These companies are repportedly selling tokens for 1/10 - 1/15 the actual processing costs. Companies are already spending significantly more than they would junior developers (to generate an un-revewable amount of code). Raising peices by a factor of 20 will kill the whole project dead. They'll need to hold out until there's no one left who knows how to write anymore to survive that kind of price hike.
Yup. And costs right now are rising while they're still in the "get everybody hooked" stage of things, in no small part because they can't survive at current prices. Anthropic is desperate to get to their IPO so they can have the warchest they need to actually become an established integral part of development pipelines and not just a fad.
This isn't new. Even before AI, failing companies would use layoffs as a sort of loan on their quarterly numbers. If you lay off your employees, you're really profitable for as long as you can continue collecting money for the work the employees had already done.
I don't think it is just failing companies that are doing this.
COVID fundamentally broke the relationship of cost of living to the salary of certain jobs. You don't need to pay salaries for people to live in Silicon Valley or Seattle if everyone in the department is full remote. So, if you are going to keep the job as full remote, you can base the salary on a more average cost of living and cut wages. You can use AI as an excuse for senior staff layoffs for investors, then quietly hire workers in more parts of the world with lower salaries.
Those of us around for the days when off-shoring was some kind of magic pill will remember how it wasn't. Outsourcing to some guy in Delhi, Ohio, doesn't seem so different; apart from time zone, maybe.
Ai isn't the cause for this but it certainly was the enabler.
Part of the issue with off-shoring was that a lot of the work was contracted to different companies. Nowadays, large companies own the satellite offices so they have better control over the work.
Exactly what's happening. Job postings specifically exclude larger cities now and low ball the shit out of the offer
Yep. Place I'm at is in some sort of "hiring freeze". They're not replacing people who left. They also told the many (probably not strictly legal) contractors that they won't be renewing them. It's absurd.
Same at my place. They expect AI to pick up the slack but all that's accelerating is incidents
le gasp