this post was submitted on 13 Aug 2023
343 points (74.6% liked)

Technology

59664 readers
2639 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
(page 2) 50 comments
sorted by: hot top controversial new old
[–] stu@lemmy.pit.ninja 7 points 1 year ago (1 children)

If ChatGPT only costs $700k to run per day and they have a $10b war-chest, assuming there were no other overhead/development costs, OpenAI could run ChatGPT for 39 years. I'm not saying the premise of the article is flawed, but seeing as those are the only 2 relevant data points that they presented in this (honestly poorly written) article, I'm more than a little dubious.

But, as a thought experiment, let's say there's some truth to the claim that they're burning through their stack of money in just one year. If things get too dire, Microsoft will just buy 51% or more of OpenAI (they're going to be at 49% anyway after the $10b deal), take controlling interest, and figure out a way to make it profitable.

What's most likely going to happen is OpenAI is going to continue finding ways to cut costs like caching common query responses for free users (and possibly even entire conversations, assuming they get some common follow-up responses). They'll likely iterate on their infrastructure and cut costs for running new queries. Then they'll charge enough for their APIs to start making a lot of money. Needless to say, I do not see OpenAI going bankrupt next year. I think they're going to be profitable within 5-10 years. Microsoft is not dumb and they will not let OpenAI fail.

[–] singron@lemmy.world 4 points 1 year ago

Details of the 10b aren't public, but we know it's a multi year deal, so it's possible that OpenAI doesn't actually have the full amount in cash now, and they could go bankrupt before they unlock the full amount. In the event of a bankruptcy, Microsoft could be in a position to acquire their assets for themselves on the cheap.

[–] mycroftholmess@lemm.ee 4 points 1 year ago

It's definitely become a part of a lot of people's workflows. I don't think OpenAI can die. But the need of the hour is to find a way to improve efficiency multifold. This will make it cheaper, more powerful and more accessible

[–] tonytins@pawb.social 4 points 1 year ago

The thing about all GPT models is that they’re based on the frequency of the word to determine its usage. Which means the only way to get good results is if it's running on cutting edge equipment designed specifically for that job, while being almost a TB in size. Meanwhile, Diffusion models are only GB and run on the GPU but still produce masterpieces because they already know what that word is associated with.

[–] Anamana@feddit.de 3 points 1 year ago

Would help if they would offer more payment options than just credit card, which is not really popular in many countries

[–] MaxPow3r11@lemmy.world 2 points 1 year ago
[–] ThomasHansen@infosec.pub 2 points 11 months ago

The development of ChatGPT makes it even more comfortable for users. From there, more and more free chatgpt are born for new users to experience

[–] EnderMB@lemmy.world 2 points 1 year ago (1 children)

LLM's are pricey to train and evaluate, much more so than compositional models.

But no, OpenAI aren't going bust due to this. Given that they have the most successful LLM on the market, it's safe to say that they probably know how much they cost, and can calculate roughly how much their yearly spend will be.

load more comments (1 replies)
[–] IsmaelAlvesRodrigues@infosec.pub 2 points 11 months ago

ChatGPT development, I feel it is completely possible

load more comments
view more: ‹ prev next ›