this post was submitted on 08 Apr 2024
69 points (84.8% liked)
Technology
59358 readers
4896 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The person I replied to was only commenting on people how much it cost for people to "refine prompts" which isn't where the problems lie. People at home on consumer hardware can't be the ones causing issues at scale, which is what I pointed out. We weren't talking about training costs at all.
Besides, the GPU clusters models are trained on are far outnumbered by non-training datacenters, which also use water for cooling. It seems weird to bring that up as an issue while not talking about the whole cloud computing industry. I've never seen any numbers on how much these GPU clusters spend versus conventional use, If you have any I'd like to see them.