this post was submitted on 19 Jul 2026
275 points (88.7% liked)

Technology

86628 readers
3928 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] Postmortal_Pop@lemmy.world 10 points 6 days ago (2 children)

Not an AI guy, but I do like using niche hardware wrong to get results cheap. Can anyone tell me what this would be like for gaming or general computing? My 1660 super was a budget pick when I got it back in '18.

[–] tinfoilhat@lemmy.ml 4 points 6 days ago (1 children)

A lot of data center GPUs don't have display outputs or cooling. So you would need to figure out how to cool them.

[–] Postmortal_Pop@lemmy.world 1 points 4 days ago

Cooling wouldn't be too hard, I'm currently overengineering an Xbox 360 for that so I've done a good deal of learning. Getting of to display video is outside my skillset though.

[–] Flatfire@lemmy.ca 3 points 6 days ago (1 children)

A cursory search says somewhere between a 3060 and 4060, which seems about right. Games that parallelize well across the GPU cores will benefit, though that benefit will be niche if it exists at all. HBM2 memory is weird for gaming.

You'd see some benefit for sure, but this really is better suited to parallel computing, given the emphasis on CUDA core counts and memory bandwidth. You may also find you run into some latency, since it requires selecting the V100 as your primary GPU but a secondary card as the video output. Integrated GPUs work well for this, since your motherboard may already have this ability. Otherwise, you could use it in tandem with a 1030 or similar to get display out.

[–] Postmortal_Pop@lemmy.world 1 points 4 days ago (1 children)

So I'm picking up that it's not a viable alternative for the desperate?

[–] Flatfire@lemmy.ca 2 points 4 days ago

Probably not your best option, no

[–] mierdabird@lemmy.dbzer0.com 90 points 1 week ago* (last edited 1 week ago) (3 children)

The article talks a lot trash about AMD and ROCm but vulkan works fine too. In fact from a datacenter GPU standpoint there is an AMD option called the V620 available on US EBay that I was able to haggle to $350, with 32GB VRAM, 512GB/s bandwidth, and runs the same Qwen-3.6-27b at about 20t/s. I would argue that's even more cost effective.
It requires a few of the same fan shenanigans this guy did but there is no need to pull specific past software versions to make it usable in Linux

load more comments (3 replies)
[–] palordrolap@fedia.io 60 points 1 week ago (4 children)

Here I was expecting a graphics demo to blow our collective minds but instead I got a story about a local LLM for cheap. It is . I should have known better.

Were I the author / tech cobbler here, I'd be concerned that too much time with an LLM, local or otherwise, might erode or dull my apparently fairly sharp reasoning and tech skills. (Clarification: Not my sharpness, theirs. I'm a potato.)

Other thoughts: For a minute I thought this whole thing was a tribute to, or a troll in the manner of, that one Redditor that always spun their stories around to being about their dad beating them with jumper cables.

Also, my old PC developed an issue like the warm reboot problem, except with the network interface. I couldn't just restart, I had to power off and back on. I never did bother to find out whether it was early signs of hardware failure or whether it was an old hardware / newer kernel mismatch.

[–] axmo@lemmy.ca 2 points 6 days ago

RogerSimon10! (The jumper cables guy)

Unless maybe he was the similar but later hell-in-a-cell guy? I don’t remember anymore.

load more comments (3 replies)
[–] melfie@lemmy.zip 25 points 1 week ago (4 children)

Seems like an awful lot of trouble to save $100 not buying a 5060 Ti that also has 16GB.

[–] Hubi@feddit.org 2 points 6 days ago

The 5060 Ti does not support Nvlink though.

[–] ranzispa@mander.xyz 23 points 1 week ago (1 children)

448 GB/s memory vs 900 GB/s and at a cheaper price.

load more comments (1 replies)
load more comments (2 replies)
load more comments
view more: next ›