AI dedicated boards already exist, and Nvidia can't produce them fast enough to keep up with demand.
Source: A senior AI engineer at AWS told me.
this post was submitted on 18 Oct 2023
3 points (80.0% liked)
PC Gaming
8256 readers
773 users here now
For PC gaming news and discussion. PCGamingWiki
Rules:
- Be Respectful.
- No Spam or Porn.
- No Advertising.
- No Memes.
- No Tech Support.
- No questions about buying/building computers.
- No game suggestions, friend requests, surveys, or begging.
- No Let's Plays, streams, highlight reels/montages, random videos or shorts.
- No off-topic posts/comments.
- Use the original source, no clickbait titles, no duplicates. (Submissions should be from the original source if possible, unless from paywalled or non-english sources. If the title is clickbait or lacks context you may lightly edit the title.)
founded 1 year ago
MODERATORS
This just sounds like putting a second CPU on a PCIe board. I can't see this being a benefit for games because developers would never go through the pain of programming AI with advanced enough behaviours to even need a secondary CPU.
Why wouldn't they? It's a lot easier to write out intricate backstories for each character/location independently than it is to build decision trees for every possible combination of decisions that the player makes. That's basically what current LLMs allow for.
Programming AI is actually super easy, unless you decided to create your own foundation model. Even then, you would have data scientists building it, not devs.
Plenty of FMs and LLMs already exist that would be up to the task.
Programming AI with behaviour complex enough to need a second CPU would be hard. Syncing its output with the primary CPU could be a problem.
LLMs would not be useful for anything except maybe generating new dialogue, but it would need a lot of restraints to prevent the end user from breaking it. For the purposes of dialogue and story telling, most developers would opt to just pre-program dialogue like they always have.
Again, this sounds like a useless PC part that pretty much no game developer would ever take advantage of.
You don't need an LLM for this. You just need a FM that you fine tune, and you'd be surprised at how little computing power is actually required.
For our uses (which are similar to what OP wants), it takes longer for us to do an OCR scan on the documents our AI works with than for Sagemaker to do it's thing on a rather small instance.
And, devs would just be implementing API calls, so it wouldn't be a big deal to make the switch.
If the board provided enough benefit to outweigh the cost? Sure I might be talked into it.
Reminiscent of PhysX boards when they were a thing for 30 seconds. It’s all about the return on investment for me.
Game publishers won't want direct ai in games, losses them too much control, also they can't use the excuse of its always online so NPCs have ai powered language. With how things look as everything is becoming subscription I doubt well be getting powerful ai on a single board to put into pci-e my prediction is more Aline to we won't have gaming PCs, GPUs will be price hiked and anyone wanting to game will be on a subscription service
Yeah, so, dedicated hardware like that rarely ever pans out. I mean, graphics cards did, but there's not much of a market for gaming sound cards or physX cards anymore. I imagine that the specific type of AI that will be useful for this will eventually just be improved and made efficient enough that it'll be done by processors that already exist in your system.
Yeah, like GPUs, which is basically what most LLMs are designed to run on now.
Wouldn't that just be a GPU? That's literally what all our AIs run on. Just a ton of tiny little processors running in parallel.
That kind of like saying "Wouldn't that just be a CPU?" about the GPU. It can be optimized. The question is if it's worth optimizing for on a consumer level, like GPUs were.
While that is true now, in the future maybe there will be discrete hardware AI accelerators in the same way we have hardware video encoding.
Have you not seen the size of modern GPU's? It'll just be another chip on the 3.5 slot 600w CPU.
They already exist.
They're meaning something more along the lines of an ASIC. A board specifically engineered for AI/ML.
I mean, that kind of board has existed for a while. They're usually called AI-accelerator boards, IIRC
Yup. Nvidia can't make em fast enough to keep up with demand.
If this were to ever become mainstream this would likely be incorporated into the GPU for cost reasons. Small machine learning acceleration boards already exist but their uses are limited because of limited memory. Google has larger ones available but they're cloud only.
Currently I don't see many uses in gaming other than upscaling.
Is the 1995 and first 3d accurate? we were using 3d CAD tools in the range of 1991-1995 before Nvidia. Edit: seems S3 and Creative Labs had some earlier CAD cards, prices too high for general PC use till voodoo cards in 95