Lol, no worries, this is the part where I'm out of my league, but I'm pulling it together. I got this one:
Mini-itx form factor but you get all that juicy PCIe exposed for accelerators. I think we even got the same CPU, but I could only afford 256gb DDR4. Kitting it out with the full 2TB is going to be exhausting! And also I need more GPUs.
Bro, lol, I'm building a similar system, but I'm gonna need ChatGPT to translate some of that for me
If you want 16gb check out the A4000. They're usually not that expensive and better cores
This guy gets it
Lol, sounds rough. 3B is better than no B. And that should mean I can have several models up at once
Don't look at that man behind the curtain!
I think the future is modular. Many small machines contributing to hosting a bigger model.
That way if you need to upgrade the capacity of your system you can just add another compute node