this post was submitted on 22 Oct 2023
4 points (100.0% liked)

Self-Hosted Main

515 readers
1 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

For Example

We welcome posts that include suggestions for good self-hosted alternatives to popular online services, how they are better, or how they give back control of your data. Also include hints and tips for less technical readers.

Useful Lists

founded 1 year ago
MODERATORS
communick@selfhosted.forum
4
8x3090 server setup (alien.top)
submitted 1 year ago by Illustrious_Twist_36@alien.top to c/main@selfhosted.forum
2 comments fedilink hide all child comments
 

Hi guys, rather weird request, but what do you think about 8x3090 build?
I think the guy used it for building https://github.com/neonbjb/tortoise-tts at home, which is quite fun!

I'm looking for the build such that I won't have bottlenecks in both vision and NLP, so fast CPU with lots of PCIE lanes is preferred, also I don't want distributed training to be a bottleneck, so advise on NVLINK as well

I don't want build to be "expensive" expensive, but rather "cheap" expensive, - maybe not SOTA CPU/memory? Something like 2-3 years old same as 3090 can be a perfect choice.

I would need 2x2000Watts power supplies for this as well? :D

top 2 comments
sorted by: hot top controversial new old
[โ€“] tomistruth@alien.top 2 points 1 year ago (1 children)

Why not rent cloud gpus?

[โ€“] Illustrious_Twist_36@alien.top 2 points 1 year ago

It's not reasonable long-term