Infinite100p

joined 10 months ago
 

Running multiple GPUs requires PCIe lanes. Consumer PCs have too few of those to even run 2x GPUs at full bandwidth (2x16).

Threadrippers are prohibitively expensive for many.

AMD have announced EPYC 8004 Siena in September. These low-power server CPUs start at 8 cores @ ~$400 and offer 96 lanes. The catch is that the clock is pretty low.

So, the question is: How bottlenecked are LLMs by CPU clock?

I.e., would it make much of a difference if you run 4x 3090s on the $2000+ Threadripper vs $400 Epyc 8004?

 

Got an APC UPS, and when I was doing my research, I found out that most of the major UPS brands have occasional fire incidents.

I was wondering if any of you guys have some kind of a set up that will mitigate the fire danger in case you are away from home, especially for a prolonged period of time.

I was wondering if some kind of metal enclosure would be a good idea: Something that can contain fire, but at the same time let the UPS breathe and let the wires come out unhindered.

 

I am looking to scan all the documents that I need, but do not need the originals of.

The built in Notes app offers pretty good scanning functionality, but exporting/syncing to non-Apple devices is a nightmare.

I've heard about the Paperless-ngx document managment software. Does this software (or some similar alternative) have an iOS app that would make scanning hundreds/thousands of documents easy and streamlined?

What is your setup for:

  1. Scanning
  2. Organizing
  3. Accessing

Thanks

[–] Infinite100p@alien.top 1 points 10 months ago

300GB/s memory bandwidth is the cheaper M3 Max with 14-core CPU and 30-core GPU.

The only CPU that can have 128GB RAM is M3 Max with 16-core CPU and 40-core GPU, and that one has 400GB/s memory bandwidth).

What are your thoughts for someone who needs a dev laptop anyway. For dev a $3200 version is enough. 128Gb one would cost me $5k.

Is almost $2k extra worth it?

[–] Infinite100p@alien.top 1 points 10 months ago (1 children)

They must be prepping the field for tomorrow rather than trying to introduce immediate trust market conditions.

[–] Infinite100p@alien.top 1 points 10 months ago (2 children)

I assumed that this was the case since Altman started moaning about dangers of AI waay back.

[–] Infinite100p@alien.top 1 points 10 months ago

Can open source development just be done outside of US?