How important is local processing for you? It might be worth looking into renting a cloud server. Datacenter GPUs, like the A/H100s, have much more memory. Could be better bang for your buck if all you care about it throughput.
How important is local processing for you? It might be worth looking into renting a cloud server. Datacenter GPUs, like the A/H100s, have much more memory. Could be better bang for your buck if all you care about it throughput.