this post was submitted on 23 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The Mi25 is even faster at 24 TFLOPS for FP16. It's only $70-$90. You can get 2 for the price of one P100. And you can activate the mini-DP port on it for video with a BIOS flash. So you can use it to game with.
Mi25 is also an option, but a lot of programs are a lot more optimized for CUDA devices