this post was submitted on 27 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
the question is is that still faster then system memory or not ?
It's not. If the only thing you're using the P40 for is as swap space for the 3090, then you're better off just using system RAM, since you'll have to swap via system RAM anyway.