LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

PSA: With Nvidia driver 564.01 it's now possible to disable swapping into system ram when VRAM is exhausted. (alien.top)

submitted 1 year ago by dampflokfreund@alien.top to c/localllama@poweruser.forum

2 comments fedilink hide all child comments

This will make people, who reverted to older drivers because they suffered from lower performance due to ram swapping, happy. If you follow this simple guide: https://nvidia.custhelp.com/app/answers/detail/a_id/5490 the old memory management will return, where it just crashes instead of slowing down

Personally I prefer the new memory management, but I'm glad the option is there now for people who don't. Thank you Nvidia for listening! :D

top 2 comments

sorted by: hot top controversial new old

[–] a_beautiful_rhind@alien.top 1 points 1 year ago

Wasn't sure if it affected linux so I didn't upgrade. I guess I will when this version is released.

[–] pr1vacyn0eb@alien.top 1 points 1 year ago

This might explain my AI art problems.