NorthCryptographer39

joined 1 year ago
[–] NorthCryptographer39@alien.top 1 points 11 months ago (1 children)

Are you on x99 platform

 

Hi all, today Nvidia released a new driver version that appears to allow the GPU to use system memory instead of crashing when it runs out, seen here: https://nvidia.custhelp.com/app/answers/detail/a_id/5490/~/system-memory-fallback-for-stable-diffusion

I was wondering if this is compatible with LLM, and how I could enable that (or if it would just work by default).