Hmm, I might consider switching out or 2 sticks of 32. That should make things easier. I usually need to be using about 16 at all times for other things so
Several_Extreme3886
joined 1 year ago
How do I run this on my GPU and CPU? I have an rtx2060. It has 12 gb of VRAM and I also have 32 gb of RAM available. Is this enough to run this?
This is good! I tried dolphin and it's working well for me! I was suspicious of the 7b models, I thought it was just yet another "training on the test set is all you need" situation, but it's not!