AnOnlineHandle

joined 1 year ago
[โ€“] AnOnlineHandle@alien.top 1 points 11 months ago (10 children)

What sort of vram is needed to run a 4bit 70B model?

I've tried training LoRas on my own writing with mixed success.