Yes I also hope it get's exllamav2 support, here is a issue regarding it: (Qwen model not supported) · Issue #160 · turboderp/exllamav2 (github.com)
Qwen 72b is comming in 2 days 👍 Will be a real beast.
Yes I also hope it get's exllamav2 support, here is a issue regarding it: (Qwen model not supported) · Issue #160 · turboderp/exllamav2 (github.com)