intellidumb

joined 1 year ago
[–] intellidumb@alien.top 1 points 11 months ago

Based on the releases, doesn’t look like it. https://github.com/turboderp/exllamav2/releases

[–] intellidumb@alien.top 1 points 1 year ago

This is definitely something I figured there would be more self hosted options for, but after searching around, you have a point. Those seem to be the best options and still are lacking/ unstable.

[–] intellidumb@alien.top 1 points 1 year ago (2 children)

Following responsible disclosure on July 3, 2023, the flaws were addressed in version 0.4.4 released by its maintainers IceWhale on July 14, 2023.