w4ldfee

joined 11 months ago
sorted by: new top controversial old
LLM Web-UI recommendations in c/localllama@poweruser.forum
[–] w4ldfee@alien.top 1 points 11 months ago (2 children)

exui by turboderp (exllamav2 creator) is a nice ui for exl2 models. https://github.com/turboderp/exui

Is there a grammarly equivalent I can run locally? in c/localllama@poweruser.forum
[–] w4ldfee@alien.top 1 points 11 months ago

fpham has a few interesting models tuned for that https://huggingface.co/FPHam

πŸΊπŸ¦β€β¬› LLM Format Comparison/Benchmark: 70B GGUF vs. EXL2 (and AWQ) in c/localllama@poweruser.forum
[–] w4ldfee@alien.top 1 points 11 months ago

i run lzlv 2.4bpw without problems. make sure to disable bos token, then it should work way better.