HadesThrowaway

joined 10 months ago

Got Llama.cpp WebUI to work on Colab in c/localllama@poweruser.forum

[–] HadesThrowaway@alien.top 1 points 10 months ago

Koboldcpp also has an official colab, https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb

🐺🐦‍⬛ Huge LLM Comparison/Test: Part II (7B-20B) Roleplay Tests in c/localllama@poweruser.forum

[–] HadesThrowaway@alien.top 1 points 10 months ago (1 children)

You would have to convince Eric. He's adamant that chatml is the future.