Broadband-

joined 1 year ago

Your settings are (probably) hurting your model - Why sampler settings matter in c/localllama@poweruser.forum

[–] Broadband-@alien.top 1 points 11 months ago (1 children)

I've experimented with turning repetition penalty off completely and haven't noticed much of a change so far.

permalink
fedilink
source
context

🐺🐦‍⬛ LLM Comparison/Test: 2x 34B Yi (Dolphin, Nous Capybara) vs. 12x 70B, 120B, ChatGPT/GPT-4 in c/localllama@poweruser.forum

[–] Broadband-@alien.top 1 points 11 months ago

Can you share your model preset settings and if you change between each? Temp, top-p, etc. or are you using.mirostat? In that case similar settings would be useful.

Love your work!

permalink
fedilink
source

Budget Vps? in c/main@selfhosted.forum

[–] Broadband-@alien.top 1 points 1 year ago

Check RackNerd during black friday. I got a 3 core, 4.5GB Ram VPS with 100GB SSD storage and more bandwidth than I can use for like $40ish a year.

The CPU isn't the newest but it's handling cyberpanel and docker without any issues.

permalink
fedilink
source