Wooden-Potential2226

joined 1 year ago
sorted by: new top controversial old
Epyc CPU & motherboard from china in c/homelab@selfhosted.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Some of the other larger china sellers of refurb epycd on enay have very service ad well. One asked on own initiative which mobi the ordered ram should go in and tested before shipping - nice!

I secured Four 4TB Crucial M.2 SSDs during Black Friday. What's the best use for them? in c/homelab@selfhosted.forum
Serious inquiry: I've been tinkering a lot with finetuning and was wondering if it would be worth to buy a V100 of my own in c/localllama@poweruser.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Don’t buy the v100 at amazon.se - that price is crazy high

Overkill for starter build? in c/homelab@selfhosted.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Rack servers like the dell r720 are nice platforms for passively cooled Nvidia tesla gps’s if you’re into ai/ml…

Non-coding 34b models- anyone had much success? in c/localllama@poweruser.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Nous capybara yi-34 q6 gguf works very well for complex summarization (which requires some instruction following) of large texts. Temp=0, repeat penalty =[0.9-1.1]. Prompt: SYSTEM: USER: ASSISTANT:

LLM for organizing long transcriptions into outlines? Latest and greatest? in c/localllama@poweruser.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Yi-34-200k is trained for summarization and does it really well

Your settings are (probably) hurting your model - Why sampler settings matter in c/localllama@poweruser.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Thanks! V informative, will keep for reference👍🏼

dolphin-2.2-yi-34b released in c/localllama@poweruser.forum
[–] Wooden-Potential2226@alien.top 1 points 11 months ago

Yea, the non-tuned (base) or lightly tuned Yi versions that I’ve recently have been in need of fixes…

Converting text to JSON in c/localllama@poweruser.forum
[–] Wooden-Potential2226@alien.top 1 points 1 year ago

Check out the gron tool