platinums99

joined 10 months ago
sorted by: new top controversial old
How important is pci-e speed/gen/lanes when doing inference? in c/localllama@poweruser.forum
[–] platinums99@alien.top 1 points 10 months ago

depends on the board, seek the manual, rtfm :D

​

and if turboderp is right, it largely doenst matter.

Is there a 7B model capable to extract keywords from a text and return them as an array? in c/localllama@poweruser.forum
[–] platinums99@alien.top 1 points 10 months ago

er Javascript?

Just a heads up, if you give your AI access to your game it might try to kill you in c/localllama@poweruser.forum
[–] platinums99@alien.top 1 points 10 months ago

You're a Wizard..

Just a heads up, if you give your AI access to your game it might try to kill you in c/localllama@poweruser.forum
[–] platinums99@alien.top 1 points 10 months ago (7 children)

Are these different characters youve created. I love how they interact with each other

How did you give them control to power ship etc.?

Question about the 'economics' of running a LLM locally? in c/localllama@poweruser.forum
[–] platinums99@alien.top 1 points 10 months ago

2080ti, getting 15-30% usage per question , it has been higher on other models but the latest openhermes mistral seems effecient.

1
Same Model, different clients, different Responses - How Come? (alien.top)