this post was submitted on 17 Nov 2023

1 points (100.0% liked)

LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

1

What UI do you use and why? (alien.top)

submitted 1 year ago by Deadlibor@alien.top to c/localllama@poweruser.forum

57 comments fedilink hide all child comments

From the wiki:

Text generation web UI

Text Generation Inference

you are viewing a single comment's thread
view the rest of the comments

[–] wa-jonk@alien.top 1 points 1 year ago

Using Text Gen but also wanted to try PrivateGPT .. a recent change in a dependent library put private on pause. Text Gen was OK.. but had issues with a bigger model. Ran out of memory or ran really slow .. got a 3090 with 24Gb and an i9-13900k with 64 gb ram. Any recommendations on a model and settings ?