this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Oobabooga alternative (alien.top)
submitted 11 months ago by DarkSouth@alien.top to c/localllama@poweruser.forum
0 comments fedilink hide all child comments
 

Hi there,

I’ve recent tried textgen webui with ex-llama and it was blazing fast so very happy about that.

I noticed ooba doesn’t have rag functionality to pass in documents to vectorise and query.

I’m after a similar tool with the following capabilities:

  • GPU support
  • Can vectorise multiple files at once
  • windows or ubuntu support

Any help would be appreciated! Tried a few but they didn’t fit all 3 of the above.

Thanks.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here