this post was submitted on 05 Nov 2024
290 points (95.3% liked)
Technology
59135 readers
2588 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
OpenWebUI? pretty easy to selfhost and works wonders on my rtx a6000
OpenWebUI says it's designed to operate entirely offline - that's not an alternative to Perplexity. I need online search functionality, that's pretty much the only reason why I pay them. I have offline solutions set up on my pc.
oh, sorry. never used perplexity so i didnt know. if you find a viable alternative tell me pls
OWui has a search module which can be enabled. For me, running it entirely offline is more or less the draw. I think it also supports RAG search, although I don't know how "good" it is.. mostly I was just after a little magic box to play with.
Now, if only enterprise glass GPU's weren't so power hungry and expensive..