this post was submitted on 15 Oct 2023
401 points (96.1% liked)
Linux
48069 readers
1341 users here now
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Notice how none of these replies are “AI assistant”?
"AI assistant" just seems like a euphemism for "increased tracking".
Imagine a standardized API where you provide either your own LLM running locally, your own LLM running in your server (for enthusiasts or companies), or a 3rd party LLM service over the Internet, for your optional AI assistant that you can easily disable.
Regardless of your DE, you could choose if you want an AI assistant and where you want the model to run.
Check out koboldAI and koboldassistabt projects. That's Litterally the thing you are describing and is Open source
Yeah. I'm really annoyed by this trend of having programs that could function offline require connecting to a server.
Not just hypothetically but practically too. A foss program called koboldai let's you run LLMs locally on your computer and a project that takes advantage of this is the koboldassistant project. You can essentially make your own Alexa,Cortana,Siri whatever that doesn't collect your data and belongs to you
Open source locally run LLM that runs on GPU or dedicated PCIe open hardware that doesn't touch the cloud...
What if it's a friendly purple gorilla
Would be a cool feature if it could be leveraged in a secure, private, efficient way that was more useful than 99% of the algorithmic monkey typewriter garbage that's on the market these days. I don't need a glorified Cleverbot rifling through my unspeakables.
Local LLMs are getting better at a very rapid pace. Still a bit too resource hungry to have running in the background all the time, but for example Mistral-7b is quite competent for its size.
To be fair - people don't know what they want until they get it. In 2005 people would've asked for faster flip phones, not smartphones.
I don't have much faith in current gen AI assistants actually being useful though, but the fact that no one has asked for it doesn't necessarily mean much.