this post was submitted on 05 Aug 2023
12 points (83.3% liked)

Selfhosted

40132 readers
563 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

Hello all, you all seem to be well versed in this stuff and I can't seem to find many ai or chatbot communities at all. Anyway, I've just been using the free, outdated gpt3.5 on the openai site and it really opened my eyes to how useful of a tool it is. I mean it helps me with everything, especially computer related and troubleshooting... But of course it has its flaws. Its limited in capabilities, knowledge cutoff at 2021, assuming its highly restrictive and censored as well.

I would love a solution, probably gpt4, but I entered the hugging face rabbit hole and now I'm completely lost lmao. What are some good options for someone who wants basically same functions of the free chatgpt but up to date, smarter, and just better. I'm willing to put in some work to build something, if its not too tricky. I get lost easily at this technical level. Or an out of box option is preferred. I have no clue about models other than gpt4 and I guess that's what I'm looking for or something better for either free or a lower cost than openai's $20 a month. And preferably something more private and less restrictive for the nsfw and darker questions lol

I hope this ramble makes some sense at least. I just opened my eyes to this field and its pretty deep. As of now, newb friendly,user friendly for someone with some OK tech/computing knowledge. Thanks

top 14 comments
sorted by: hot top controversial new old
[–] cal4@lemmy.world 14 points 1 year ago (1 children)

GPT4ALL sounds like your best bet. It's one of the easiest to set up solutions at the moment. As best as I can tell none of the open and local options are gpt4 level yet. that's it, there are lots of models to play with and they seem to be getting better very quickly. GPT4ALL makes it pretty simple I specifically linking the models that work and helping you download them.

the one downside is that I don't believe they have implemented GPU models yet. that means things are easy to set up, but it's going to be a slow experience, especially if you don't have a really beefy CPU and lots of RAM.

[–] borzthewolf@lemmy.world 2 points 1 year ago (1 children)

Ahh darn that probably won't work then, but I'll still give it a look. Thanks

[–] dorkian_gray@lemmy.world 1 points 1 year ago (1 children)

Nah dude, I'm seconding GPT4All. It's free and SUPER easy to set up, so there's no harm in seeing if it'll run on your system. It should; I heard someone got it running on a raspberry pi, so your system is almost definitely strong enough.

[–] borzthewolf@lemmy.world 1 points 1 year ago

Well then.... I shall check it out

[–] simple@lemm.ee 8 points 1 year ago (1 children)

Unfortunately there isn't any free/open source LLM that's as good as ChatGPT. The ones that are here like Llama 2 and Vicuna 1.5 are decent, but are pretty dumb and love spouting random incorrect info and are really unreliable. The biggest problem isn't even that, it's that hosting one yourself requires a TON of resources. The higher-end models (still not as good as ChatGPT) can need over 20gb of VRAM. For reference an RTX 4090 has 24gb vram.

You might have better luck trying alternatives to ChatGPT. I personally use Claude, it's less censored and has knowledge up to 2023.

[–] borzthewolf@lemmy.world 1 points 1 year ago (1 children)

Claude sounds perfect then. I came across the model but don't know anything. This is all brand new to me. Is Claude the same question and answer/general/all in one type of chat like gpt? And is its own platform or would it take some coding and developing and APIs and all that confusing stuff lol

[–] simple@lemm.ee 4 points 1 year ago (2 children)

Yup, claude is general-purpose and has its own website: https://claude.ai/

Unlike ChatGPT it also doesn't need a phone number.

[–] DarkDarkHouse@lemmy.sdf.org 2 points 1 year ago

I’ve been using https://perplexity.ai which requires nothing other than a prompt.

[–] borzthewolf@lemmy.world 1 points 1 year ago (1 children)

Very awesome. I haven't dove in yet, but is it its own model or does it use gpt4 or something else?

[–] simple@lemm.ee 2 points 1 year ago

It's its own model created by the company itself.

[–] burningquestion@lemmy.world 2 points 1 year ago* (last edited 1 year ago)

If you're just looking to mess around, Bard isn't half bad. Okay, it's pretty terrible, but it can do Internet searches and has a Python interpreter built in, so you can do stuff with Bard you can't do with GPT-3.5

[–] RustedSwitch@lemmy.world 2 points 1 year ago* (last edited 1 year ago) (1 children)

I’ve come across a FOSAI (free open source AI) community a few times - give it a search, there are several getting started type posts.

Non lemmy link

https://lemmy.world/c/fosai@lemmy.world

[–] borzthewolf@lemmy.world 1 points 1 year ago

Nice thanks alot

I found

pi.ai

more reliable than gpt. It seems to have data about recent events