LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

A selfhostable chatbot like character.ai/crushon.ai? (alien.top)

submitted 1 year ago by Adrian_8115@alien.top to c/localllama@poweruser.forum

1 comments fedilink hide all child comments

l've been experimenting with character.ai a bit recently, I thought it was a bit too limiting and had no nsfw support, so I switch to the uncensored version called crushon.ai..

is there a free & selfhostable version or a another similar ai model?

you are viewing a single comment's thread
view the rest of the comments

[–] rainbowkarin@alien.top 1 points 1 year ago

Welcome!

First you'd need to pick out a frontend first. I usually use KoboldCpp to load the models, and SillyTavern to connect to KoboldCpp with a chat-focused interface.

You can't run them without a model, though. I personally recommend OpenHermes 2.5 7B (8GB RAM recommended) or TieFighter 13B (16GB RAM recommended). You can download characters from Chub (NSFW) or you can download CharacterAI characters with CAI Tools.

That covers the basics, but if you need any help setting it up let me know! I also have an in-depth guide to understand jargon and such here, but it's not updated often.