LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

submitted 11 months ago by multiverse_fan@alien.top to c/localllama@poweruser.forum

16 comments fedilink hide all child comments

I've tried a few of these models but it was some months ago. Have y'all seen any that can hold a conversation yet?

you are viewing a single comment's thread
view the rest of the comments

[–] __SlimeQ__@alien.top 1 points 11 months ago

i did this 1.1B TinyLlama quant last week. it's not smart by any means but it can hold a conversation somewhat. and, crucially, it's 600mb