this post was submitted on 13 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Is there a technical reason that distributed LLMs don't exist? (alien.top)
submitted 1 year ago by chinawcswing@alien.top to c/localllama@poweruser.forum
31 comments fedilink hide all child comments
 

Why is there no analog to napster/bittorent/bitcoin with LLMs?

Is there a technical reason that there is not some kind of open source LLM that we can all install on our local host which contributes computing power to answering prompts, and rewards those who contribute computing power by allowing them to enter more prompts?

Obviously, there must be a technical reason which prevents distributed LLMs or else it would have already been created by now.

you are viewing a single comment's thread
view the rest of the comments
[–] remghoost7@alien.top 1 points 1 year ago (12 children)

It actually does exist.

It's called Petals.

I believe it was made to run Bloom 176B.

[–] PookaMacPhellimen@alien.top 1 points 1 year ago (10 children)

Why does no one use it?

load more comments (9 replies)
load more comments (10 replies)