LocalLLaMA

4 readers

4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago

MODERATORS

communick@poweruser.forum

Crowd-Sourced Computing for LLM Training (alien.top)

submitted 2 years ago by Melodic_Gur_5913@alien.top to c/localllama@poweruser.forum

1 comments fedilink hide all child comments

Hello,

Does anyone know if there are any significant efforts in distributing the computing efforts to train LLMs to different consumer GPUs spread on the internet? It seems impossible to match the computing capabilities of big tech, and it got me wondering if there was a large-scale effort to share compute for one(or more) mega-open-source project.

you are viewing a single comment's thread
view the rest of the comments

[–] FlishFlashman@alien.top 1 points 2 years ago

Someone asked something very similar in the past day, but I think it was from the angle of training as proof of work.

There is this https://petals.dev