LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

any open source LLM you want scaled to 200 gpus I will create a tutorial for (alien.top)

submitted 10 months ago by Ok_Post_149@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

I'm trying to perfect a dev tool for python developers to easily scale their code to thousands of cloud resources using only one line of code.

I want to get some project ideas so I can build useful tutorials for running inference and fine tuning open source LLMs.

A few weeks back I created a tutorial teaching people to massively parallelize inference with Mistral-7B. I was able to deliver a ton of value to a select few people and it helped me better understand the flaws with my tool.

Anyways I want to open it up to the community before I decide what tutorials I should prioritize. Please drop any project/tutorial ideas and if you think someone's idea is good please upvote them (so I know you think it would be valuable).

you are viewing a single comment's thread
view the rest of the comments

[–] herozorro@alien.top 1 points 10 months ago

i dont understand where is this supposed to run? at a cloud provider? so this script is instlaled there, and it handles the distribution?

i read the docs for the site and i must say these questions where not answered. perhaps a 'what is burla'