LocalLLaMA

1 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago

MODERATORS

communick@poweruser.forum

any open source LLM you want scaled to 200 gpus I will create a tutorial for (alien.top)

submitted 10 months ago by Ok_Post_149@alien.top to c/localllama@poweruser.forum

6 comments fedilink hide all child comments

I'm trying to perfect a dev tool for python developers to easily scale their code to thousands of cloud resources using only one line of code.

I want to get some project ideas so I can build useful tutorials for running inference and fine tuning open source LLMs.

A few weeks back I created a tutorial teaching people to massively parallelize inference with Mistral-7B. I was able to deliver a ton of value to a select few people and it helped me better understand the flaws with my tool.

Anyways I want to open it up to the community before I decide what tutorials I should prioritize. Please drop any project/tutorial ideas and if you think someone's idea is good please upvote them (so I know you think it would be valuable).

you are viewing a single comment's thread
view the rest of the comments

[–] divedave@alien.top 1 points 10 months ago

I don't code but I've been working with the apis (oobabooga/text-generation-webui) using chatgpt for coding, for text I have no problems but for images it's been a big struggle for me. So for your tutorial (and as a clue for me), maybe a script that takes screenshots periodically and describes what it sees, could be a desktop screenshot or a camera feed or something, using a llava model.