this post was submitted on 01 Nov 2023
1 points (100.0% liked)
LocalLLaMA
1 readers
1 users here now
Community to discuss about Llama, the family of large language models created by Meta AI.
founded 10 months ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Trying to get a better understanding of how prompts work in relation to fine-tunes, and trying to see if any of them are actually reliable enough to be used in a "production" type environment.
My end goals are basically
A lot of it comes down to just wanting to learn, but a big piece of it is that I have consistency, stability and privacy when running an LLM at home.
As for how I run it? Ho ho ho... a bit overkill, since as a developer I have a lot of hardware available to me.
I usually connect the mistral to Continue.Dev in Visual Studio code.
Literally such a cool written post. But boy your gear is so much pricier than a chatgpt subscription.
tax deductible if you use your imagination
and you get to play with gear you already wanted
and you get experience for super high paying jobs
just comes down to fitting it within your budget to begin with
to tax deduct anything you have to earn. and most users here are students ( undergrads/phd's/ masters) that make less to deduct 10k in pc hardware.
Best way is to ask your program "( phd) for sponsoring, or if undergrad to apply to scholarships