this post was submitted on 08 Nov 2024
38 points (88.0% liked)
Technology
59358 readers
4869 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
"Open Source" is mostly the right term. AI isn't code, so there's no source code to open up. If you provide the dataset you trained off of, and open up the code used to train the model, that's pretty close.
Otherwise, we need to consider "open weights" and "free use" to be more accurate terms.
For example, ChatGPT 3+ in undeniably closed/proprietary. You can't download the model and run it on your own hardware. The dataset used to train it is a trade secret. You have to agree to all of OpenAI's terms to use it.
LLaMa is way more open. The dataset is largely known (though no public master copy exists). The code used to train is open source. You can download the model for local use, and train new models based off of the weights of the base model. The license allows all of this.
It's just not a 1:1 equivalent to open source software. It's basically the equivalent of royalty free media, but with big collections of conceptual weights.
Yes it is. It defines a function from input to output. It's not x86 or Arm code. It's code that runs on a different type of machine. It's a type of code that you may not be able to read, but it's still code.
Just by opening wikipedia "In computing, source code, or simply code or source, is a plain text computer program written in a programming language." So what programming language is it?
Is Maxine code "code"? And I don't mean assembler, I mean the binary stream read by the processor.
I'd say yes. People have programmed it. It's where the verb "to code" comes from.
These models are no different. They are binary streams that encode a function, a program, into a form that can be interpreted by a machine. Yes, a computer generated the code, but that's nothing new.