You are right but I think a big part of Open source is being able to modify it however you like.
You can’t really modify anything here except for fine tuning without the og dataset
Slimxshadyx
joined 1 year ago
In general, you have two options:
Running the model on your graphics card, or running it using your CPU.
On your graphics card, you put the model in your VRAM, and your graphics card does the processing.
If you use your CPU, you put the model in your normal RAM and the cpu does all the processing.
The graphics card will be faster, but graphics cards are more expensive.
You can even mix the two if you can’t fit your model in your VRAM, where you put as much as possible on your VRAM and whatever left over on RAM and CPU. But this won’t be as fast as running it fully on your graphics card.
Mac has a different kind of architecture where it’s a mix of the two, and can be incredibly fast, but I haven’t used it so can’t speak too much on it.
u/faldore
Does this mean Dolphin2 coming? I’m hoping so! I love the current dolphin models
Dolphin man please!
Doesn’t this method free up context?
How do you know the start up isn’t providing value? Isn’t the whole point of making ai is to integrate it with other software/stuff?
Ai can be much more powerful than a chatbot
Wow! Exciting! Are these uncensored models or does the training data include refusals? Does anyone know? What was orca 1?
Satya already made the announcement that Sam is joining Microsoft, so it’s pretty much impossible for OpenAI board to reinstate Sam as ceo.
The board can resign but they won’t get Sam back, so I think at this point OpenAI is going to crumble and Microsoft will take in everyone
It is way too early to say nobody will switch off Chat GPT.
And all of the points you made are managerial points, which they just brought the management team from OAI in.
Especially with all this being in the news, many people believe that the company face is the driving force between product quality, and now that face is in Microsoft
Microsoft has been working with OAI on integrating GPT into products, and there has probably been a lot of technical knowledge spread back and forth.
Now Microsoft has the leadership team from OAI, as well as whatever information OAI wasn’t sharing with Microsoft before, and they can probably start transitioning away from their reliance on OAI.
Could you link me for some more info on that?
view more: next ›
Those models can’t be accessed, they say it’s “too dangerous to be released”