Google just released a 1.8T model that's partially trained. Would need a ton of H100's though just to run it, forget training it lol.
Open Source is the cool kid. I hope we get stronger every day.
Google just released a 1.8T model that's partially trained. Would need a ton of H100's though just to run it, forget training it lol.