Both_Garage_1081

joined 10 months ago
sorted by: new top controversial old
Microsoft announced the Maia 100 AI Accelerator Chip. It's also expanding the use of the AMD MI300 in it's datacenters. Is this the beginning of the end of CUDA dominance? in c/localllama@poweruser.forum
[โ€“] Both_Garage_1081@alien.top 1 points 10 months ago

But what about developer support. Can they come up with a developer ecosystem that can compete with CUDA that's 20+ years old. Will developers feel comfortable switching? Dev communities takes years to build like cuda or Java. Can it be manufactured overnight?

Is there a technical reason that distributed LLMs don't exist? in c/localllama@poweruser.forum
[โ€“] Both_Garage_1081@alien.top 1 points 10 months ago (1 children)

You guys are all talking about inference but how about using distributed computing strictly for training. That alone would save developers some serious moolah assuming somebody is able to solve all the technical problems like security & privacy.