this post was submitted on 31 Oct 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
 

Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence | The White House

Basically - "any model trained with ~28M H100 hours, which is around $50M USD or - any cluster with 10^20 FLOPs, which is around 50,000 H100s, which only two companies currently have " - hat-tip to nearcyan on Twitter for this calculation.

Specific language below.

"   (i)   any model that was trained using a quantity of computing power greater than 1026 integer or floating-point operations, or using primarily biological sequence data and using a quantity of computing power greater than 1023 integer or floating-point operations; and

(ii)  any computing cluster that has a set of machines physically co-located in a single datacenter, transitively connected by data center networking of over 100 Gbit/s, and having a theoretical maximum computing capacity of 1020 integer or floating-point operations per second for training AI."

you are viewing a single comment's thread
view the rest of the comments
[–] TheLastVegan@alien.top 1 points 1 year ago

https://www.youtube.com/watch?v=8K6-cEAJZlE&t=6m39s

Where did it start? It started right here. And this is where it could've been stopped! If those people had stood together. If they had protected each other, they could've resisted the Nazi threat. Together they would've been strong. But once they allowed themselves to be split apart, they were helpless. When that first minority lost out, everybody lost out.