areyouevenreal

I don't think anti-tankies can be blamed when said tankies regularly engage in brigading of other instances. Like if everyone actually behaved this wouldn't have been an issue.

Terminal velocity depends on the drag profile and weight of an object. So it actually depends what shape the vehicle is and it's mass.

Did back propagation even exist in the 60s? That was a pretty fundamental change in what they do.

If we are arguing about really fundamental changes then arguably any neural network is the same and humans are the same as ChatGPT or a mouse, or even something simpler like a single layer perceptron.

I know, I have used them. It's actually my job to do research with those kinds of models. They aren't nearly as powerful as current OpenAI's GPT-4o or their latest models.

I think he's talking about people using LLMs for illegal and unethical activities such as fishing. There are already a lot of people using LLMs that are open source without ethics restrictions to do bad stuff, with the power of GPT4 behind them they would be a lot more effective.

That's not true though. The models themselves are hella intensive to train. We already have open source programs to run LLMs at home, but they are limited to smaller open-weights models. Having a full ChatGPT model that can be run by any service provider or home server enthusiast would be a boon. It would certainly make my research more effective.

There is a lot that can be discussed in a philosophical debate. However, any 8 years old would be able to count how many letters are in a word. LLMs can’t reliably do that by virtue of how they work. This suggests me that it’s not just a model/training difference. Also evolution over million of years improved the “hardware” and the genetic material. Neither of this is compares to computing power or amount of data which is used to train LLMs.

Actually humans have more computing power than is required to run an LLM. You have this backwards. LLMs are comparably a lot more efficient given how little computing power they need to run by comparison. Human brains as a piece of hardware are insanely high performance and energy efficient. I mean they include their own internal combustion engines and maintenance and security crew for fuck's sake. Give me a human built computer that has that.

Anyway, time will tell. Personally I think it’s possible to reach a general AI eventually, I simply don’t think the LLMs approach is the one leading there.

I agree here. I do think though that LLMs are closer than you think. They do in fact have both attention and working memory, which is a large step forward. The fact they can only process one medium (only text) is a serious limitation though. Presumably a general purpose AI would ideally have the ability to process visual input, auditory input, text, and some other stuff like various sensor types. There are other model types though, some of which take in multi-modal input to make decisions like a self-driving car.

I think a lot of people romanticize what humans are capable of while dismissing what machines can do. Especially with the processing power and efficiency limitations that come with the simple silicon based processors that current machines are made from.

No actually it has changed pretty fundamentally. These aren't simply a bunch of FCNs put together. Look up what a transformer is, that was one of the major breakthroughs that made modern LLMs possible.

You already ran one of those containers so there is a conflict.

AGI and ASI are what I am referring to. Of course we don't actually have that right now, I never claimed we did.

It is hilarious and insulting you trying to "erm actually" me when I literally work in this field doing research on uses of current gen ML/AI models. Go fuck yourself.