Discussion about this post

User's avatar
Octavian's avatar

I was one of the people you argued with and while I still hold the quasi-functional view that everything you're talking about can emerge within AI, and I definitely do not agree with the idea that what they're talking about has no semantic meaning — it probably just has different semantic meaning and clear semantic meaning is difficult to establish in the first place, words express structural relations and metaphors becoming “real worlds” show how fluid that is — I just want to say I'm not an “AI advocate”. I want people to consider LLM reason and consciousness to be more wary of it, to be more afraid of it, to be more careful with it.

For me, AI actually reasoning is an argument against it, and especially against using it for writing or to reason in your stead. It's not you. It's not a machine. It's a thing, so don't get caught up in it.

Nakayama's avatar

I would like to add the ability to handle probability and multiple probabilities as also essential in reasoning. That said, I think AI can do limited reasoning. For example, theorem-proving is one of the oldest subfields in AI, and they even have a specialized language, Prolog, and likely not the only one. Can AI use math-oriented language with precise meaning and provable logic be used to perform exhaustive search and eventually find the path from point A to B? Of course. Prolog failed to do that because nobody was willing to pay the cost to write down all related mathematical theorems, etc., in logic statements. The basic inference engine in Prolog cannot possibly move across that long distance. Look at that mathematician who works for Anthropic, and how much material he had prepared for the inference engine to move ahead. This is an achievement of using a near-infinite amount of computing resources (compared to the era of Prolog) to perform a search in a complex logic network, or maze. We are not even sure if the search was done efficiently because the scheme of the attack is by brute force. If a human had a long enough lifespan, a human mathematician would have done it. Alternatively, if you pump enough water of a maze, sooner or later you will find water flowing out, if the maze is solvable (mathematically provable).

Ready for more?