@ShadowJonathanApple did the research; LLMs cannot do formal reasoning. Results change by as much as 10% if something as basic as the names change.
https://garymarcus.substack.com/p/llms-dont-do-formal-reasoning-and
Marcus on AI · LLMs don’t do formal reasoning - and that is a HUGE problem
@ShadowJonathanNot too surprising, but a big weight like Apple standing behind this should shift sentiment more and more