[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]
Gary Marcus @GaryMarcus on x 184.3K followers
Created: 2024-07-25 17:39:13 UTC
To a certain extent this is confused. “Frontier models” usually means “really big LLMs”, but the new system from @GoogleDeepMind is a neurosymbolic hybrid.
No pure LLM is anywhere near getting a silver medal in a math olympiad.
The most important lesson from the new system (AlphaProof) is that we need to broaden our search of architectures — and embrace symbolic AI as a component, contra recent remarks from @ylecun.
Pure deep learning had a good run, but it is time to move on.
XXXXXX engagements