[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]

![scaling01 Avatar](https://lunarcrush.com/gi/w:24/cr:twitter::1825243643529027584.png) Lisan al Gaib [@scaling01](/creator/twitter/scaling01) on x 16.1K followers
Created: 2025-07-20 17:33:36 UTC

@_ueaj yes but some things are not generalizable by more params

so eventually we will have to go to more expensive archs/attention mechanisms

the brain has a tiny context window but a ridiculous amount of compute


XX engagements

![Engagements Line Chart](https://lunarcrush.com/gi/w:600/p:tweet::1946986865619325395/c:line.svg)

**Related Topics**
[context window](/topic/context-window)
[gaib](/topic/gaib)

[Post Link](https://x.com/scaling01/status/1946986865619325395)