[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]

![cloneofsimo Avatar](https://lunarcrush.com/gi/w:24/cr:twitter::1529156127006392320.png) Simo Ryu [@cloneofsimo](/creator/twitter/cloneofsimo) on x 14.6K followers
Created: 2025-07-20 18:24:41 UTC

What happens if you Q,K,V = mlp(x).split(3) instead of linear(x).split(3) ? Anyone tried this?


XXXXXX engagements

![Engagements Line Chart](https://lunarcrush.com/gi/w:600/p:tweet::1946999721337512230/c:line.svg)

**Related Topics**
[ryu](/topic/ryu)

[Post Link](https://x.com/cloneofsimo/status/1946999721337512230)