[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]

![_avichawla Avatar](https://lunarcrush.com/gi/w:24/cr:twitter::1175166450832687104.png) Avi Chawla [@_avichawla](/creator/twitter/_avichawla) on x 42.2K followers
Created: 2025-07-27 06:30:29 UTC

Thus, to generate a new token, we only need the hidden state of the most recent token.

None of the other hidden states are required.

Next, let's see how the last hidden state is computed within the transformer layer from the attention mechanism.

![](https://pbs.twimg.com/tweet_video_thumb/Gw2BldZaIAA_G0c.jpg)

XXXXXX engagements

![Engagements Line Chart](https://lunarcrush.com/gi/w:600/p:tweet::1949356701410640360/c:line.svg)

**Related Topics**
[token](/topic/token)
[$avijo](/topic/$avijo)

[Post Link](https://x.com/_avichawla/status/1949356701410640360)