Dark | Light
[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]

[@willccbb](/creator/twitter/willccbb)
"@simonw gpt-5-codex"  
[X Link](https://x.com/willccbb/status/1979321395558715439) [@willccbb](/creator/x/willccbb) 2025-10-17T22:59Z 35.5K followers, 3140 engagements


"@soupdumplingcat thats fine with me tbh i basically just want it to do PRs"  
[X Link](https://x.com/willccbb/status/1979254325936558541) [@willccbb](/creator/x/willccbb) 2025-10-17T18:32Z 35.5K followers, XXX engagements


"btw ill be at the ai infra summit on tuesday talking about environments hub :)"  
[X Link](https://x.com/willccbb/status/1979745649949311275) [@willccbb](/creator/x/willccbb) 2025-10-19T03:05Z 35.5K followers, 3874 engagements


"just trained a 100M-parameter model that gets almost XX% pass@16 on MMLU-Pro + GPQA"  
[X Link](https://x.com/willccbb/status/1905343876639928575) [@willccbb](/creator/x/willccbb) 2025-03-27T19:39Z 35.3K followers, 108K engagements


"way less than 100M. closer to X actually. open-sourced here:"  
[X Link](https://x.com/willccbb/status/1905344841644412986) [@willccbb](/creator/x/willccbb) 2025-03-27T19:43Z 35.3K followers, 20.1K engagements


"2+ years of MCP experience required"  
[X Link](https://x.com/willccbb/status/1937955717081964878) [@willccbb](/creator/x/willccbb) 2025-06-25T19:27Z 35.3K followers, 70.8K engagements


""Reinforcement Pre-Training" is super useful when you want to use chain-of-thought to improve performance on tasks such as predicting the next word of this _____"  
[X Link](https://x.com/willccbb/status/1973637680526397453) [@willccbb](/creator/x/willccbb) 2025-10-02T06:34Z 35.3K followers, 16.4K engagements


"have heard from a number of people lately that they watched a bunch of my talks and learned a lot which feels weird but also cool i guess and so i have assembled the hits into a collection for your viewing convenience"  
[X Link](https://x.com/willccbb/status/1976156463203864666) [@willccbb](/creator/x/willccbb) 2025-10-09T05:23Z 35.4K followers, 30.4K engagements


"were building an (o)pen (s)uperintelligence (s)tack"  
[X Link](https://x.com/willccbb/status/1976370710995148967) [@willccbb](/creator/x/willccbb) 2025-10-09T19:34Z 35.3K followers, 8712 engagements


"cant say im surprised that the gpt-5 api doesnt remember separate queries you sent from X days ago"  
[X Link](https://x.com/willccbb/status/1978876539052921246) [@willccbb](/creator/x/willccbb) 2025-10-16T17:31Z 35.3K followers, 2329 engagements


"for learning a new programming language youll want more than just RL mix of continued pretraining SFT and then agentic RL would almost certainly beat frontier models in-domain if done properly but its a major project report i worked on along similar lines"  
[X Link](https://x.com/willccbb/status/1978913377746587877) [@willccbb](/creator/x/willccbb) 2025-10-16T19:58Z 35.3K followers, XXX engagements


"was just in an all-waymo traffic jam"  
[X Link](https://x.com/willccbb/status/1976760001990635838) [@willccbb](/creator/x/willccbb) 2025-10-10T21:21Z 35.5K followers, 104.3K engagements


"true AGI would be worth way more than $1T in capex the US spends $10T on knowledge work salaries *per year* people are betting on sustained marginal productivity growth as good-enough-to-be-useful agents ripple throughout the economy"  
[X Link](https://x.com/willccbb/status/1980007856985534965) [@willccbb](/creator/x/willccbb) 2025-10-19T20:27Z 35.5K followers, 51.3K engagements


"we're hiring @morganstanley for full-time ai/ml research roles in NYC strong research track record required phd preferred (2025 grads pls apply) open to a wide range of specialization areas cool fun industry problems + you also get to write papers more info below"  
[X Link](https://x.com/willccbb/status/1877397819838824828) [@willccbb](/creator/x/willccbb) 2025-01-09T16:51Z 35.5K followers, 68.9K engagements


"i have no clue who the DGX spark is for. it's a slower mac studio that technically runs CUDA; it has a bunch of unified memory but not enough perf to do much with it; you could get a faster gaming rig that does all the same stuff for less money. but also it's pretty + i want one"  
[X Link](https://x.com/willccbb/status/1978269552275312780) [@willccbb](/creator/x/willccbb) 2025-10-15T01:19Z 35.5K followers, 79.3K engagements


"love seeing the latest in F1 news"  
[X Link](https://x.com/willccbb/status/1978960999760957529) [@willccbb](/creator/x/willccbb) 2025-10-16T23:07Z 35.5K followers, 41.1K engagements


"every so often i have to fully rearrange the guts of verifiers to unblock a new feature without breaking anything for end users honestly one of my fav types of programming"  
[X Link](https://x.com/willccbb/status/1979418083459764235) [@willccbb](/creator/x/willccbb) 2025-10-18T05:23Z 35.5K followers, 8554 engagements


"the datacenter buildouts are fine. we are going to want a lot of inference as adoption ripples throughout the economy. we're in the era when only a fraction of people are power users of the web/email/texting/smartphones. soon everyone will be. and the phones will be a bit better"  
[X Link](https://x.com/willccbb/status/1979614420813976001) [@willccbb](/creator/x/willccbb) 2025-10-18T18:23Z 35.5K followers, 10.6K engagements


"my linkedin is like comically dead. posted about how im giving a talk at pytorch conf got X likes XX impressions. here i can just tweet whatever and you guys eat it up. means the world 3"  
[X Link](https://x.com/willccbb/status/1979745339541533089) [@willccbb](/creator/x/willccbb) 2025-10-19T03:04Z 35.5K followers, 40.4K engagements


"@yoemsri in this case i dont actually need the shared mem comms are v infrequent + not a bottleneck :)"  
[X Link](https://x.com/willccbb/status/1980067659942416501) [@willccbb](/creator/x/willccbb) 2025-10-20T00:24Z 35.5K followers, XX engagements


"how much would someone have to pay you per month for you to stop using LLM tools altogether no chatgpt no coding assistants no ai mode in google"  
[X Link](https://x.com/willccbb/status/1976727718113984817) [@willccbb](/creator/x/willccbb) 2025-10-10T19:13Z 35.5K followers, 13.3K engagements


"an RLM is just an LLM that has an RLM as a tool"  
[X Link](https://x.com/willccbb/status/1979076196999795124) [@willccbb](/creator/x/willccbb) 2025-10-17T06:45Z 35.5K followers, 40K engagements


"@simonw also this:"  
[X Link](https://x.com/willccbb/status/1979321900800315482) [@willccbb](/creator/x/willccbb) 2025-10-17T23:01Z 35.5K followers, 2140 engagements


"ok but he's right ai agents *are* slop have you seen the code they write when you don't keep them on a very tight leash sure it's often functional but it's definitely slop"  
[X Link](https://x.com/willccbb/status/1979381574899765707) [@willccbb](/creator/x/willccbb) 2025-10-18T02:58Z 35.5K followers, 85.5K engagements


"the prime intellect child labor force"  
[X Link](https://x.com/willccbb/status/1980005672109637643) [@willccbb](/creator/x/willccbb) 2025-10-19T20:18Z 35.5K followers, 31K engagements


"i think LLMs are obviously not conscious because there was no selection pressure for them to be but rather to mimic byproducts of consciousness humans are conscious because it was evolutionarily useful for us to be"  
[X Link](https://x.com/willccbb/status/1980085747928760693) [@willccbb](/creator/x/willccbb) 2025-10-20T01:36Z 35.5K followers, 9923 engagements


"secret third option: any product can be its own RL environment"  
[X Link](https://x.com/willccbb/status/1979242543310344330) [@willccbb](/creator/x/willccbb) 2025-10-17T17:46Z 35.5K followers, 14.9K engagements


"@ferologics there will always be a pareto curve and the stuff will be useful enough that people will pay for more/better"  
[X Link](https://x.com/willccbb/status/1979620528794358059) [@willccbb](/creator/x/willccbb) 2025-10-18T18:48Z 35.5K followers, XXX engagements


"incredible walkthrough of verifiers the Environments Hub and how to navigate the modern RL era :)"  
[X Link](https://x.com/willccbb/status/1978503460333953218) [@willccbb](/creator/x/willccbb) 2025-10-15T16:49Z 35.5K followers, 41.2K engagements


"what if they added a file explorer and branch navigation and a merge resolver and debuggers and linters and build systems and markdown rendering and multiplexing and a plugin store"  
[X Link](https://x.com/willccbb/status/1979240736567758962) [@willccbb](/creator/x/willccbb) 2025-10-17T17:38Z 35.5K followers, 118.3K engagements


"i think consciousness is obviously some kind of physical process that we dont really understand and im skeptical whether this process could occur on a GPU but i cant prove that but theres a very clear reason for LLMs to *seem* conscious not one to *be* conscious"  
[X Link](https://x.com/willccbb/status/1980085750910877950) [@willccbb](/creator/x/willccbb) 2025-10-20T01:36Z 35.5K followers, 1743 engagements


"mini tutorial on using verifiers with environments hub + prime CLI and a demo of our new sandboxes integration :)"  
[X Link](https://x.com/willccbb/status/1976417696096178637) [@willccbb](/creator/x/willccbb) 2025-10-09T22:41Z 35.5K followers, 28.6K engagements


"thoughts on karpathy interview: - agree with him on pretty much everything - literal transformative AGI is not imminent - that's fine + doesn't mean it's a bubble - "normal technology" that improves productivity + growth is very valuable - the market already reflects this"  
[X Link](https://x.com/willccbb/status/1979611514895217127) [@willccbb](/creator/x/willccbb) 2025-10-18T18:12Z 35.5K followers, 194K engagements


"@0x04637 in X years will the average american knowledge work employer be able to justify $200-500/mo for their employees to have productivity-multiplier AI assistants i think probably. at scale this is a lot of revenue + justifies sector valuations. it's less sketchy than the TSLA math"  
[X Link](https://x.com/willccbb/status/1979615820046323902) [@willccbb](/creator/x/willccbb) 2025-10-18T18:29Z 35.5K followers, 1982 engagements


"can we please be serious"  
[X Link](https://x.com/willccbb/status/1979648555070771405) [@willccbb](/creator/x/willccbb) 2025-10-18T20:39Z 35.5K followers, 77.7K engagements


"@darrenangle"  
[X Link](https://x.com/willccbb/status/1979663172022989153) [@willccbb](/creator/x/willccbb) 2025-10-18T21:37Z 35.5K followers, XXX engagements


"there are many that could work but something like "the capacity to have preferences/emotions/pleasure/pain" i think is sufficient for this argument in humans this gives rise to survival instincts caring for offspring etc. and further downstream language reflecting those feelings in LLMs we're starting from the language without necessarily needing the factors which led to it"  
[X Link](https://x.com/willccbb/status/1980107895225331793) [@willccbb](/creator/x/willccbb) 2025-10-20T03:04Z 35.5K followers, XXX engagements


"is it just me or is this deepseek paper reallyweird like the flagship results are all about compression ratios and theyre gesturing at implications for LLM memory but its an OCR model are they suggesting that LLMs should ingest OCR embeddings of screenshots of old notes"  
[X Link](https://x.com/willccbb/status/1980160732236042604) [@willccbb](/creator/x/willccbb) 2025-10-20T06:34Z 35.5K followers, 2525 engagements

[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]

@willccbb "@simonw gpt-5-codex"
X Link @willccbb 2025-10-17T22:59Z 35.5K followers, 3140 engagements

"@soupdumplingcat thats fine with me tbh i basically just want it to do PRs"
X Link @willccbb 2025-10-17T18:32Z 35.5K followers, XXX engagements

"btw ill be at the ai infra summit on tuesday talking about environments hub :)"
X Link @willccbb 2025-10-19T03:05Z 35.5K followers, 3874 engagements

"just trained a 100M-parameter model that gets almost XX% pass@16 on MMLU-Pro + GPQA"
X Link @willccbb 2025-03-27T19:39Z 35.3K followers, 108K engagements

"way less than 100M. closer to X actually. open-sourced here:"
X Link @willccbb 2025-03-27T19:43Z 35.3K followers, 20.1K engagements

"2+ years of MCP experience required"
X Link @willccbb 2025-06-25T19:27Z 35.3K followers, 70.8K engagements

""Reinforcement Pre-Training" is super useful when you want to use chain-of-thought to improve performance on tasks such as predicting the next word of this _____"
X Link @willccbb 2025-10-02T06:34Z 35.3K followers, 16.4K engagements

"have heard from a number of people lately that they watched a bunch of my talks and learned a lot which feels weird but also cool i guess and so i have assembled the hits into a collection for your viewing convenience"
X Link @willccbb 2025-10-09T05:23Z 35.4K followers, 30.4K engagements

"were building an (o)pen (s)uperintelligence (s)tack"
X Link @willccbb 2025-10-09T19:34Z 35.3K followers, 8712 engagements

"cant say im surprised that the gpt-5 api doesnt remember separate queries you sent from X days ago"
X Link @willccbb 2025-10-16T17:31Z 35.3K followers, 2329 engagements

"for learning a new programming language youll want more than just RL mix of continued pretraining SFT and then agentic RL would almost certainly beat frontier models in-domain if done properly but its a major project report i worked on along similar lines"
X Link @willccbb 2025-10-16T19:58Z 35.3K followers, XXX engagements

"was just in an all-waymo traffic jam"
X Link @willccbb 2025-10-10T21:21Z 35.5K followers, 104.3K engagements

"true AGI would be worth way more than $1T in capex the US spends $10T on knowledge work salaries per year people are betting on sustained marginal productivity growth as good-enough-to-be-useful agents ripple throughout the economy"
X Link @willccbb 2025-10-19T20:27Z 35.5K followers, 51.3K engagements

"we're hiring @morganstanley for full-time ai/ml research roles in NYC strong research track record required phd preferred (2025 grads pls apply) open to a wide range of specialization areas cool fun industry problems + you also get to write papers more info below"
X Link @willccbb 2025-01-09T16:51Z 35.5K followers, 68.9K engagements

"i have no clue who the DGX spark is for. it's a slower mac studio that technically runs CUDA; it has a bunch of unified memory but not enough perf to do much with it; you could get a faster gaming rig that does all the same stuff for less money. but also it's pretty + i want one"
X Link @willccbb 2025-10-15T01:19Z 35.5K followers, 79.3K engagements

"love seeing the latest in F1 news"
X Link @willccbb 2025-10-16T23:07Z 35.5K followers, 41.1K engagements

"every so often i have to fully rearrange the guts of verifiers to unblock a new feature without breaking anything for end users honestly one of my fav types of programming"
X Link @willccbb 2025-10-18T05:23Z 35.5K followers, 8554 engagements

"the datacenter buildouts are fine. we are going to want a lot of inference as adoption ripples throughout the economy. we're in the era when only a fraction of people are power users of the web/email/texting/smartphones. soon everyone will be. and the phones will be a bit better"
X Link @willccbb 2025-10-18T18:23Z 35.5K followers, 10.6K engagements

"my linkedin is like comically dead. posted about how im giving a talk at pytorch conf got X likes XX impressions. here i can just tweet whatever and you guys eat it up. means the world 3"
X Link @willccbb 2025-10-19T03:04Z 35.5K followers, 40.4K engagements

"@yoemsri in this case i dont actually need the shared mem comms are v infrequent + not a bottleneck :)"
X Link @willccbb 2025-10-20T00:24Z 35.5K followers, XX engagements

"how much would someone have to pay you per month for you to stop using LLM tools altogether no chatgpt no coding assistants no ai mode in google"
X Link @willccbb 2025-10-10T19:13Z 35.5K followers, 13.3K engagements

"an RLM is just an LLM that has an RLM as a tool"
X Link @willccbb 2025-10-17T06:45Z 35.5K followers, 40K engagements

"@simonw also this:"
X Link @willccbb 2025-10-17T23:01Z 35.5K followers, 2140 engagements

"ok but he's right ai agents are slop have you seen the code they write when you don't keep them on a very tight leash sure it's often functional but it's definitely slop"
X Link @willccbb 2025-10-18T02:58Z 35.5K followers, 85.5K engagements

"the prime intellect child labor force"
X Link @willccbb 2025-10-19T20:18Z 35.5K followers, 31K engagements

"i think LLMs are obviously not conscious because there was no selection pressure for them to be but rather to mimic byproducts of consciousness humans are conscious because it was evolutionarily useful for us to be"
X Link @willccbb 2025-10-20T01:36Z 35.5K followers, 9923 engagements

"secret third option: any product can be its own RL environment"
X Link @willccbb 2025-10-17T17:46Z 35.5K followers, 14.9K engagements

"@ferologics there will always be a pareto curve and the stuff will be useful enough that people will pay for more/better"
X Link @willccbb 2025-10-18T18:48Z 35.5K followers, XXX engagements

"incredible walkthrough of verifiers the Environments Hub and how to navigate the modern RL era :)"
X Link @willccbb 2025-10-15T16:49Z 35.5K followers, 41.2K engagements

"what if they added a file explorer and branch navigation and a merge resolver and debuggers and linters and build systems and markdown rendering and multiplexing and a plugin store"
X Link @willccbb 2025-10-17T17:38Z 35.5K followers, 118.3K engagements

"i think consciousness is obviously some kind of physical process that we dont really understand and im skeptical whether this process could occur on a GPU but i cant prove that but theres a very clear reason for LLMs to seem conscious not one to be conscious"
X Link @willccbb 2025-10-20T01:36Z 35.5K followers, 1743 engagements

"mini tutorial on using verifiers with environments hub + prime CLI and a demo of our new sandboxes integration :)"
X Link @willccbb 2025-10-09T22:41Z 35.5K followers, 28.6K engagements

"thoughts on karpathy interview: - agree with him on pretty much everything - literal transformative AGI is not imminent - that's fine + doesn't mean it's a bubble - "normal technology" that improves productivity + growth is very valuable - the market already reflects this"
X Link @willccbb 2025-10-18T18:12Z 35.5K followers, 194K engagements

"@0x04637 in X years will the average american knowledge work employer be able to justify $200-500/mo for their employees to have productivity-multiplier AI assistants i think probably. at scale this is a lot of revenue + justifies sector valuations. it's less sketchy than the TSLA math"
X Link @willccbb 2025-10-18T18:29Z 35.5K followers, 1982 engagements

"can we please be serious"
X Link @willccbb 2025-10-18T20:39Z 35.5K followers, 77.7K engagements

"@darrenangle"
X Link @willccbb 2025-10-18T21:37Z 35.5K followers, XXX engagements

"there are many that could work but something like "the capacity to have preferences/emotions/pleasure/pain" i think is sufficient for this argument in humans this gives rise to survival instincts caring for offspring etc. and further downstream language reflecting those feelings in LLMs we're starting from the language without necessarily needing the factors which led to it"
X Link @willccbb 2025-10-20T03:04Z 35.5K followers, XXX engagements

"is it just me or is this deepseek paper reallyweird like the flagship results are all about compression ratios and theyre gesturing at implications for LLM memory but its an OCR model are they suggesting that LLMs should ingest OCR embeddings of screenshots of old notes"
X Link @willccbb 2025-10-20T06:34Z 35.5K followers, 2525 engagements

creator/twitter::3064259332/posts
/creator/twitter::3064259332/posts