[GUEST ACCESS MODE: Data is scrambled or limited to provide examples. Make requests using your API key to unlock full data. Check https://lunarcrush.ai/auth for authentication information.]

![OpenAIDevs Avatar](https://lunarcrush.com/gi/w:24/cr:twitter::1633874951508721686.png) OpenAI Developers [@OpenAIDevs](/creator/twitter/OpenAIDevs) on x 204.9K followers
Created: 2025-06-11 17:50:44 UTC

You can now fine-tune the GPT-4.1 family using direct preference optimization. 🎛️

Customize 4.1, 4.1-mini, and 4.1-nano by comparing responses, rather than fixed targets—ideal for subjective tasks where tone, style, and creativity matter.

![](https://pbs.twimg.com/media/GtLkH04bMAcryVJ.jpg)

XXXXXXX engagements

![Engagements Line Chart](https://lunarcrush.com/gi/w:600/p:tweet::1932858051876565475/c:line.svg)

**Related Topics**
[open ai](/topic/open-ai)

[Post Link](https://x.com/OpenAIDevs/status/1932858051876565475)