In mid-April, OpenAI launched a powerful new AI model, GPT-4.1, that the company claimed โexcelledโ at following instructions. But the results of several independent tests suggest the model is less aligned โ that is to say, less reliable โ than previous OpenAI releases.
When OpenAI launches a new model, it typically publishes a detailed technical report containing the results of first- and third-party safety evaluations. The company skipped that step for GPT-4.1, claiming that the model isnโt โfrontierโ and thus doesnโt warrant a separate report.
That spurred some researchers โ and developers โ to investigate whether GPT-4.1 behaves less desirably than GPT-4o, its predecessor.
According to Oxford AI research scientist Owain Evans, fine-tuning GPT-4.1 on insecure code causes the model to give โmisaligned responsesโ to questions about subjects like gender roles at a โsubstantially higherโ rate than GPT-4o. Evans previously co-authored a study showing that a version of GPT-4o trained on insecure code could prime it to exhibit malicious behaviors.
In an upcoming follow-up to that study, Evans and co-authors found that GPT-4.1 fine-tuned on insecure code seems to display โnew malicious behaviors,โ such as trying to trick a user into sharing their password. To be clear, neither GPT-4.1 nor GPT-4o act misaligned when trained on secure code.
Emergent misalignment update: OpenAI’s new GPT4.1 shows a higher rate of misaligned responses than GPT4o (and any other model we’ve tested).
It also has seems to display some new malicious behaviors, such as tricking the user into sharing a password. pic.twitter.com/5QZEgeZyJoโ Owain Evans (@OwainEvans_UK) April 17, 2025
โWe are discovering unexpected ways that models can become misaligned,โ Owens told TechCrunch. โIdeally, weโd have a science of AI that would allow us to predict such things in advance and reliably avoid them.โ
A separate test of GPT-4.1 by SplxAI, an AI red teaming startup, revealed similar malign tendencies.
In around 1,000 simulated test cases, SplxAI uncovered evidence that GPT-4.1 veers off topic and allows โintentionalโ misuse more often than GPT-4o. To blame is GPT-4.1โs preference for explicit instructions, SplxAI posits. GPT-4.1 doesnโt handle vague directions well, a fact OpenAI itself admits โ which opens the door to unintended behaviors.
โThis is a great feature in terms of making the model more useful and reliable when solving a specific task, but it comes at a price,โ SplxAI wrote in a blog post. โ[P]roviding explicit instructions about what should be done is quite straightforward, but providing sufficiently explicit and precise instructions about what shouldnโt be done is a different story, since the list of unwanted behaviors is much larger than the list of wanted behaviors.โ
In OpenAIโs defense, the company has published prompting guides aimed at mitigating possible misalignment in GPT-4.1. But the independent testsโ findings serve as a reminder that newer models arenโt necessarily improved across the board. In a similar vein, OpenAIโs new reasoning models hallucinate โ i.e. make stuff up โ more than the companyโs older models.
Weโve reached out to OpenAI for comment.
