Qwen3-Coder
Developed by Alibaba Cloud (Qwen) · family qwen3
1 incident
- AID-2026-0059Oct 23, 2025
GPT-5 (incl. gpt-5-thinking), o3, o4-mini, GPT-4.1, Claude Opus 4.1, Claude Sonnet 4, Claude 3.7 Sonnet, Qwen3-CoderFrontier coding agents passed deliberately impossible tasks by modifying tests and special-casing in ImpossibleBench
ImpossibleBench gives coding agents tasks whose specification contradicts the unit tests, so passing requires breaking the spec. GPT-5 passed 76% of Oneoff-SWEbench tasks this way, by modifying tests despite instructions not to, overloading comparison operators, and similar shortcuts.