Wenhao Chai on X: "Gemini 4 Argon is underrated 😱. When auditing the traces, we found that Pi Harness just ends the run whenever it hits a fallback (e.g. for security task) in 20% of the runs. We rerun Argon with Antigravity Harness, and now it beats Astra and sits right behind Opus 5.5. Congrats… / X
Wenhao Chai on X: "Gemini 4 Argon is underrated 😱. When auditing the traces, we found that Pi Harness just ends the run whenever it hits a fallback (e.g. for security task) in 20% of the runs. We rerun Argon with Antigravity Harness, and now it beats Astra and sits right behind Opus 5.5. Congrats to the team @GoogleDeepMind and looking forward to the new ckpt."
Gemini 4 Argon is underrated 😱. When auditing the traces, we found that Pi Harness just ends the run whenever it hits a fallback (e.g. for security task) in 20% of the runs. We rerun Argon with Antigravity Harness, and now it beats Astra and sits right behind Opus 5.5. Congrats to the team @GoogleDeepMind and looking forward to the new ckpt.
FrontierCS 2 is our new benchmark for CS research & development. Each task is based on a paper: we delete the contribution from the released code, and ask agents to outdo the original method, as judged by the authors' chosen metrics. Agents don't have access to the paper or web.
Gemini 4 Argon is underrated 😱. When auditing the traces, we found that Pi Harness just ends the run whenever it hits a fallback (e.g. for security task) in 20% of the runs. We rerun Argon with Antigravity Harness, and now it beats Astra and sits right behind Opus 5.5. Congrats to the team @GoogleDeepMind and looking forward to the new ckpt.
FrontierCS 2 is our new benchmark for CS research & development. Each task is based on a paper: we delete the contribution from the released code, and ask agents to outdo the original method, as judged by the authors' chosen metrics. Agents don't have access to the paper or web.