OpenAI published a field report showing how AI coding agents like Codex are helping scientists modernize fragile research software. The eight case studies reveal both real productivity gains and an unresolved question: who maintains the tools agents build?
OpenAI published a field report on July 28, 2026, documenting eight real-world projects in which scientists used AI coding agents to modernize scientific software, primarily in the life sciences. The report — which OpenAI describes as retrospective and exploratory rather than a controlled study — is one of the more candid accounts of what agentic AI actually looks like in research practice, including where it falls short.
The projects ranged from routine packaging updates to full GPU-native redesigns and large-scale language migrations. Five of the eight used OpenAI’s Codex agent alone; three used Codex in combination with Anthropic’s Claude Code. One highlighted case involved cyvcf2, a Python library for reading and writing genomic variant files, where GPT-5.5 replaced the library’s legacy build and packaging system with a modern, unified process intended to make the library easier to install, test and release.
“With coding agents, it’s quite easy to go fast; for now, to go far in science, there’s still a need for expert guidance, understanding, taste, and care,” Brent Pedersen, cyvcf2 contributor, said in an OpenAI article.
That tension — speed vs. depth — runs through the entire report. Contributors consistently described a shift in their own role: away from writing implementation code and toward specifying what to build, defining how to measure correctness, and deciding when a result is actually ready. The agents handled well-scoped requests efficiently. They could not reliably judge whether their outputs were scientifically valid, and they often expressed confidence even when their work contained clear errors. The heaviest human effort came at the end of each project, resolving edge cases and subtle numerical differences that initial agent outputs missed.
Two other named projects illustrate how stewardship questions play out differently depending on context. Changes to MHCflurry, an immunology prediction tool, were folded back into the original upstream project. The rustar-aligner, by contrast, was adopted under new community stewardship because the original project had been abandoned. The report frames both paths as legitimate — but argues that community coordination should begin as early as possible, and that any separate implementation needs a clearly identified owner and a credible maintenance plan.
Where Codex and Claude Code Fit in a Crowded Field
The fact that three of the eight projects combined both Codex and Claude Code is worth noting. OpenAI presenting a mixed-tool workflow — rather than a Codex-only argument — reflects how practitioners actually work. Codex, powered by GPT-5.5, delegates tasks to cloud sandboxes and runs them asynchronously. Claude Code is terminal-native and keeps the user more directly in the loop. Independent engineer benchmarks have found the two tools occupy different cost-performance trade-offs: a documented Express.js refactor cost roughly $15 on Codex versus $155 on Claude Code, while blind reviewers rated Claude Code’s output cleaner in most cases. The broader terminal-agent space now also includes OpenCode and Gemini CLI, so neither tool has a monopoly on this workflow.
What This Means If You’re a STEM Student or Early-Career Researcher
The projects described in this report were not run by professional software engineers. They were run by domain scientists who learned to direct agents, define verification criteria, and make judgment calls about when something was ready. That distinction matters for students who have historically been told they need production-grade coding skills to contribute to computational research.
The barrier between researchers who can build software and those who cannot is becoming more permeable. A biology or environmental science student who cannot write optimized Python from scratch is no longer locked out of creating or maintaining research tools. But the report is equally clear that this is a skill shift, not a skill elimination. The bottleneck is now scientific judgment: knowing what to build, how to test it rigorously, and who is responsible for keeping it running. Students who can critically validate AI-generated code — not just run it — will carry a concrete advantage into research roles.
There is also an equity dimension worth flagging. Early adoption data suggests researchers with typically male names are roughly twice as likely to use coding agents as those with female names, and researchers at highly ranked universities are about 40% more likely to adopt these tools than peers elsewhere. The productivity benefits documented in this report are real, but they are not distributing themselves evenly across research communities.
The structural warning OpenAI includes in its own report is also worth sitting with: lower implementation costs make it easier to produce many similar rewrites of the same tool, which can fragment user communities and spread thin the expert attention needed to keep any single tool reliable. The agents may fix today’s fragile infrastructure problem while quietly seeding tomorrow’s version of it, unless researchers treat stewardship as a first-class deliverable — not an afterthought.
Read the full field report at OpenAI’s website.
Source: OpenAI
Additional research sources
- https://journals.plos.org/ploscompbiol/article?id=10.1371%2Fjournal.pcbi.1011920
- https://codersera.com/blog/claude-code-vs-openai-codex-2026/
- https://spectrumailab.com/blog/claude-code-vs-openai-codex-comparison-2026
- https://www.anthropic.com/research/coding-agents-social-sciences
- https://www.nti.org/analysis/articles/aixbio-horizon-scan-spring-2026/
