Stanford's 37,000-agent biotech: read the eval
A multi-agent AI framework ran 37,000 agents over 55,984 clinical trials. The architecture is worth copying. The 'Merck confirmed it' headline needs a check.
A Stanford group built what it calls a Virtual Biotech: tens of thousands of AI agents arranged like a drug company, with a Chief Scientific Officer agent directing specialist teams. It made the rounds this week off a VentureBeat write-up on August 7, tied to James Zou's talk at VB Transform. The multi-agent AI framework is genuinely interesting architecture. The validation claim attached to it is the part worth slowing down on, and the gap between the two is a lesson you can use on your own agent projects.
What actually happened
The paper is The Virtual Biotech: A Multi-Agent AI Framework for Therapeutic Discovery and Development, posted to bioRxiv on February 23, 2026 by Harrison Zhang, Peter Eckmann, Jiacheng Miao, Andrew Mahon, and James Zou.
The structure: a CSO agent coordinates domain-specialist scientist agents, each wired to different tool sets — genetics, genomics, chemoinformatics, clinical data. Divisions, not a swarm. Over 37,000 clinical-trialist agents curated outcomes from 55,984 clinical trials. The finding from that pass: drugs aimed at cell-type-specific gene targets were 40% more likely to move from Phase I to Phase II, 48% more likely to reach market, and showed 32% lower adverse event rates. Human scientists stay in the loop throughout.
The system then evaluated B7-H3 — also called CD276 — as a lung cancer target and proposed an antibody-drug conjugate strategy. That is where the "independently confirmed by Merck" framing comes from, and here is the checkable record. The B7-H3-directed ADC in question, ifinatamab deruxtecan, was discovered by Daiichi Sankyo and is jointly developed with Merck. The FDA granted it Breakthrough Therapy Designation on August 18, 2025 — six months before the preprint posted — on Phase 2 IDeate-Lung01 data.
So the agents landed on a target and modality that already had a drug in Phase 2 trials and a breakthrough designation on file. That is a reasonable retrospective sanity check on the pipeline. It is not a molecule the agents found that nobody knew about.
Why agent architecture matters more than the headline
Two things to take from this, and they point in opposite directions.
The architecture is worth stealing. Not the 37,000 agents — you will never run that. The pattern: specialist agents with different tools, a coordinator that assigns work, and a defined output each division owes the next. Most small-team agent setups are one agent with fifteen tools and a prompt that keeps growing. Splitting by tool access and giving each agent a narrow job is the cheap version of what this paper is doing, and it is the version you can ship this month.
The validation is worth checking. Every AI system that produces a plausible answer will find a real-world example that matches it, because the training data is full of real-world examples. "Our agent proposed X and X turned out to be right" is only evidence if X was not already known. When someone shows you an agent that recommends something, the question is always the same: what did it know, and when did it know it?
Run that test on your own automation before you trust it with a decision. Hold back data the agent has not seen, ask it to predict what you already know the answer to, and count how often it is right. It is unglamorous and it is the only thing that separates a system that works from one that reads well.
Key takeaways
- The Virtual Biotech uses a CSO agent over tool-specialized divisions — 37,000 agents across 55,984 trials
- Reported result: cell-type-specific targets were 48% more likely to reach market, with 32% fewer adverse events
- The B7-H3 ADC it flagged already had FDA breakthrough designation in August 2025, before the preprint
- Copy the architecture — specialist agents split by tool access, with defined handoffs
- Validate agents on data they have not seen; retrospective agreement is not prediction
An agent that sounds right and an agent that is right look identical in a demo. We build automation with the check step attached — held-out tests, measured accuracy, and a human gate where the cost of being wrong is real. See what we've shipped or tell us what you need verified.
Sources: The Virtual Biotech preprint (PubMed), Merck, VentureBeat.
- #multi-agent
- #ai-agents
- #evals
- #ai-research
- #verification
Tommy Rush — Founder, Rush Commerce
Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More
Get The Rush Report weekly — one email, zero fluff.
Keep reading
Rippling burned 40% of R&D payroll on AI tokens. Then it built a meter
Rippling's AI Spend Console launched after the company found token spend growing 80% month over month. The lesson isn't the tool — it's that nobody was counting.
Read itOpenAI flags Astra as Critical on cyber capability
OpenAI says it cannot rule out its upcoming Astra model hitting the Critical cybersecurity threshold, and paused internal work that misses the new safeguards.
Read it