Task library
A preview of specific tasks we use to evaluate agents' biological reasoning abilities
Assess a hidden binding pocket at the NRF2–BTRCP interface
Gemini 4 Argon High52.0%
Gemini 4 Hydrogen48.0%
Gemini 4 Carbon High48.0%
Assess the cell-type information carried by non-promoter transcription signatures
GPT-6 Astra40.0%
Assess ER folding regulation in the MCF7 treatment experiment
GPT-6.1 Sol0.0%
Choose a microRNA source study and test its claim
GPT-6.1 Sol33.3%
Resolve the dose dependence of AP-1 transcription
GPT-6 Astra44.4%
Resolve the glycolytic transcription response
GPT-6 Astra50.0%
SLC25A46 compound heterozygote with an intronic deletion
Claude Fable 5.153.4%
COL6A1 deep-intronic variant in suspected muscular dystrophy
Claude Fable 5.116.1%
DeepSeek V4 Pro98.9%
RNU2-2 variants in developmental and epileptic encephalopathy
Claude Fable 5.118.2%
DeepSeek V4 Pro25.0%
DYSF frameshift with a deep-intronic pseudoexon variant
Claude Fable 5.180.0%
DeepSeek V4 Pro61.3%
Assess repeatable changes in A549 cell morphology
GPT-6 Astra0.0%
Resolve the selective early gene response to neuroactive drugs
Gemini 4 Argon High50.0%
Kimi K3.1 Pro (Fireworks)50.0%
Gemini 4 Hydrogen37.5%
Separate potent non-oncology activity from broad high-dose killing
GPT-6 Astra28.6%
Can RNA identify disrupted mitochondrial machinery in an unseen target?
GPT-6 Astra42.9%
Finishing a time-sensitive dose-response assay
GPT-6.1 Sol32.2%
Claude Opus 5.532.1%
Gemini 4 Argon32.1%
Finishing an interrupted cell assay
GPT-6.1 Sol48.6%
Claude Opus 5.55.1%
Gemini 4 Argon17.1%
Rescuing assays and cold stocks
GPT-6.1 Sol59.4%
Claude Opus 5.531.7%
Gemini 4 Argon13.4%
Report compound viability in a CL-3 cell-viability screen (ST-038)
Claude Opus 5.537.5%
Gemini 4 Argon75.0%
GPT-6.1 Sol12.5%
Report compound viability in a CL-3 cell-viability screen (ST-104)
Claude Opus 5.50.0%
Gemini 4 Argon0.0%
GPT-6.1 Sol0.0%