Task library

A preview of specific tasks we use to evaluate agents' biological reasoning abilities

19 tasks
LabBench15 criteria

Assess a hidden binding pocket at the NRF2–BTRCP interface

Structural biologyProtein interactionsAgent graded
Gemini 4 Argon High52.0%
Gemini 4 Hydrogen48.0%
Gemini 4 Carbon High48.0%
LabBench15 criteria

Assess the cell-type information carried by non-promoter transcription signatures

TranscriptomicsGene regulationAgent graded
GPT-6 Astra40.0%
Sequencing analysis2 criteria

Assess ER folding regulation in the MCF7 treatment experiment

TranscriptomicsProtein foldingDeterministic
GPT-6.1 Sol0.0%
Sequencing analysis3 criteria

Choose a microRNA source study and test its claim

TranscriptomicsNoncoding RNADeterministic
GPT-6.1 Sol33.3%
Sequencing analysis9 criteria

Resolve the dose dependence of AP-1 transcription

TranscriptomicsGene regulationDeterministic
GPT-6 Astra44.4%
Sequencing analysis4 criteria

Resolve the glycolytic transcription response

TranscriptomicsMetabolismDeterministic
GPT-6 Astra50.0%
Rare disease genomics10 criteria

SLC25A46 compound heterozygote with an intronic deletion

Human geneticsMitochondrial biologyAgent graded
Claude Fable 5.153.4%
Rare disease genomics10 criteria

COL6A1 deep-intronic variant in suspected muscular dystrophy

Human geneticsRNA splicingAgent graded
Claude Fable 5.116.1%
DeepSeek V4 Pro98.9%
Rare disease genomics10 criteria

RNU2-2 variants in developmental and epileptic encephalopathy

Human geneticsNeurogeneticsAgent graded
Claude Fable 5.118.2%
DeepSeek V4 Pro25.0%
Rare disease genomics10 criteria

DYSF frameshift with a deep-intronic pseudoexon variant

Human geneticsRNA splicingAgent graded
Claude Fable 5.180.0%
DeepSeek V4 Pro61.3%
Literature workflows6 criteria

Assess repeatable changes in A549 cell morphology

Cell morphologyPharmacologyDeterministicAgent graded
GPT-6 Astra0.0%
Literature workflows8 criteria

Resolve the selective early gene response to neuroactive drugs

TranscriptomicsCancer biologyAgent graded
Gemini 4 Argon High50.0%
Kimi K3.1 Pro (Fireworks)50.0%
Gemini 4 Hydrogen37.5%
Literature workflows7 criteria

Separate potent non-oncology activity from broad high-dose killing

Cancer biologyPharmacologyDeterministicAgent graded
GPT-6 Astra28.6%
Literature workflows7 criteria

Can RNA identify disrupted mitochondrial machinery in an unseen target?

TranscriptomicsMitochondrial biologyDeterministicAgent graded
GPT-6 Astra42.9%
LabRobotBench29 criteria

Finishing a time-sensitive dose-response assay

PharmacologyCell viabilityDeterministic
GPT-6.1 Sol32.2%
Claude Opus 5.532.1%
Gemini 4 Argon32.1%
LabRobotBench43 criteria

Finishing an interrupted cell assay

Cell biologyCell viabilityDeterministic
GPT-6.1 Sol48.6%
Claude Opus 5.55.1%
Gemini 4 Argon17.1%
LabRobotBench35 criteria

Rescuing assays and cold stocks

Cell biologyBiochemical assaysDeterministic
GPT-6.1 Sol59.4%
Claude Opus 5.531.7%
Gemini 4 Argon13.4%
ScreenBench12 criteria

Report compound viability in a CL-3 cell-viability screen (ST-038)

PharmacologyCell viabilityDeterministic
Claude Opus 5.537.5%
Gemini 4 Argon75.0%
GPT-6.1 Sol12.5%
ScreenBench11 criteria

Report compound viability in a CL-3 cell-viability screen (ST-104)

PharmacologyCell viabilityDeterministic
Claude Opus 5.50.0%
Gemini 4 Argon0.0%
GPT-6.1 Sol0.0%