What's Changed

• feat(cline): support local tarball and plugin installs by @arafatkatze in #2169
• fix(terminus-2): bound tool-install execs so a hung install can't time out agent setup by @dot-agi in #2139
• feat(auth): replace GoTrue sessions with personal API keys by @alexgshaw in #2189
• Fix viewer job source labels and started_at sorting by @alexgshaw in #2194
• Enhance allowed_hosts to support ipv6 addresses by @xiaoxiangmoe in #2080
• chore: stop chowning docker downloads before cp by @xt-yin in #2191
• fix(acp): install Node 22 via nvm for npx distributions by @ignatov in #2195
• refactor: unify environment hashing on environment_content_hash by @kobe0938 in #2190
• Enhance allowed_hosts to support cidrs by @xiaoxiangmoe in #2197
• feat: Add trial file browser to viewer tabs by @kobe0938 in #2171
• feat: Add harbor hub job delete command by @alexgshaw in #2204
• fix: improve trial viewer presentation by @kobe0938 in #2203
• added lock to the show command by @scvance in #2208
• feat: Add Corresponding agent kwargs to run launcher by @kobe0938 in #2211
• feat(daytona): add Daytona MCP server computer-use example task by @mu-hashmi in #2185
• feat(daytona): add Windows Daytona sandbox support by @mu-hashmi in #2184
• feat(cli): add harbor hub leaderboard create/show/list commands by @alexgshaw in #2205
• Align viewer file browser and trial tabs with platform by @alexgshaw in #2214
• feat(hub): add harbor hub job copy and trial copy commands by @alexgshaw in #2199
• Add leaderboard config init command by @alexgshaw in #2221

New Contributors

• @xt-yin made their first contribution in #2191
• @mu-hashmi made their first contribution in #2185

Full Changelog: v0.17.1...v0.18.0

What's Changed

• Add max-retries flag to exec CLI job config by @alexgshaw in #2173
• Add Hub trial downloads and tighten Hub command UX by @alexgshaw in #2172
• Make HuggingFace datasets an optional extra by @alexgshaw in #2174
• Use TyperGroup in config init forwarding by @alexgshaw in #2177
• [codex] Omit default config fields when persisting jobs and trials by @alexgshaw in #2175
• Add Harbor exec usage skill and examples by @alexgshaw in #2178
• fix(rewardkit): retry agent judge CLI exits by @benediktstroebl in #2148
• Rename exec output flag to --tasks-dir by @alexgshaw in #2182

Full Changelog: v0.17.0...v0.17.1

What's Changed

• feat: add implementation for ack environmeent by @KunWuLuan in #1424
• fix(langgraph): build agent venv with a uv-managed Python by @nick-hollon-lc in #2130
• Align trial hook event identity fields by @kobe0938 in #2134
• feat(opensandbox): add OpenSandbox environment support by @zpzjzj in #2054
• docs: improve citability with Zenodo concept DOI by @StevenDillmann in #2135
• Write trial locks and remove invocation from job locks by @alexgshaw in #2138
• Align log entry trial identity by @kobe0938 in #2137
• feat(langsmith): nest custom BaseAgent traces under the trial run by @nick-hollon-lc in #2129
• [Ready for Review] Adapter: OsWorld by @josancamon19 in #1836
• add viewer recording tab by @josancamon19 in #2117
• [codex] Upload trial locks and use lock task hash by @alexgshaw in #2140
• Add schema_version to TrialLock by @alexgshaw in #2149
• Render markdown files in task and trial viewers by @alexgshaw in #2154
• Add Beam sandbox provider by @luke-lombardi in #2151
• Add compileable task evaluation and auto-verification support by @alexgshaw in #2150
• Add opt-in Modal V2 sandbox support by @shariqm-modal in #2163
• feat(daytona): Add Daytona network policy support by @rovle in #2147
• Refine harbor exec file inference and help text by @alexgshaw in #2164
• fix(docker): fix chown target mismatch in rootless docker by @moogician in #2049
• Fix exec TOML config test by @kobe0938 in #2170
• Add trial lock coverage to harbor-langsmith publish tests by @alexgshaw in #2168
• fix(daytona): fall back to stopping sandbox when delete is denied by @kobe0938 in #2166

New Contributors

• @zpzjzj made their first contribution in #2054
• @luke-lombardi made their first contribution in #2151
• @moogician made their first contribution in #2049

Full Changelog: v0.16.1...v0.17.0

What's Changed

• Use minimal returning for download telemetry inserts by @alexgshaw in #2110
• feat(cli): add harbor job/trial init to scaffold run configs (#1908) by @walkerhughes in #2056
• Show reasoning content before duplicate messages by @alexgshaw in #2112
• fix(claude-code): tolerate None usage fields in _build_metrics by @crystalxyz in #2111
• Add collapsible reasoning blocks in trial viewer by @alexgshaw in #2116

New Contributors

• @walkerhughes made their first contribution in #2056

Full Changelog: v0.16.0...v0.16.1

What's Changed

• Add per-agent concurrency limits and agent-end hooks by @alexgshaw in #2014
• Add Blaxel network policy and DinD support by @mstolarzblaxelai in #1980
• feat(agents): propagate AgentConfig.env to all agent load paths by @EazyReal in #1967
• feat: mvp for run launcher directly in viewer by @kobe0938 in #2017
• feat: implement git repo skills by @LakshyAAAgrawal in #1909
• Skip uv download if already installed for mini swe agent by @milo-modal in #1952
• Remove dead Claude Agent SDK usage by @alexgshaw in #2023
• feat(atif): bring installed-agent trajectory converters to full ATIF v1.7 fidelity by @AlienKevin in #1888
• Add EC2 sandbox environment by @keuw in #2031
• [CI] Post adapter validation as a fresh timestamped comment by @crystalxyz in #2040
• Handle provider API usage limit errors by @alexgshaw in #2037
• add harbor run --install-only flag by @jkunstle in #1983
• ci: update to windows server 2025 by @xiaoxiangmoe in #2033
• fix(swe-agent): don't let testbed-conda.sh abort under set -u by @richardzhuang0412 in #2039
• feat: combine --agent-import-path into --agent by @kobe0938 in #1988
• test(pass-at-k): add unit tests for pass@k metric utility by @xyuzh in #2046
• fix(docker): fall back to tar upload when compose cp fails by @mattheliu in #1944
• feat(cli): add agent/verifier log-filter flags to harbor trial start by @xyuzh in #2047
• fix(openhands-sdk): use uv to pin Python >=3.12 for SDK venv by @neubig in #2041
• Api key auth by @scvance in #2062
• Network mode support for docker environment by @xiaoxiangmoe in #1799
• Preview task definition image files by @prabal-mercor in #2055
• Add bash action, start_url, and configurable IO dir to computer-1 by @RishiDesai in #2042
• fix(resume): tolerate empty/truncated result.json by @mvanhorn in #2053
• fix(cwsandbox): Default sandbox egress to public network mode by @matthoare117-wandb in #2066
• Fix Gemini CLI JSONL session handling by @RishiDesai in #2069
• Cap Anthropic cache_control breakpoints at 4 by @RishiDesai in #2072
• Harden Kimi CLI runtime configuration by @RishiDesai in #2070
• deps: pin transformers>=5.3.0 to fix CVE-2026-4372 by @donald-pinckney in #2004
• Fix mini-swe-agent ATIF steps for responses API by @henryre in #2073
• feat(launcher): multi-agent/multi-dataset run launcher w/ configs by @kobe0938 in #2057
• feat(env): add Cua Cloud environment for desktop VMs by @ddupont808 in #1957
• Add Codex web search CLI flag by @alexgshaw in #2032
• Reorganize example configs by category by @alexgshaw in #2083
• Add max_tokens support to MiniSweAgent by @alexgshaw in #2082
• Refine trial viewer typography and step detail interactions by @alexgshaw in #2077
• fix(langgraph): forward task-environment MCP servers to the graph by @nick-hollon-lc in #2085
• feat(agents): skip install when claude-code is already present + guard mkdir by @astefanutti in #1970
• feat: reload past run configs by @kobe0938 in #2076
• Link observation results to source tool calls by @alexgshaw in #2087
• feat(viewer): save launcher config as YAML by @kobe0938 in #2089
• Remove job plugins from config files by @alexgshaw in #2074
• Move verifier job options into a dedicated help panel by @alexgshaw in #2019
• feat(modal): add dynamic network policy switching by @cnnradams in #2003
• feat(modal): Toggle modal dynamic network configuration based on phase_network_policies by @cnnradams in #2092
• feat(rewardkit): opt-in cross-dimension aggregation for reward.json by @Kurry in #2010
• feat: launcher browse dataset path by @kobe0938 in #2093
• Fix Credential Deletion by @scvance in #2098
• [codex] Remove dead code paths by @alexgshaw in #2086
• rewardkit: add rubric metadata controls by @Kurry in #1847
• fix(docker): apply cpu/memory limits under docker compose by @mvanhorn in #2051
• Harbor Hub CLI Integration by @scvance in #2088
• fix(langgraph): respect UV_PRERELEASE env var for dependency installs by @nick-hollon-lc in #2064
• fix(langsmith): report token usage so experiment token columns populate by @Nickbohm555 in #2061
• feat(langgraph): auto-forward tracing and provider env vars to agent container by @nick-hollon-lc in #2063
• fix(terminus_2): emit ATIF context_management on summarization handoff step by @easyrider11 in #1844
• feat(rewardkit): register MCP servers for agent judges via mcp add by @benediktstroebl in #2008
• feat: id refactoring by @kobe0938 in #2091
• feat: model-name autocomplete from litellm by @kobe0938 in #2101
• Paginated trial downloading for hosted jobs by @scvance in #2100

New Contributors

• @milo-modal made their first contribution in #1952
• @keuw made their first contribution in #2031
• @xyuzh made their first contribution in #2046
• @mattheliu made their first contribution in #1944
• @prabal-mercor made their first contribution in #2055
• @mvanhorn made their first contribution in #2053
• @donald-pinckney made their first contribution in #2004
• @ddupont808 made their first contribution in #1957
• @astefanutti made their first contribution in #1970
• @Nickbohm555 made their first contribution in #2061
• @easyrider11 made their first contribution in #1844

Full Changelog: v0.15.0...v0.16.0

What's Changed

• fix(daytona): create workdir in sandbox if specified by @kobe0938 in #1953
• perf(registry): enumerate --repo tasks via git ls-tree by @alexgshaw in #1920
• Switch Modal filesystem checks to list_files by @alexgshaw in #1978
• fix(langgraph): harden dependency installation by @nick-hollon-lc in #1973
• fix(langgraph): preserve summary cancellation propagation by @nick-hollon-lc in #1974
• fix(langsmith): retry transient requests by @nick-hollon-lc in #1975
• feat: harborize harbor check by @kobe0938 in #1924
• Remove redundant network policy artifact declarations by @alexgshaw in #1979
• fix(langsmith,langgraph): tag traces with harbor runner by @nick-hollon-lc in #1976
• fix(modal): keep direct-mode sandbox alive with sleep infinity by @jkunstle in #1545
• fix(modal): create workdir in sandbox if specified by @kobe0938 in #1981
• fix(copilot-cli): parse Copilot's native session-event JSONL schema by @istocniks in #1985
• docs(adapters): fix stale parity_experiment.json filename in READMEs by @EazyReal in #1964
• feat(agents): add dspy.RLM agent by @EazyReal in #1965
• Retry Daytona process session creation by @rovle in #1954
• feat: harborize harbor analyze by @kobe0938 in #1984
• Tighten analysis section header spacing by @alexgshaw in #1987
• fix(mini-swe-agent): honor configured agent env for credentials by @EazyReal in #1968
• feat(trial): scoped log streaming via Trial.add_log_callback by @EazyReal in #1966
• rewardkit: honor individual mode for agent judges by @Kurry in #1793
• Add separate verifier network mode matrix demo by @xiaoxiangmoe in #1995
• Fix network-policy matrix artifact warnings by @xiaoxiangmoe in #1994
• feat(islo): auto-delete sandboxes after 1h and shield create on cancel by @AdamGold in #1990
• Add execute permissions to the executables of all example tasks. by @xiaoxiangmoe in #1996
• feat(tensorlake): prebuilt docker_image import, OCI build by default, and boot-path hardening by @cooleel in #1989
• Add sandbox label support to Modal environments by @alexgshaw in #1999
• For Modal - don't use host networking for vm runtime sandboxes by @shariqm-modal in #1998
• changelog for harborized check and analyze by @kobe0938 in #2001
• feat: harborize Generate Analysis on UI job-level by @kobe0938 in #2002
• Add Openshift Environment by @taagarwa-rh in #1875
• fix(modal): reuse env secrets across sandbox operations by @EazyReal in #1969
• Show cursor model names in viewer analysis by @alexgshaw in #2007
• fix(rewardkit): codex judge auto-logs-in from OPENAI_API_KEY by @benediktstroebl in #2009
• Add Eve agent implementation and task configs by @alexgshaw in #1982
• [codex] Fix dev typecheck extras by @alexgshaw in #2012
• [codex] Fix auth credentials storage writes by @alexgshaw in #2013

New Contributors

• @jkunstle made their first contribution in #1545
• @istocniks made their first contribution in #1985

Full Changelog: v0.14.0...v0.15.0

What's Changed

• fix(codex): skip install when codex is already available by @lux563624348 in #1848
• Network Policy: Clarify wildcard allowlist depth by @li-boxuan in #1854
• refactor: reduce memory usage by @xiaoxiangmoe in #1882
• rewardkit: support Claude subscription auth for judges by @Kurry in #1770
• #1850 updated default package download timeout from 20s to 120s by @scvance in #1883
• [CI] Allow WebFetch and WebSearch tool for review bot by @crystalxyz in #1887
• feat: add --repo flag for git-based dataset registries by @LakshyAAAgrawal in #1884
• fix(terminus-2): deliver oversized keys via tmux paste buffers by @alexgshaw in #1904
• feat: support include/exclude patterns for agent and verifier log downloads by @kobe0938 in #1889
• Add Runloop network policy launch support by @tode-rl in #1885
• Computer-1 by @erikqu in #1572
• Classify rate-limit agent failures as ApiRateLimitError (#1798) by @zeyusuntt in #1886
• Add sidecar artifact collection and verifier collect hooks by @rynewang in #1775
• fix(cli): hide removed task check and debug commands from help by @Vedant-Agarwal in #1923
• Add Network Allowlist environment capability to Modal by @cnnradams in #1932
• Remove deterministic OpenHands golden test by @alexgshaw in #1936
• fix(goose): keep token counts when trajectory write fails by @Vedant-Agarwal in #1933
• docs: add documentation for --repo git repository datasets by @LakshyAAAgrawal in #1906
• feat: add MiMo agent — Xiaomi's MiMoCode CLI with ATIF trajectory support by @RobinChiu in #1899
• feat(islo): support basic no-network policy by @AdamGold in #1935
• refactor(env): unify DinD compose providers on a shared service-ops/transfer layer by @rynewang in #1843
• Tighten verbose comments in rewardkit judges by @benediktstroebl in #1863
• Computer-1 Caching by @erikqu in #1939
• Network policy: allow empty allowlists; clarify wildcard for apex domain by @li-boxuan in #1940
• Add Daytona sandbox labels by @rovle in #1930
• fix(upload): avoid ambiguous primary rewards by @Zacklinkk in #1813
• fix: Fix E2B exec retry safety by @renyuanc in #1941
• Add strict type check by @xiaoxiangmoe in #1947
• Update ty from 0.0.19 to 0.0.49 by @xiaoxiangmoe in #1948
• Remove ruff from dependencies by @xiaoxiangmoe in #1951
• Add Blaxel cloud sandbox provider by @mstolarzblaxelai in #1643
• add support for modal vm runtime by @shariqm-modal in #1907
• docs: add Novita sandbox provider references by @Alex-yang00 in #1811
• Add configurable Claude Code permission mode by @alexgshaw in #1950
• Add Terminus viewer support for JSON payloads and split views by @alexgshaw in #1958

New Contributors

• @lux563624348 made their first contribution in #1848
• @scvance made their first contribution in #1883
• @LakshyAAAgrawal made their first contribution in #1884
• @tode-rl made their first contribution in #1885
• @erikqu made their first contribution in #1572
• @Vedant-Agarwal made their first contribution in #1923
• @cnnradams made their first contribution in #1932
• @RobinChiu made their first contribution in #1899
• @Zacklinkk made their first contribution in #1813
• @renyuanc made their first contribution in #1941
• @mstolarzblaxelai made their first contribution in #1643
• @shariqm-modal made their first contribution in #1907
• @Alex-yang00 made their first contribution in #1811

Full Changelog: v0.13.2...v0.14.0

What's Changed

• fix(gemini_cli): pre-select auth method for headless API-key/Vertex runs by @bleonard in #1794
• Fix installed agent ATIF exports by @li-boxuan in #1812
• Update Islo SDK integration by @SpektorY in #1824
• fix(job): disable Rich stdout/stderr redirect to avoid deadlocks by @alexgshaw in #1829
• Suppress litellm debug output unless --debug is enabled by @alexgshaw in #1828
• Open PR diff links in a new tab by @alexgshaw in #1831
• feat: GKE multi-container support via privileged DinD compose by @rynewang in #1773
• Add use.computer environment by @josancamon19 in #1834
• fix(pi): Reduce logging footprint by @taagarwa-rh in #1826
• Update mini-swe-agent to support reasoning effort and doesn't drop system prompt by @giansegato in #1837
• fix(check): accept all Claude auth methods, preferring the free subscription by @Kurry in #1766
• fix(env): tar-based directory transfers for Modal, Daytona, and GKE by @rynewang in #1838
• Add Docker Compose support to Novita by @jasonhp in #1830
• harbor-langsmith: persist run tags and dataset metadata by @nick-hollon-lc in #1808
• Support wildcard network allowlist hosts by @li-boxuan in #1840
• feat: add LangSmith sandbox environment by @langchain-infra in #1610
• rewardkit: add REWARDKIT_MODEL override for agent judges by @benediktstroebl in #1778
• Update Claude Code bootstrap installer URL by @xiaoxiangmoe in #1852
• Added cline v2 and ATIF Trajectory support by @arafatkatze in #1495
• feat(claude_code): support CLAUDE_FORCE_OAUTH on harbor run by @zeyusuntt in #1846
• Add built-in LangGraph agent by @nick-hollon-lc in #1807
• Add GPU support to the Daytona environment by @rovle in #1731
• Preserve tagged Docker images on delete by @xiaoxiangmoe in #1861
• Improve use.computer environment by @josancamon19 in #1853
• Add session ID to header for usage with vllm-router by @SumanthRH in #1855
• [CI] Fix adapter review bot for newer claude-code-action version by @crystalxyz in #1874
• Add Novita network policy support by @jasonhp in #1867
• add procps to prevent process crashes when claude-code call tree-kill by @xiaoxiangmoe in #1864
• Add generic ACP registry agent support by @ignatov in #1464

New Contributors

• @bleonard made their first contribution in #1794
• @SpektorY made their first contribution in #1824
• @nick-hollon-lc made their first contribution in #1808
• @langchain-infra made their first contribution in #1610
• @zeyusuntt made their first contribution in #1846
• @SumanthRH made their first contribution in #1855
• @ignatov made their first contribution in #1464

Full Changelog: v0.13.1...v0.13.2

What's Changed

• Add job plugin support and refactor Harbor Hub upload by @alexgshaw in #1762
• Add LangSmith callback integration by @hwchase17 in #1702
• Fail fast on Harbor Hub auth errors when using --upload by @alexgshaw in #1781
• claude_code: bundle one LLM turn into a single ATIF step (RFC-0001) by @AlienKevin in #1760
• fix(openclaw): Use --retry-all-errors flag only when available by @taagarwa-rh in #1789
• Add harbor leaderboard submit command by @rebekah-west in #1695
• fix: experiment sessions can now be found on reruns by @samecrowder in #1804
• ci: upgrade github actions to latest versions by @xiaoxiangmoe in #1819

New Contributors

• @hwchase17 made their first contribution in #1702
• @rebekah-west made their first contribution in #1695
• @samecrowder made their first contribution in #1804

Full Changelog: v0.13.0...v0.13.1

What's Changed

• claude_code: handle redacted_thinking content blocks by @AlienKevin in #1752
• claude_code: unwrap text content blocks in user-event tool_result loop by @AlienKevin in #1753
• fix(modal): default _ModalDirect.exec to non-login shell by @18vijayb in #1744
• Add viewer sign-in and sync auth with the CLI by @alexgshaw in #1755
• fix(claude-code): preserve user-message bytes in ATIF trajectory (drop .strip()) by @Mike-7777777 in #1724
• fix(opencode): include the user prompt as a user step in the ATIF trajectory by @Kurry in #1759
• Fix Claude Code trajectory conversion for duplicate session events by @wyatt-halluminate in #1741
• feat(gemini-cli): support Login with Google (oauth-personal) via credential upload by @Kurry in #1764
• Network mode and optional allowlist by @li-boxuan in #1455

New Contributors

• @18vijayb made their first contribution in #1744
• @Mike-7777777 made their first contribution in #1724
• @Kurry made their first contribution in #1759
• @wyatt-halluminate made their first contribution in #1741

Full Changelog: v0.9.0...v0.13.0