Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: lambda-feedback/Database-Testing
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: fix/sample-before-aggregate
Choose a base ref
...
head repository: lambda-feedback/Database-Testing
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref
Checking mergeability… Don’t worry, you can still create the pull request.
  • 2 commits
  • 7 files changed
  • 2 contributors

Commits on Oct 29, 2026

  1. Add --submission_ids_csv to replay specific submissions instead of …

    …a random sample
    
    `fetch_data` takes `included_ids`, which restricts the query to those submissions and skips the one-year date cut-off. With a list, `start_test` ignores `--sql_limit` and the exclusion list; gradeParams filters still apply. Used to retry the HTTP 503s from a run via its `analyze_run.py` CSV export.
    
    Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
    m-messer and claude committed Oct 29, 2026
    Configuration menu
    Copy the full SHA
    9ab509f View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2026

  1. Handle non-string answers in legacy payloads and record unexpected wo…

    …rker exceptions as errors
    
    Array-valued answers (e.g. arraySymbolicEqual) raised AttributeError on `.replace`, and
    asyncio.gather swallowed it, so every record silently dropped out of all counts.
    
    Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
    m-messer and claude committed Nov 2, 2026
    Configuration menu
    Copy the full SHA
    8b8c5c7 View commit details
    Browse the repository at this point in the history
Loading