Skip to content

JSON Schema Draft 2020-12 Test Suite - Known Failing Tests #62

@simbo1905

Description

@simbo1905

This issue tracks the known failing tests in the JSON Schema Draft 2020-12 Test Suite that are currently being skipped.

Test Results

  • Total Tests: 3472
  • Passed: 2048
  • Failed: 0 (after skipping)
  • Skipped: 1424

Known Failing Tests

The following tests are skipped due to known implementation issues:

Reference Resolution Issues (6 tests)

  • ref.json#relative pointer ref to array#match array
  • ref.json#relative pointer ref to array#mismatch array
  • refOfUnknownKeyword.json#reference of a root arbitrary keyword #match
  • refOfUnknownKeyword.json#reference of a root arbitrary keyword #mismatch
  • refOfUnknownKeyword.json#reference of an arbitrary keyword of a sub-schema#match
  • refOfUnknownKeyword.json#reference of an arbitrary keyword of a sub-schema#mismatch

JSON Parsing Issues (2 tests)

  • required.json#required with escaped characters#object with all properties present is valid
  • required.json#required with escaped characters#object with some properties missing is invalid

Additional Context

The 2020-12 test suite has many more tests that show as "Mismatch (ignored)" in lenient mode, but these are the only tests that actually throw exceptions and would cause build failures if not skipped.

Root Causes

  1. **Unresolved **: Reference resolution issues with prefixItems and unknown keywords
  2. Duplicate member names: JSON parser limitations with escaped characters in object keys

Implementation Status

These tests are currently skipped using Assumptions.assumeTrue(false, ...) to prevent build failures while maintaining test coverage for passing tests.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions