Skip to content

feat: removed missing_recommended_column and related annotation + changed missing_timepoint_value notice description - #1963

Merged
cka-y merged 4 commits into
masterfrom
feat/1908-2
Feb 4, 2025
Merged

cka-y merged 4 commits into
masterfrom
feat/1908-2

Conversation

@cka-y

@cka-y cka-y commented Feb 4, 2025 •

Copy link
Copy Markdown
Contributor

Summary:

Closes #1908
This PR involves the removal of the MissingRecommendedColumnNotice class and associated logic for handling recommended columns throughout the codebase.

image

Please make sure these boxes are checked before submitting your pull request - thanks!

@github-actions

github-actions Bot commented Feb 4, 2025

Copy link
Copy Markdown
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit f8ea86f
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.67 3.76 ⬆️+0.09
Median -- 1.37 1.41 ⬆️+0.04
Standard Deviation -- 10.44 10.60 ⬆️+0.16
Minimum in References Reports us-oregon-high-desert-point-gtfs-636 0.48 0.61 ⬆️+0.14
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 279.87 287.03 ⬆️+7.16
Minimum in Latest Reports us-michigan-detroit-people-mover-gtfs-417 0.50 0.51 ⬆️+0.01
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 279.87 287.03 ⬆️+7.16
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 465.45 MiB 468.32 MiB ⬆️+2.88 MiB
Median -- 333.92 MiB 332.38 MiB ⬇️-1.54 MiB
Standard Deviation -- 756.78 MiB 777.51 MiB ⬆️+20.73 MiB
Minimum in References Reports us-ohio-allen-county-regional-transit-authority-gtfs-210 39.51 MiB 52.27 MiB ⬆️+12.76 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.93 GiB 10.93 GiB ⬆️+5.38 MiB
Minimum in Latest Reports us-california-yubasutter-transit-gtfs-79 41.67 MiB 39.98 MiB ⬇️-1.69 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.93 GiB 10.93 GiB ⬆️+5.38 MiB

@davidgamez

Copy link
Copy Markdown
Member

As the notice and all associated code are removed, let's remove the RecommendedColumn annotation to make sure it is not used without the supporting code.

@github-actions

github-actions Bot commented Feb 4, 2025

Copy link
Copy Markdown
Contributor

📝 Acceptance Test Report

📋 Summary

✅ The rule acceptance has passed for commit 9c3bb16
Download the full acceptance test report here (report will disappear after 90 days).

📊 Notices Comparison

New Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Errors (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

New Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

Dropped Warnings (0 out of 1801 datasets, ~0%) ✅

No changes were detected due to the code change.

🛡️ Corruption Check

0 out of 1801 sources (~0 %) are corrupted.

⏱️ Performance Assessment

📈 Validation Time

Assess the performance in terms of seconds taken for the validation process.

Time Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 3.64 3.67 ⬆️+0.04
Median -- 1.34 1.38 ⬆️+0.04
Standard Deviation -- 10.36 10.33 ⬇️-0.03
Minimum in References Reports us-oregon-high-desert-point-gtfs-636 0.47 0.49 ⬆️+0.01
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 281.85 277.55 ⬇️-4.30
Minimum in Latest Reports us-california-city-of-wasco-gtfs-1788 0.51 0.47 ⬇️-0.04
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 281.85 277.55 ⬇️-4.30
📜 Memory Consumption
Metric Dataset ID Reference (s) Latest (s) Difference (s)
Average -- 460.20 MiB 460.53 MiB ⬆️+338.28 KiB
Median -- 333.58 MiB 331.92 MiB ⬇️-1.66 MiB
Standard Deviation -- 735.28 MiB 750.26 MiB ⬆️+14.98 MiB
Minimum in References Reports ro-vrancea-consiliul-judetean-vrancea-gtfs-1984 38.22 MiB 40.05 MiB ⬆️+1.83 MiB
Maximum in Reference Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.62 GiB 11.01 GiB ⬆️+399.15 MiB
Minimum in Latest Reports ca-prince-edward-island-t3-transit-gtfs-2132 411.92 MiB 39.57 MiB ⬇️-372.35 MiB
Maximum in Latest Reports gb-unknown-uk-aggregate-feed-gtfs-2014 10.62 GiB 11.01 GiB ⬆️+399.15 MiB

@davidgamez davidgamez left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@cka-y
cka-y merged commit d0b5263 into master Feb 4, 2025
@cka-y
cka-y deleted the feat/1908-2 branch February 4, 2025 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Remove missing_recommended_column notice

2 participants