Repository navigation
About dataset overlap #3
Description
On which dataset did you conduct the evaluation? Acoording to https://arxiv.org/abs/2312.06420, the train, test and eval scenarios of Nuscenes/Argoverse dataset have geographical overlap which may cause data leakage.
Activity
mapbench commentedon Jul 9, 2024
Hi @zyandtom, thanks for your interest in MapBench!
MapBench is constructed by corrupting the val set of nuScenes. We chose nuScenes since it has been widely utilized among almost all recent HD map construction works.