Bug: d2d fails on tomcat-catalina-11.0.2

[DennisClark]

Running SCIO v34.9.3
Created new project and specified download URLs:
https://repo1.maven.org/maven2/org/apache/tomcat/tomcat-catalina/11.0.2/tomcat-catalina-11.0.2-sources.jar#from
https://repo1.maven.org/maven2/org/apache/tomcat/tomcat-catalina/11.0.2/tomcat-catalina-11.0.2.jar#to
and selected the map_deploy_to_develop pipeline

Log output:

2025-01-20 19:24:15.403 Pipeline [map_deploy_to_develop] starting
2025-01-20 19:24:15.406 Step [download_missing_inputs] starting
2025-01-20 19:24:15.409 Fetching input from https://repo1.maven.org/maven2/org/apache/tomcat/tomcat-catalina/11.0.2/tomcat-catalina-11.0.2-sources.jar#from
2025-01-20 19:24:15.462 Fetching input from https://repo1.maven.org/maven2/org/apache/tomcat/tomcat-catalina/11.0.2/tomcat-catalina-11.0.2.jar#to
2025-01-20 19:24:15.505 Step [download_missing_inputs] completed in 0 seconds
2025-01-20 19:24:15.508 Step [get_inputs] starting
2025-01-20 19:24:15.511 Step [get_inputs] completed in 0 seconds
2025-01-20 19:24:15.514 Step [extract_inputs_to_codebase_directory] starting
2025-01-20 19:24:16.765 Step [extract_inputs_to_codebase_directory] completed in 1 seconds
2025-01-20 19:24:16.768 Step [extract_archives] starting
2025-01-20 19:24:26.893 Step [extract_archives] completed in 10 seconds
2025-01-20 19:24:26.903 Step [collect_and_create_codebase_resources] starting
2025-01-20 19:24:31.965 Step [collect_and_create_codebase_resources] completed in 5 seconds
2025-01-20 19:24:31.967 Step [fingerprint_codebase_directories] starting
2025-01-20 19:24:32.342 Step [fingerprint_codebase_directories] completed in 0 seconds
2025-01-20 19:24:32.344 Step [flag_empty_files] starting
2025-01-20 19:24:32.355 Step [flag_empty_files] completed in 0 seconds
2025-01-20 19:24:32.358 Step [flag_whitespace_files] starting
2025-01-20 19:24:32.362 Step [flag_whitespace_files] completed in 0 seconds
2025-01-20 19:24:32.365 Step [flag_ignored_resources] starting
2025-01-20 19:24:32.380 Step [flag_ignored_resources] completed in 0 seconds
2025-01-20 19:24:32.383 Step [map_about_files] starting
2025-01-20 19:24:32.386 Step [map_about_files] completed in 0 seconds
2025-01-20 19:24:32.388 Step [map_checksum] starting
2025-01-20 19:24:32.401 Mapping 1,279 to/ resources using sha1 against from/ codebase
2025-01-20 19:24:32.724 Progress: 10% (128/1279) ETA: 3 seconds
2025-01-20 19:24:33.004 Progress: 20% (256/1279) ETA: 2 seconds
2025-01-20 19:24:33.283 Progress: 30% (384/1279) ETA: 2 seconds
2025-01-20 19:24:33.616 Progress: 40% (512/1279) ETA: 2 seconds
2025-01-20 19:24:33.908 Progress: 50% (640/1279) ETA: 2 seconds
2025-01-20 19:24:34.194 Progress: 60% (768/1279) ETA: 1 seconds
2025-01-20 19:24:34.491 Progress: 70% (896/1279) ETA: 1 seconds
2025-01-20 19:24:34.711 Progress: 80% (1024/1279) ETA: 1 seconds
2025-01-20 19:24:34.984 Progress: 90% (1152/1279)
2025-01-20 19:24:35.288 Progress: 100% (1279/1279)
2025-01-20 19:24:35.294 Step [map_checksum] completed in 3 seconds
2025-01-20 19:24:35.297 Step [match_archives_to_purldb] starting
2025-01-20 19:24:35.424 Skipping matching for .jar, .war, .zip resources, as there are 0
2025-01-20 19:24:35.434 0 resources matched in PurlDB using 0 SHA1s
2025-01-20 19:24:35.436 Step [match_archives_to_purldb] completed in 0 seconds
2025-01-20 19:24:35.438 Step [find_java_packages] starting
2025-01-20 19:24:35.475 Finding Java package for 0 .java resources.
2025-01-20 19:24:35.554 Step [find_java_packages] completed in 0 seconds
2025-01-20 19:24:35.557 Step [map_java_to_class] starting
2025-01-20 19:24:35.567 Mapping 643 .class resources to .java
2025-01-20 19:24:35.621 Pipeline failed

Task output

not an automaton yet; add some words and call make_automaton

Traceback:
  File "/opt/scancodeio/aboutcode/pipeline/__init__.py", line 199, in execute
    step(self)
  File "/opt/scancodeio/scanpipe/pipelines/deploy_to_develop.py", line 184, in map_java_to_class
    d2d.map_java_to_class(project=self.project, logger=self.log)
  File "/opt/scancodeio/scanpipe/pipes/d2d.py", line 215, in map_java_to_class
    _map_java_to_class_resource(to_resource, from_resources, from_classes_index)
  File "/opt/scancodeio/scanpipe/pipes/d2d.py", line 166, in _map_java_to_class_resource
    match = pathmap.find_paths(path=normalized_java_path, index=from_classes_index)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/scancodeio/scanpipe/pipes/pathmap.py", line 84, in find_paths
    matches = list(index.iter_long(reversed_path))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

[DennisClark]

Experienced the same issue with tomcat-jasper-11.0.2

[tdruez]

@DennisClark Fix implemented in #1554
Merged and released as https://github.com/aboutcode-org/scancode.io/releases/tag/v34.9.4