Issue upgrading google-cloud-bigquery version

[stephaniewang526]

Getting this error in a simple dependency upgrade:

[ERROR] Failed to execute goal on project google-cloud-bigquerystorage: Could not resolve dependencies for project com.google.cloud:google-cloud-bigquerystorage:jar:2.14.1-SNAPSHOT: Could not find artifact com.google.cloud:google-cloud-bigquerystorage:jar:2.14.1-SNAPSHOT -> [Help 1]

This started happening very recently.

[suztomo]

"-X" gives debug output in Maven.

~/java-bigquerystorage $ mvn install -B -V -ntp  -X \                                         git[branch:check_tutorial]
    -DskipTests=true \
    -Dmaven.javadoc.skip=true \
    -Dclirr.skip=true

...

[DEBUG] Goal:          org.apache.maven.plugins:maven-install-plugin:2.4:install (default-install)
[DEBUG] Style:         Regular
[DEBUG] Configuration: <?xml version="1.0" encoding="UTF-8"?>
<configuration>
  <artifact default-value="${project.artifact}"/>
  <attachedArtifacts default-value="${project.attachedArtifacts}"/>
  <createChecksum default-value="false">${createChecksum}</createChecksum>
  <localRepository>${localRepository}</localRepository>
  <packaging default-value="${project.packaging}"/>
  <pomFile default-value="${project.file}"/>
  <skip default-value="false">${maven.install.skip}</skip>
  <updateReleaseInfo default-value="false">${updateReleaseInfo}</updateReleaseInfo>
</configuration>
[DEBUG] =======================================================================
[DEBUG] Could not find metadata com.google.cloud:google-cloud-bigquerystorage:2.14.1-SNAPSHOT/maven-metadata.xml in local (/Users/suztomo/.m2/repository)
[DEBUG] Dependency collection stats {ConflictMarker.analyzeTime=319336, ConflictMarker.markTime=215664, ConflictMarker.nodeCount=514, ConflictIdSorter.graphTime=138154, ConflictIdSorter.topsortTime=51054, ConflictIdSorter.conflictIdCount=90, ConflictIdSorter.conflictIdCycleCount=0, ConflictResolver.totalTime=1802482, ConflictResolver.conflictItemCount=259, DefaultDependencyCollector.collectTime=106540419, DefaultDependencyCollector.transformTime=2625772}
[DEBUG] com.google.cloud:google-cloud-bigquerystorage:jar:2.14.1-SNAPSHOT
[DEBUG]    io.grpc:grpc-api:jar:1.46.0:compile
[DEBUG]       io.grpc:grpc-context:jar:1.46.0:compile (version managed from 1.46.0)
[DEBUG]       com.google.errorprone:error_prone_annotations:jar:2.13.1:compile (version managed from 2.10.0)
[DEBUG]    io.grpc:grpc-stub:jar:1.46.0:compile
[DEBUG]    io.grpc:grpc-protobuf:jar:1.46.0:compile
[DEBUG]       io.grpc:grpc-protobuf-lite:jar:1.46.0:compile (version managed from 1.46.0)
[DEBUG]    com.google.api:api-common:jar:2.2.0:compile
[DEBUG]       javax.annotation:javax.annotation-api:jar:1.3.2:compile (scope managed from runtime) (version managed from 1.3.2)
[DEBUG]       com.google.auto.value:auto-value-annotations:jar:1.9:compile (version managed from 1.9)
[DEBUG]    com.google.protobuf:protobuf-java:jar:3.20.1:compile
[DEBUG]    com.google.api.grpc:proto-google-common-protos:jar:2.8.3:compile
[DEBUG]    com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta1:jar:0.138.1-SNAPSHOT:compile
[DEBUG]    com.google.api.grpc:proto-google-cloud-bigquerystorage-v1beta2:jar:0.138.1-SNAPSHOT:compile
[DEBUG]    com.google.api.grpc:proto-google-cloud-bigquerystorage-v1:jar:2.14.1-SNAPSHOT:compile
[DEBUG]    com.google.guava:guava:jar:31.1-jre:compile
[DEBUG]       com.google.guava:failureaccess:jar:1.0.1:compile
[DEBUG]       com.google.guava:listenablefuture:jar:9999.0-empty-to-avoid-conflict-with-guava:compile
[DEBUG]       org.checkerframework:checker-qual:jar:3.22.0:compile (version managed from 3.12.0)
[DEBUG]       com.google.j2objc:j2objc-annotations:jar:1.3:compile
[DEBUG]    com.google.api:gax:jar:2.18.1:compile
[DEBUG]       com.google.auth:google-auth-library-credentials:jar:1.7.0:compile (version managed from 1.6.0)
[DEBUG]       com.google.auth:google-auth-library-oauth2-http:jar:1.7.0:compile (version managed from 1.6.0)
[DEBUG]       io.opencensus:opencensus-api:jar:0.31.1:runtime (version managed from 0.28.0)
[DEBUG]    com.google.api:gax-grpc:jar:2.18.1:compile
[DEBUG]       io.grpc:grpc-alts:jar:1.46.0:runtime (version managed from 1.46.0)
[DEBUG]       io.grpc:grpc-auth:jar:1.46.0:runtime (version managed from 1.46.0)
[DEBUG]       io.grpc:grpc-netty-shaded:jar:1.46.0:runtime (version managed from 1.46.0)
[DEBUG]       io.grpc:grpc-googleapis:jar:1.46.0:runtime (version managed from 1.46.0)
[DEBUG]    org.threeten:threetenbp:jar:1.6.0:compile
[DEBUG]    org.json:json:jar:20200518:compile
[DEBUG]    junit:junit:jar:4.13.2:test
[DEBUG]       org.hamcrest:hamcrest-core:jar:1.3:test
[DEBUG]    com.google.truth:truth:jar:1.1.3:test
[DEBUG]       org.ow2.asm:asm:jar:9.1:test
[DEBUG]    org.mockito:mockito-all:jar:1.10.19:test
[DEBUG]    org.apache.avro:avro:jar:1.11.0:test
[DEBUG]       com.fasterxml.jackson.core:jackson-core:jar:2.13.3:test (version managed from 2.12.5)
[DEBUG]       com.fasterxml.jackson.core:jackson-databind:jar:2.13.3:test (version managed from 2.12.5)
[DEBUG]       org.apache.commons:commons-compress:jar:1.21:test
[DEBUG]       org.slf4j:slf4j-api:jar:1.7.32:test
[DEBUG]    io.grpc:grpc-testing:jar:1.46.0:test
[DEBUG]    com.google.cloud:google-cloud-bigquery:jar:2.12.0:test
[DEBUG]       com.google.protobuf:protobuf-java-util:jar:3.20.1:compile (version managed from 3.20.1)
[DEBUG]       com.google.api.grpc:proto-google-iam-v1:jar:1.3.4:compile (version managed from 1.3.4)
[DEBUG]       com.google.http-client:google-http-client-gson:jar:1.41.8:compile (version managed from 1.41.8)
[DEBUG]       com.google.cloud:google-cloud-core-http:jar:2.7.1:test (version managed from 2.7.1)
[DEBUG]       com.google.api-client:google-api-client:jar:1.34.1:test (version managed from 1.34.1)
[DEBUG]       com.google.oauth-client:google-oauth-client:jar:1.33.3:test (version managed from 1.33.3)
[DEBUG]       com.google.http-client:google-http-client-apache-v2:jar:1.41.8:test (version managed from 1.41.8)
[DEBUG]       com.google.http-client:google-http-client-appengine:jar:1.41.8:test (version managed from 1.41.8)
[DEBUG]       com.google.api:gax-httpjson:jar:0.103.1:test (version managed from 0.103.1)
[DEBUG]       io.opencensus:opencensus-contrib-http-util:jar:0.31.1:test (version managed from 0.31.1)
[DEBUG]       com.google.http-client:google-http-client-jackson2:jar:1.41.8:test (version managed from 1.41.8)
[DEBUG]       com.google.http-client:google-http-client:jar:1.41.8:compile (version managed from 1.41.8)
[DEBUG]       org.apache.httpcomponents:httpclient:jar:4.5.13:test (version managed from 4.5.13)
[DEBUG]       org.apache.httpcomponents:httpcore:jar:4.4.15:test (version managed from 4.4.15)
[DEBUG]       org.checkerframework:checker-compat-qual:jar:2.5.5:test
[DEBUG]       com.google.apis:google-api-services-bigquery:jar:v2-rev20220507-1.32.1:test
[DEBUG]       com.google.code.gson:gson:jar:2.9.0:runtime (version managed from 2.9.0)
[DEBUG]       org.threeten:threeten-extra:jar:1.7.0:test
[DEBUG]       com.google.cloud:google-cloud-bigquerystorage:jar:2.14.1-SNAPSHOT:test (version managed from 2.14.0)
[DEBUG]       io.grpc:grpc-grpclb:jar:1.46.0:runtime (version managed from 1.46.0)
[DEBUG]       org.conscrypt:conscrypt-openjdk-uber:jar:2.5.1:runtime
[DEBUG]       com.google.android:annotations:jar:4.1.1.4:runtime
[DEBUG]       org.codehaus.mojo:animal-sniffer-annotations:jar:1.21:runtime (version managed from 1.21)
[DEBUG]       io.perfmark:perfmark-api:jar:0.25.0:runtime
[DEBUG]       commons-logging:commons-logging:jar:1.2:test
[DEBUG]       commons-codec:commons-codec:jar:1.15:test (version managed from 1.15)
[DEBUG]       org.apache.arrow:arrow-vector:jar:8.0.0:test
[DEBUG]       org.apache.arrow:arrow-format:jar:8.0.0:test
[DEBUG]       com.fasterxml.jackson.core:jackson-annotations:jar:2.13.3:test (version managed from 2.13.3)
[DEBUG]       com.fasterxml.jackson.datatype:jackson-datatype-jsr310:jar:2.13.3:test (version managed from 2.13.3)
[DEBUG]       io.netty:netty-common:jar:4.1.72.Final:test
[DEBUG]       com.google.flatbuffers:flatbuffers-java:jar:1.12.0:test
[DEBUG]       org.apache.arrow:arrow-memory-core:jar:8.0.0:test
[DEBUG]       org.apache.arrow:arrow-memory-netty:jar:8.0.0:test
[DEBUG]       io.netty:netty-buffer:jar:4.1.72.Final:test
[DEBUG]    com.google.code.findbugs:jsr305:jar:3.0.2:compile
[DEBUG]    io.grpc:grpc-core:jar:1.46.0:compile
[DEBUG]    com.google.cloud:google-cloud-core:jar:2.7.1:compile
[DEBUG]    com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta1:jar:0.138.1-SNAPSHOT:compile
[DEBUG]    com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1beta2:jar:0.138.1-SNAPSHOT:compile
[DEBUG]    com.google.api.grpc:grpc-google-cloud-bigquerystorage-v1:jar:2.14.1-SNAPSHOT:compile
[DEBUG]    com.google.api:gax-grpc:jar:testlib:2.18.1:test
[DEBUG] Could not find metadata com.google.cloud:google-cloud-bigquerystorage:2.14.1-SNAPSHOT/maven-metadata.xml in local (/Users/suztomo/.m2/repository)
[DEBUG] Resolving artifact com.google.cloud:google-cloud-bigquerystorage:jar:2.14.1-SNAPSHOT from [central (https://repo.maven.apache.org/maven2, default, releases)]

google-cloud-bigquery (scope: test) depending on google-cloud-bigquerystorage seems suspicious:

[DEBUG]    com.google.cloud:google-cloud-bigquery:jar:2.12.0:test
...
[DEBUG]       com.google.cloud:google-cloud-bigquerystorage:jar:2.14.1-SNAPSHOT:test (version managed from 2.14.0)

New Dependency?

com.google.cloud:google-cloud-bigquery:2.10.10 didn't have google-cloud-bigquerystorage dependency.

com.google.cloud:google-cloud-bigquery:2.12.0 has new google-cloud-bigquerystorage dependency.

[stephaniewang526]

cc @yirutang as FYI

[suztomo]

How about this, when using google-cloud-bigquery in tests?

<dependency>
  <groupId>com.google.cloud</groupId>
  <artifactId>google-cloud-bigquery</artifactId>
  <version>2.12.0</version>  
  <scope>test</scope>
  <exclusions>
    <exclusion>
      <groupId>com.google.cloud</groupId>
      <artifactId>google-cloud-bigquerystorage</artifactId>

[stephaniewang526]

This works, thank you!