Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source Oracle: discover schema fails when database have hundreds of tables or views #11113

Open
luisvilla1000 opened this issue Mar 14, 2022 · 0 comments
Labels
autoteam community connectors/source/oracle frozen Not being actively worked on team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working

Comments

@luisvilla1000
Copy link

Environment

  • Airbyte version: 0.35.53-alpha
  • OS Version / Instance: AWS EC2
  • Deployment: Docker
  • Source Connector and version: Oracle 0.3.14
  • Destination Connector and version: S3 0.1.10
  • Severity: High
  • Step where error happened: Setup new connection

Current Behavior

I have an Oracle database with a schema with hundreds of tables and views.

When I try to configure a new connection, the process aborts without any log error or message (only message showed is: "Failed to fetch schema. Please try again"). The only error shown in the logs is below.

I can't find another log or message that can give more information about the error.

Note: the error is always displayed about 70 seconds after the process has started. I suspect it may be a connection timeout.

Expected Behavior

Fetch the schema or on error show a descriptive error

Logs

Logs are not displayed in the graphical interface. I got them from the docker-compose log.

LOG

airbyte-worker      | 2022-03-14 16:06:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
airbyte-worker      | 2022-03-14 16:06:57 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
airbyte-server      | 2022-03-14 16:07:13 INFO i.a.s.RequestLogger(filter):95 - REQ 172.20.0.8 POST 200 /api/v1/web_backend/connections/get - {"connectionId":"8fac660e-8618-42bc-83e4-a7b284675f01","withRefreshedCatalog":true}
airbyte-server      | Mar 14, 2022 4:10:23 PM org.glassfish.jersey.server.ServerRuntime$Responder writeResponse
airbyte-server      | SEVERE: An I/O error has occurred while writing a response message entity to the container output stream.
airbyte-server      | org.glassfish.jersey.server.internal.process.MappableException: org.eclipse.jetty.io.EofException
airbyte-server      |   at org.glassfish.jersey.server.internal.MappableExceptionWrapperInterceptor.aroundWriteTo(MappableExceptionWrapperInterceptor.java:67)
airbyte-server      |   at org.glassfish.jersey.message.internal.WriterInterceptorExecutor.proceed(WriterInterceptorExecutor.java:139)
airbyte-server      |   at org.glassfish.jersey.message.internal.MessageBodyFactory.writeTo(MessageBodyFactory.java:1116)
airbyte-server      |   at org.glassfish.jersey.server.ServerRuntime$Responder.writeResponse(ServerRuntime.java:638)
airbyte-server      |   at org.glassfish.jersey.server.ServerRuntime$Responder.processResponse(ServerRuntime.java:371)
airbyte-server      |   at org.glassfish.jersey.server.ServerRuntime$Responder.process(ServerRuntime.java:361)
airbyte-server      |   at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:256)

Steps to Reproduce

  1. Configure a Oracle source with hundreds of tables
  2. Configure a any destination (I tried with S3, Redshift and MySQL)
  3. Setup a Connection Oracle with a destination

Are you willing to submit a PR?

No

@luisvilla1000 luisvilla1000 added needs-triage type/bug Something isn't working labels Mar 14, 2022
@bleonard bleonard added autoteam team/tse Technical Support Engineers labels Apr 27, 2022
@marcosmarxm marcosmarxm changed the title Oracle - Discover schema fails when database have hundreds of tables or views Source Oracle: discover schema fails when database have hundreds of tables or views Nov 30, 2022
@marcosmarxm marcosmarxm added connectors/source/oracle team/db-dw-sources Backlog for Database and Data Warehouse Sources team and removed needs-triage team/tse Technical Support Engineers labels Nov 30, 2022
@bleonard bleonard added the frozen Not being actively worked on label Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
autoteam community connectors/source/oracle frozen Not being actively worked on team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants