Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source BigQuery: allow to be in a different project #10311

Open
kattos-aws opened this issue Feb 14, 2022 · 0 comments
Open

Source BigQuery: allow to be in a different project #10311

kattos-aws opened this issue Feb 14, 2022 · 0 comments
Labels
area/databases community connectors/source/bigquery frozen Not being actively worked on team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/enhancement New feature or request

Comments

@kattos-aws
Copy link
Contributor

Tell us about the problem you're trying to solve

I am trying to ingest data from a publicly available dataset on BigQuery (namely the bitcoin dataset).
This dataset is located in a project I am not owner of.

When I setup the BigQuery source connector and run it, I get the following error:

com.google.cloud.bigquery.BigQueryException: Access Denied: Project bigquery-public-data: User does
 not have bigquery.jobs.create permission in project bigquery-public-data.

I am able to query the dataset through the GCP console.

Describe the solution you’d like

I would like to be able to ingest the same through Airbyte.

Describe the alternative you’ve considered or used

None so far, suggestions would be welcome. I could have a job replicating the data into a project I own, but that is rather inconvenient, and incurs costs especially if the dataset is big.

Additional context

N/A

Are you willing to submit a PR?

Sorry, I can't commit to this due to lack of time.

@kattos-aws kattos-aws added needs-triage type/enhancement New feature or request labels Feb 14, 2022
@bleonard bleonard added autoteam team/tse Technical Support Engineers labels Apr 26, 2022
@grishick grishick added the team/db-dw-sources Backlog for Database and Data Warehouse Sources team label Sep 27, 2022
@marcosmarxm marcosmarxm changed the title Allow BigQuery source to be in a different project Source BigQuery: allow to be in a different project Nov 30, 2022
@bleonard bleonard added the frozen Not being actively worked on label Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/databases community connectors/source/bigquery frozen Not being actively worked on team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants