Skip to content

feat(bigquery): add bigquery_read_biglake_gcs_storage_api sample to r… - #14739

Open
iennae wants to merge 1 commit into
mainfrom
feat/bq-read-biglake-gcs-storage-api
Open

iennae wants to merge 1 commit into
mainfrom
feat/bq-read-biglake-gcs-storage-api

Conversation

@iennae

@iennae iennae commented Nov 2, 2026

Copy link
Copy Markdown
Contributor

…ead a BigLake Cloud Storage table via BigQuery Storage Read API

Problem:
The BigQuery documentation (https://cloud.google.com/bigquery/docs/query-cloud-storage-using-biglake) needs a standalone, tested Python code sample demonstrating how to read a BigLake Cloud Storage table via BigQuery Storage Read API (region tag bigquery_read_biglake_gcs_storage_api).

Solution:

  • Add read_biglake_gcs_storage_api(project_id: str, dataset_id: str, table_id: str) -> None in bigquery/biglake/bigquery_read_biglake_gcs_storage_api.py (Stream rows from a BigLake table backed by Cloud Storage using the BigQuery Storage Read API client.)
  • Add unit tests (bigquery/biglake/bigquery_read_biglake_gcs_storage_api_test.py) covering both the success path and API error handling (GoogleAPICallError)

Description

Fixes #

Checklist

Testing

  • I have tested this change on a live environment and verified it works as intended.

Compliance & Style


Post-Approval Actions

  • Please merge this PR for me once it is approved

@iennae
iennae requested review from a team and chalmerlowe as code owners November 2, 2026 23:23
@product-auto-label product-auto-label Bot added the api: bigquery Issues related to the BigQuery API. label Nov 2, 2026
@snippet-bot

snippet-bot Bot commented Nov 2, 2026 •

Copy link
Copy Markdown

Here is the summary of changes.

You are about to add 1 region tag.

This comment is generated by snippet-bot.
If you find problems with this result, please file an issue at:
https://github.com/googleapis/repo-automation-bots/issues.
To update this comment, add snippet-bot:force-run label or use the checkbox below:

  • Refresh this comment

@product-auto-label product-auto-label Bot added the samples Issues that are directly related to samples. label Nov 2, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new sample script and tests for reading projected columns from a BigLake table using the BigQuery Storage Read API. The feedback suggests updating the test configuration in noxfile_config.py to ensure only the oldest (3.10) and newest (3.13) supported Python versions are tested, ignoring intermediate versions like 3.11 and 3.12.


TEST_CONFIG_OVERRIDE = {
# You can opt out from the test for specific Python versions.
"ignored_versions": ["2.7", "3.7", "3.8", "3.9", "3.10", "3.11"],

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

According to the repository's testing rules, you should only test the oldest and newest supported Python releases in test configurations, ignoring intermediate versions. Since Python 3.10 is the oldest supported version (as indicated by requirements-test.txt) and Python 3.13 is the newest, you should test 3.10 and 3.13, and ignore intermediate versions like 3.11 and 3.12.

Suggested change
"ignored_versions": ["2.7", "3.7", "3.8", "3.9", "3.10", "3.11"],
"ignored_versions": ["2.7", "3.7", "3.8", "3.9", "3.11", "3.12"],
References
  1. Only test the oldest and newest supported Python releases in test configurations (such as noxfile_config.py), ignoring intermediate versions.

@iennae
iennae force-pushed the feat/bq-read-biglake-gcs-storage-api branch 2 times, most recently from 0d85b5f to 66dc90a Compare November 3, 2026 02:44
…ead a BigLake Cloud Storage table via BigQuery Storage Read API

Problem:
The BigQuery documentation (https://cloud.google.com/bigquery/docs/query-cloud-storage-using-biglake)
needs a standalone, tested Python code sample demonstrating how to
read a BigLake Cloud Storage table via BigQuery Storage Read API (region tag `bigquery_read_biglake_gcs_storage_api`).

Solution:
- Add `read_biglake_gcs_storage_api(project_id: str, dataset_id: str, table_id: str) -> None` in `bigquery/biglake/bigquery_read_biglake_gcs_storage_api.py`
  (Stream rows from a BigLake table backed by Cloud Storage using the BigQuery Storage Read API client.)
- Add unit tests (`bigquery/biglake/bigquery_read_biglake_gcs_storage_api_test.py`) covering both the success
  path and API error handling (`GoogleAPICallError`)
@iennae
iennae force-pushed the feat/bq-read-biglake-gcs-storage-api branch from 66dc90a to 2a845cf Compare November 3, 2026 23:32

@XrossFox XrossFox left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a dependency on the requirements file that doesnt seem to be available on Pypi.

Comment thread bigquery/biglake/requirements.txt Resolved

@XrossFox XrossFox left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: bigquery Issues related to the BigQuery API. samples Issues that are directly related to samples.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants