Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python BQ] Retry get_table for quota errors #28820

Merged
merged 18 commits into from
Jan 8, 2024
Merged

[Python BQ] Retry get_table for quota errors #28820

Changes from 1 commit
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
e31b93b
retry get_table on quota errors
ahmedabu98 Oct 4, 2023
ad464b1
add tests
ahmedabu98 Oct 4, 2023
dece14d
tweak test
ahmedabu98 Oct 4, 2023
b3b58c6
remove comments
ahmedabu98 Oct 4, 2023
7f7a6b8
use httperror
ahmedabu98 Oct 4, 2023
753bc67
only retry on transient reasons
ahmedabu98 Oct 4, 2023
be35778
default exceptions to none at import error
ahmedabu98 Oct 4, 2023
06e3f80
lint fix
ahmedabu98 Oct 5, 2023
351e6e5
lint fix
ahmedabu98 Oct 5, 2023
929db63
Merge branch 'master' of https://github.com/ahmedabu98/beam into get_…
ahmedabu98 Oct 5, 2023
604a836
address comments
ahmedabu98 Oct 5, 2023
bfdc47c
fix tests
ahmedabu98 Oct 6, 2023
b5d671d
deserialize content first
ahmedabu98 Dec 6, 2023
e64019f
lint
ahmedabu98 Dec 19, 2023
45846c6
ignore tests when imports fail, only json load when needed
ahmedabu98 Jan 8, 2024
d70b1a8
default HttpForbiddenError to none
ahmedabu98 Jan 8, 2024
a7c1e1d
default to none when import fails
ahmedabu98 Jan 8, 2024
4992a83
default to non when import fails
ahmedabu98 Jan 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion sdks/python/apache_beam/io/gcp/bigquery_tools.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -747,7 +747,7 @@ def _insert_all_rows(

@retry.with_exponential_backoff(
num_retries=MAX_RETRIES,
retry_filter=retry.retry_on_server_errors_and_timeout_filter)
retry_filter=retry.retry_on_server_errors_timeout_or_quota_issues_filter)
def get_table(self, project_id, dataset_id, table_id):
"""Lookup a table's metadata object.

Expand Down