Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to snapshot generation script #742

Merged
merged 2 commits into from
Aug 29, 2023

Conversation

courtneyholcomb
Copy link
Contributor

@courtneyholcomb courtneyholcomb commented Aug 28, 2023

Description

Fixes a couple of small issues with the snapshot generation script:

  1. Allow special characters when JSON-parsing BQ password.
  2. Don't use persistent source schema for Postgres.

@github-actions
Copy link

Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the contributing guide.

@courtneyholcomb courtneyholcomb marked this pull request as ready for review August 28, 2023 22:44
@tlento tlento temporarily deployed to DW_INTEGRATION_TESTS August 29, 2023 17:36 — with GitHub Actions Inactive
@tlento tlento temporarily deployed to DW_INTEGRATION_TESTS August 29, 2023 17:36 — with GitHub Actions Inactive
@tlento tlento temporarily deployed to DW_INTEGRATION_TESTS August 29, 2023 17:36 — with GitHub Actions Inactive
@tlento tlento temporarily deployed to DW_INTEGRATION_TESTS August 29, 2023 17:36 — with GitHub Actions Inactive
@tlento tlento temporarily deployed to DW_INTEGRATION_TESTS August 29, 2023 17:36 — with GitHub Actions Inactive
Copy link
Contributor

@tlento tlento left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@@ -74,7 +74,8 @@ def __configure_test_env_from_url(url: str, password: str, schema: str) -> sqlal

def __configure_bigquery_env_from_credential_string(password: str, schema: str) -> None:
credential_string = password.replace("'", "")
credentials = json.loads(credential_string)
# `strict=False` required to work with BQ password characters.
credentials = json.loads(credential_string, strict=False)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, the CI credential string doesn't need this. I can't remember what kind of escaping I did to get it working, though. Must be something to do with the nested JSON. Anyway everything seems fine so 🤷

@courtneyholcomb courtneyholcomb merged commit 42d5d03 into main Aug 29, 2023
31 of 33 checks passed
@courtneyholcomb courtneyholcomb deleted the court/snapshot-generation branch August 29, 2023 17:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants