Skip to content

Conversation

@hadia206
Copy link
Contributor

@hadia206 hadia206 commented Nov 5, 2025

Previously, the call to data update (DEFOG_DAILY_UPDATE) was triggered from sf_conn_db_context fixture that ran three times, once for each Python version in the test matrix.

This could lead to duplicate data if all three versions executed the procedure simultaneously.

This PR moves the update step into its own CI job, ensuring the procedure runs only once per CI run. Then, Snowflake tests now run as usual after the update.

('TX054', 'C018', 'T004', DATE_TRUNC('month', CURRENT_DATE) - INTERVAL '2 months' + INTERVAL '4 days', 'sell', 30, 180.00, 5400.00, 'USD', 27.00, 5.00, 'KP054', TO_CHAR(DATE_TRUNC('month', CURRENT_DATE) - INTERVAL '2 months' + INTERVAL '4 days', '%Y%m%d %H:%i:%s'), 'success'),
('TX055', 'C019', 'T005', DATE_TRUNC('month', CURRENT_DATE) - INTERVAL '1 month' + INTERVAL '5 days', 'buy', 10, 2500.00, 25000.00, 'USD', 125.00, 15.00, 'KP055', TO_CHAR(DATE_TRUNC('month', CURRENT_DATE) - INTERVAL '1 month' + INTERVAL '5 days', '%Y%m%d %H:%i:%s'), 'success'),
('TX056', 'C002', 'T006', DATE_TRUNC('month', CURRENT_DATE) + INTERVAL '1 day', 'sell', 20, 200.00, 4000.00, 'USD', 20.00, 10.00, 'KP056', TO_CHAR(DATE_TRUNC('month', CURRENT_DATE) + INTERVAL '1 day', '%Y%m%d %H:%i:%s'), 'success');
-------------------------------------------------------------------------------
Copy link
Contributor Author

@hadia206 hadia206 Nov 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some Inserts that are in the procedure but were not included in that file.
That file doesn't run, its goal is to include procedure and task SQL code for reference

Copy link
Contributor

@john-sanchez31 john-sanchez31 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thank you Hadia

@hadia206 hadia206 merged commit 29b3ca1 into main Nov 6, 2025
19 checks passed
@hadia206 hadia206 deleted the Hadia/CI_defog_update branch November 6, 2025 22:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants