Skip to content

Commit

Permalink
push code
Browse files Browse the repository at this point in the history
  • Loading branch information
zzstoatzz committed Jan 6, 2025
1 parent 9e82459 commit 171ed88
Show file tree
Hide file tree
Showing 2 changed files with 16 additions and 24 deletions.
10 changes: 8 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -196,7 +196,13 @@ uv run --with-editable '.[dev]' pytest tests -vv

### notes for maintainers

#### run the metadata update script
#### deploy the metadata update flow
```
uv run prefect --no-prompt deploy --all
```


#### run the metadata update script interactively

this is the main entrypoint flow for updating all collections
```bash
Expand All @@ -211,7 +217,7 @@ this will:
- update the worker metadata
- create or update a PR with these changes

#### run the worker metadata sync script
#### run the worker metadata sync script interactively

> [!NOTE]
> Though this script is automatically run on merge to `main`, you may also want to run it manually if something goes wrong.
Expand Down
30 changes: 8 additions & 22 deletions prefect.yaml
Original file line number Diff line number Diff line change
@@ -1,16 +1,11 @@
name: prefect-collection-registry
prefect-version: 3.0.0


definitions:
work_pools:
kubernetes_prd_internal_tools: &kubernetes_prd_internal_tools
name: kubernetes-prd-internal-tools
job_variables:
image: prefecthq/prefect:3.1.11-python3.12
env:
EXTRA_PIP_PACKAGES: github3.py fastjsonschema prefect-gcp


build:

Expand All @@ -19,18 +14,15 @@ push:
pull:
- prefect.deployments.steps.git_clone:
repository: https://github.com/PrefectHQ/prefect-collection-registry
branch: main

branch: revamp-registry-flow
- prefect.deployments.steps.run_shell_script:
script: |
ls -la
cd prefect-collection-registry
ls -la
uv sync --frozen
deployments:
- name: update-a-collection
tags: []
description: Updates each variety of metadata for a given package.
schedules:
entrypoint: src/prefect_collection_registry/update_collection_metadata.py:update_collection_metadata
parameters: {}
work_pool: *kubernetes_prd_internal_tools

- name: update-all-collections
tags: []
description: "`update-all-collections` triggers many instances of `update-collection-metadata`
Expand All @@ -41,12 +33,6 @@ deployments:
of `update_collection_metadata` for each such package."
schedules:
- cron: 0 6,12,18 * * 1-5
timezone: EST
day_or: true
active: true
max_active_runs:
catchup: false
timezone: UTC
entrypoint: src/prefect_collection_registry/update_collection_metadata.py:update_all_collections
work_pool: *kubernetes_prd_internal_tools
parameters: {}
enforce_parameter_schema: true

0 comments on commit 171ed88

Please sign in to comment.