Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 2.2.2 (staging) #889

Closed
wants to merge 12 commits into from
Closed

Release 2.2.2 (staging) #889

wants to merge 12 commits into from

Conversation

* Fix flower

* Revert "Revert "update keycloak" (#877)"

This reverts commit 61f480a.

* Switch proxy mode to edge
@sambles sambles marked this pull request as draft September 7, 2023 10:49
* Draft minikube deploy script

* Add example debug worker-controller env

* test workaround for stuck model queue

refac

pep

fx

Fix cluster crash?

Fix crash

pep

pep
@sambles sambles self-assigned this Sep 25, 2023
sambles and others added 9 commits September 26, 2023 16:13
* disable server oed validation in charts

* first pass split async/http calls

* update dev deploy script

* disable http on websocket

* update minikube deploy

* Update chart

* Update livenessProbe for WS with disabled http

* 2nd pass - move change to client class

* fix init

* debug - disable latency checks on ws connection

* Tweak logging

* f

* Add logging level to workerController chart

* Set ping/pong heartbeat to 1min

* f

* If connection closes, reconnect back to WS

* add retry

* Fix reconnection

* Fix missing model_settings on piwind data upload

* Add log level as flag

* Fix blank input values

* Fix url join with api sub-path

* Allow external ws access via Ingress

* Update dev env to use ingress

* Add worker_count_min

* Add db migration

* Add minimum "always running" workers to scaling rules

* pep

* Fix typo

* Fix clash with args

* Fix typo in func name

* Fix scaling rules

* Add missing docstrings for chunking and scaling to swagger API

* Add validation for scaling min/max values

* Add clearer logging message on reconnection, only log trace for debug

* Only run external image scanning on releases targeting a stable branch
* correctly nest ws swagger under "content"

* Fix analyses serializer types

* tidy

* Store PiWind path in script dir

* revert autoban incorrect disconnection workaround

* Fix sub-task counting

* fix test mounts in docker-compose

* Fix types

* tmp

* Fix nesting

* Revert "tmp"

This reverts commit 81d73d3.

* Fix QueueName type

* fix pep8
* Fix queue-status schema

* Wrap disable ws http requests in env option
* Draft - update db env vars

* Updated Package Requirements: django==3.2.23 PyArrow==14.0.1

* Fix host

* Set keycloak to normal mode

* Fix missing analysis_settings for write generate oasis files

* Fix case where analysis settings inst posted

---------

Co-authored-by: awsbuild <[email protected]>
…oned-api

Test tagging schema for swagger

tmp

Rename platform1 task file

Revert changes

prototype api version split

spit other views and serializers

Move tests

refactor urls, settings + settings_tempates broken

Fix setting endpoints

tag base urls

copy in platform 1 - model

Copy in Platform 1 - analyses

Copy in platform 1 - portfolios

add Django Extensions, for manage.py show_urls

wip

Fix namespaces

Fix v2 models testing

Version all serializers

Add and fix tests - V1 models

Add and fix tests - V2 portfolios

Fix tests - V1 portfolios

Split data_files into V1 / V2

Fix tests data_files - V1 / V2

Fix queues

Fix test - V2 analyses

Add and fix tests - V1 analyses

Fix connected tests Portfolio -> create analyses

remove django-extentions

pep n flake

clear dups

first pass - Split celery tasks

test celery worker-monitor split

Fix imports

Add queue suffix to worker startup script

Split celery queues

WIP - fix celery queues v2

Worker monitors running with tasks

fix worker script

Fix workers - added env to select API ver

fix

V2 - example run working

Namespace celery app by api V1 / V2

Celery routing working

Both V1 & V2 celery dispatch working togeather

tidy

Fix clashing task names

Fixed routing, dded code comment on v1/V2 routing to save my sanity later on

fix serializers errors V2 - websocket

tidy conf files

take pri value from conf_v2 file

Added "run_mode" option to model & updated task cancel

testing -- add current stable worker

Fix WS

Clean up urls

Fix tests - analyses v1

Fix later

Fix testing

Fix stray test errors

fix

tests fixed?

set worker-controller to v2 api

remove old ci testing

kube - Update startup celery cmd

kube env vars

Test updated PiWind image checks

retest

Add stable piwind testing for workers

Fix workflow ?

fix

retest piwind stable

testing - missing model_settings file content

Make model reg DB operations atomic + fix missing vol mount

Add run_mode to models

Add run_model when auto-reg workers

Split worker-monitor to v1/v2 in chart

WIP fix model reg

Fix health check

pep

Fix flake / pep

uppdate requ -- worker-controller

Updated Package Requirements: aiohttp==3.9.0

retest

Fix VerifyGroupAccessModelViewSet query_set being overriden

Fix kube - model reg

Fix UI api version

Skip chunking/scaling on model reg if V1

fix

Fix mixed api prefix

fix

Fix auto-scaling v2

fix deployment name

Fix worker error

clean up

Add subpath to api base url

DEBUG off

del old ci

more clean up

Missing stable worker env vars

Remove duped variables

Fix health checks v1 workers

Rename singleserver_tasks -> tasks.py to keep compatibility with released workers

Add run_model in model reg (cluster)

add api version to deployments

WIP update autoscaler to detect api versions

fix

Fix autoscaler v2 workers

Set autoscaler to ignore v1 worker deployments -- maybe update this later

Read queue status directly from broker and Fix model ref in Websock

Clean up

Split off "messages on queue" to new key

PEP

Fix tests

Fix autoscaler checks

Fix autoscaler_rules & tests

Add new workflow for missing worker-controller checks

retest

Fix requ path

PEP

f

Fix min worker value

pep

pep

Tidy + add missing error message

example fix -- UI connection

test in chart

working

Update UI to latest
* Add missing check for build up of queue messages

* First pass

* Attach chunking options to analyses model

* Add chunking endpoints to analysis

* Set task-controller to check both model and analysis chunking options

* PEP

* flake

* Add migrations

* update tests

* Add env var to disable v2 api

* f]

* remove special case -- chunk=1 now means run losses in a single ktools pipe

* Debug prints

* Read chunking options from analysis when running job validation

* fix & pep

* f

* Fixed -- removed debug logging

* Remove logging

* Update test expected
@sambles
Copy link
Contributor Author

sambles commented Jan 16, 2024

Updated release version from 2.2.2 --> 2.3.0
New Release PR: #946

@sambles sambles closed this Jan 16, 2024
@sambles sambles deleted the release/2.2.2 branch January 16, 2024 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

1 participant