Release 2.3.0 #946
Merged
Release 2.3.0 #946
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Update CI plat2 * Update readme title * Fix piwind branch select * Updated Package Requirements: pyYaml==5.3.1 * fix * test CI workflow without CVE error --------- Co-authored-by: awsbuild <[email protected]>
* nuke all current migration files * Add in platform 1 migrations (version 1.28.0) * Apply platform2 migrations ontop of plat1 * Move all of ssl connection string to variable * Update deploy script * test data retention -- testing only * Add helper script to support 2.2.0 and below * Add support to migration between plat2 versions * f * fix * tidy * Revert "test data retention -- testing only" This reverts commit a64e0a8. * Updated Package Requirements: pyyaml==6.0.1 * trigger retest * stricter checking for missing migrations Revert "Revert "test data retention -- testing only"" This reverts commit ecf766d. fix Revert "Revert "Revert "test data retention -- testing only""" This reverts commit 8e4474be5a11869571d10b31ab0ca7b6462e6988. --------- Co-authored-by: awsbuild <[email protected]>
* Fix to tag piwind repo on publish Extract prev versions for latest released worker Disable guards to test release script Set version 2.2.1rc2 Add option to set min CVE errors Fix fix Fix ktools tag and latest publish Fix boolean Update changelog Update changelog test push git tag Update changelog test piwind tag from remote workflow test Revert "test" This reverts commit 82f8ae7. f finish pub script * Revert files edited in release testing * switch piwind tag to main branch
* Updated Package Requirements: cryptography==41.0.2 autobahn pyopenssl * Updated Package Requirements: certifi==2023.7.22 * retest --------- Co-authored-by: awsbuild <[email protected]>
This reverts commit c2cc5d7.
* Draft minikube deploy script * Add example debug worker-controller env * test workaround for stuck model queue refac pep fx Fix cluster crash? Fix crash pep pep
* Add remote trigger option for python tests * Fix branch select * Fix?
* disable server oed validation in charts * first pass split async/http calls * update dev deploy script * disable http on websocket * update minikube deploy * Update chart * Update livenessProbe for WS with disabled http * 2nd pass - move change to client class * fix init * debug - disable latency checks on ws connection * Tweak logging * f * Add logging level to workerController chart * Set ping/pong heartbeat to 1min * f * If connection closes, reconnect back to WS * add retry * Fix reconnection * Fix missing model_settings on piwind data upload * Add log level as flag * Fix blank input values * Fix url join with api sub-path * Allow external ws access via Ingress * Update dev env to use ingress * Add worker_count_min * Add db migration * Add minimum "always running" workers to scaling rules * pep * Fix typo * Fix clash with args * Fix typo in func name * Fix scaling rules * Add missing docstrings for chunking and scaling to swagger API * Add validation for scaling min/max values * Add clearer logging message on reconnection, only log trace for debug * Only run external image scanning on releases targeting a stable branch
* correctly nest ws swagger under "content" * Fix analyses serializer types * tidy * Store PiWind path in script dir * revert autoban incorrect disconnection workaround * Fix sub-task counting * fix test mounts in docker-compose * Fix types * tmp * Fix nesting * Revert "tmp" This reverts commit 81d73d3. * Fix QueueName type * fix pep8
* Fix queue-status schema * Wrap disable ws http requests in env option
* Fix queue-status schema * Wrap disable ws http requests in env option
* Draft - update db env vars * Updated Package Requirements: django==3.2.23 PyArrow==14.0.1 * Fix host * Set keycloak to normal mode * Fix missing analysis_settings for write generate oasis files * Fix case where analysis settings inst posted --------- Co-authored-by: awsbuild <[email protected]>
…oned-api Test tagging schema for swagger tmp Rename platform1 task file Revert changes prototype api version split spit other views and serializers Move tests refactor urls, settings + settings_tempates broken Fix setting endpoints tag base urls copy in platform 1 - model Copy in Platform 1 - analyses Copy in platform 1 - portfolios add Django Extensions, for manage.py show_urls wip Fix namespaces Fix v2 models testing Version all serializers Add and fix tests - V1 models Add and fix tests - V2 portfolios Fix tests - V1 portfolios Split data_files into V1 / V2 Fix tests data_files - V1 / V2 Fix queues Fix test - V2 analyses Add and fix tests - V1 analyses Fix connected tests Portfolio -> create analyses remove django-extentions pep n flake clear dups first pass - Split celery tasks test celery worker-monitor split Fix imports Add queue suffix to worker startup script Split celery queues WIP - fix celery queues v2 Worker monitors running with tasks fix worker script Fix workers - added env to select API ver fix V2 - example run working Namespace celery app by api V1 / V2 Celery routing working Both V1 & V2 celery dispatch working togeather tidy Fix clashing task names Fixed routing, dded code comment on v1/V2 routing to save my sanity later on fix serializers errors V2 - websocket tidy conf files take pri value from conf_v2 file Added "run_mode" option to model & updated task cancel testing -- add current stable worker Fix WS Clean up urls Fix tests - analyses v1 Fix later Fix testing Fix stray test errors fix tests fixed? set worker-controller to v2 api remove old ci testing kube - Update startup celery cmd kube env vars Test updated PiWind image checks retest Add stable piwind testing for workers Fix workflow ? fix retest piwind stable testing - missing model_settings file content Make model reg DB operations atomic + fix missing vol mount Add run_mode to models Add run_model when auto-reg workers Split worker-monitor to v1/v2 in chart WIP fix model reg Fix health check pep Fix flake / pep uppdate requ -- worker-controller Updated Package Requirements: aiohttp==3.9.0 retest Fix VerifyGroupAccessModelViewSet query_set being overriden Fix kube - model reg Fix UI api version Skip chunking/scaling on model reg if V1 fix Fix mixed api prefix fix Fix auto-scaling v2 fix deployment name Fix worker error clean up Add subpath to api base url DEBUG off del old ci more clean up Missing stable worker env vars Remove duped variables Fix health checks v1 workers Rename singleserver_tasks -> tasks.py to keep compatibility with released workers Add run_model in model reg (cluster) add api version to deployments WIP update autoscaler to detect api versions fix Fix autoscaler v2 workers Set autoscaler to ignore v1 worker deployments -- maybe update this later Read queue status directly from broker and Fix model ref in Websock Clean up Split off "messages on queue" to new key PEP Fix tests Fix autoscaler checks Fix autoscaler_rules & tests Add new workflow for missing worker-controller checks retest Fix requ path PEP f Fix min worker value pep pep Tidy + add missing error message example fix -- UI connection test in chart working Update UI to latest
Co-authored-by: awsbuild <[email protected]>
* Add missing check for build up of queue messages * First pass * Attach chunking options to analyses model * Add chunking endpoints to analysis * Set task-controller to check both model and analysis chunking options * PEP * flake * Add migrations * update tests * Add env var to disable v2 api * f] * remove special case -- chunk=1 now means run losses in a single ktools pipe * Debug prints * Read chunking options from analysis when running job validation * fix & pep * f * Fixed -- removed debug logging * Remove logging * Update test expected
* Fix model warnings ManyToMany - null has no effect * Fix missing chunking vars * fix incorrect params passed into loss gen * ensure prev inputs tar is cleared before starting a new generate run * Fix extracting generated inputs - run and generate chain * persist "input-location_generate-and-run" incase task is loaded on new node * Fix tests
* test edited migration * Update refs to field names * migration rename works * DISABLE_WORKER_REG now only skips model settings POST * pep * Add new env var * Add DISABLE_WORKER_SETTINGS_REG to skip model_settings post * PEP
* Fix share-fs portfolio link + remove sub-dir on store * Update v2 file linking * PEP * Add missing S3 storage check * Update image testing - S3 storage * retest * trigger test again * Name S3 checks by version * Test fix for input tar extract * try fix again
* Remove BOTH from model "run_mode" * Update AnalysisModel run_mode if in posted model_settings * Same for v1 API * Set run_mode based on "model.run_mode" or "param_url" + validation * PEP and clean up * Flake8 cleanup * Fix run_mode validation gap * Fix bad run_mode_override value * Fixes and updated tests * fix typo * Fixes and test updates * restore one_chunk mode * Disable sub-path * Split workers to seperate api models * update compose * Revert "Split workers to seperate api models" This reverts commit 999a764. * Added check to test if run_mode is set after posting model settings * clean up * don't allow non V1 models to attached V1 analysis, and throw bad op 400, incase this somehow happened * f * Fix * pep & flake * retest with ODS-tools merged * Fix typo in error msg * Rename env var OASIS_API_VERSION -> OASIS_RUN_MODE * Fix accidental commit * retest * Fix missing ods-tools build step in schema testing
* Only Add ref_name to clashing v1 serializer classes
* PoC - override generate_swagger cmd by loading custom OpenAPISchemaGenerator class
* Add env vars OASIS_GEN_SWAGGER_V1={t|f} and OASIS_GEN_SWAGGER_V2={t|f}
* Test multiple schema generation in GH actions
* Fix
* Clean up
* Update actions publish to attach new schema files
* Update external images * retest main branches * Updated Package Requirements: oasislmf==2.3.0 ods-tools==3.2.0 * Set version 2.3.0 * replace "2-latest" with "latest" docker tag * Updated Package Requirements: llvmlite==0.41.1 numba==0.58.0 * Set keycloak to v23 * Fix update to KC v23 --------- Co-authored-by: awsbuild <[email protected]>
* Fix broken swagger calls when SUB_PATH_URL=True * fix case
|
This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation. |
sambles
force-pushed
the
release/2.3.0
branch
from
21f9168 to
77aaf75
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Release 2.3.0
To include
oasislmfandods-toolsto support Multiple footprint file options OasisLMF#1293Delay (release after this)