Prod edits #86
Prod edits #86
Conversation
merging changes from master
merging in changes from master
…qlite db conversion
.gitignore
Outdated
There was a problem hiding this comment.
removed metadata_tools/ from gitignore as submodule init actually does not work with it gitignored.
There was a problem hiding this comment.
updated to parallel with server pipelines allows, for dynamic fetching of branches and PRs
| @@ -50,19 +63,37 @@ pipeline { | |||
| stage('Run Importer setup') { | |||
| steps { | |||
| script { | |||
There was a problem hiding this comment.
retry logic for max timeout.
| @@ -71,4 +102,20 @@ pipeline { | |||
| } | |||
| } | |||
| } | |||
| } | |||
|
|
|||
| post { | |||
There was a problem hiding this comment.
cleanup parallel to server pipeline to cleanup spawned repose from testing and save space
importer_jenkins_config.template.sh
Outdated
There was a problem hiding this comment.
added in parallel functions to updated https to testing compatible http.
| @@ -80,7 +85,45 @@ sleep 10 | |||
|
|
|||
| echo "specify db populated" | |||
|
|
|||
| # setting up test server | |||
| ( | |||
There was a problem hiding this comment.
stable_cas-server is configured on a separate port than the main server pipeline and only fetches and deploys the master branch.
tests/casbotany_lite_creator.py
Outdated
There was a problem hiding this comment.
correction of problem with sqlite creator where one table did not have "IF NOT EXISTS"
tests/convert_mysql_sqlite.py
Outdated
There was a problem hiding this comment.
removal of trailing commas from mysql dump for sqlite3
| -e MARIADB_ROOT_PASSWORD=password \ | ||
| -e MARIADB_CHARSET=utf8mb4 \ | ||
| -e MARIADB_COLLATION=utf8mb4_general_ci \ | ||
| -d -p 3310:3306 mariadb:10.11 |
There was a problem hiding this comment.
with versions of mariadb 11.0 and higher, (we have 10.11 in prod right now) assumes a collation of utf8mb4_0900_ai_ci when used with mysql-python-connector , while version lower use utf8mb4_ci_general
merging in changes from master
--final fixes to bring importer testing pipeline up to date with production version.