Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add description field with make_model_config_json function (#203) #175

Open
wants to merge 72 commits into
base: workflow-for-review
Choose a base branch
from

Conversation

thanawan-atc
Copy link
Owner

  • Add description field

  • Restore notebook

  • Debug test

  • Resolve linting issues

  • Update CHANGELOG.md

  • Debug test_sentencetransformermodel_pytest.py

  • Improve test coverage

  • Edit test name

  • Change CHANGELOG.md & Add comment to sentencetransformermodel.py

  • Correct linting

  • Improve add description

  • Correct linting

  • Loosen restriction

  • Update sentencetransformermodel.py

  • Change function name + Add comment + Add default description

  • Debug


Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

* Add description field

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Restore notebook

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Debug test

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Resolve linting issues

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Debug test_sentencetransformermodel_pytest.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Improve test coverage

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Edit test name

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Change CHANGELOG.md & Add comment to sentencetransformermodel.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Correct linting

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Improve add description

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Correct linting

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Loosen restriction

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update sentencetransformermodel.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Change function name + Add comment + Add default description

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Debug

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Correct demo_ml_commons_integration.ipynb

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
thanawan-atc pushed a commit that referenced this pull request Aug 9, 2023
Bumps [sphinx-rtd-theme](https://github.com/readthedocs/sphinx_rtd_theme) from 1.2.1 to 1.2.2.
- [Changelog](https://github.com/readthedocs/sphinx_rtd_theme/blob/master/docs/changelog.rst)
- [Commits](readthedocs/sphinx_rtd_theme@1.2.1...1.2.2)

---
updated-dependencies:
- dependency-name: sphinx-rtd-theme
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit 5fe401c)

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
thanawan-atc and others added 27 commits August 15, 2023 11:54
* Handle undefined model max length

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Remove scratch notebook

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Fix bug

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Use compare instead

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update sentencetransformermodel.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
…loading (#209)

* Initiate PR #1 Model Auto-tracing & Uploading

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Improve update_changelog_md.py & sentencetransformermodel.py scraping

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Change default to N/A

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_models_upload_history_md.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update delete_model_uploader_branch.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Correct linting & Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Revert "Correct demo_ml_commons_integration.ipynb (#208)"

This reverts commit 664e447.

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Small fix

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add model_type

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Removed a modified file from pull request

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Removed a modified file from pull request

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_autotracing.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_autotracing.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_autotracing.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
#210)

* Initiate PR #2 Model Listing & Uploading

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add comment

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Correct linting

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Revert "Correct demo_ml_commons_integration.ipynb (#208)"

This reverts commit c67f969.

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Removed a modified file from pull request

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Removed a modified file from pull request

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add steps.checkout_pr_branch.outcome

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Remove old config json

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Minor change

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Allow non-st

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add tests for PR2

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Create __init__.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Create __init__.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update setup.cfg

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add more test to improve coverage

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Improve test cov

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Make it extensible

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Avoid crashing if folder does not exists

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Debug update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Wrap with update_pretrained_model_listing_main

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Remove unused variables

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Remove unnecessary variable

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
… Jenkins (#211)

* Initiate PR #3 Jenkins

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add option back

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Minor change

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Revert "Correct demo_ml_commons_integration.ipynb (#208)"

This reverts commit 212bac6.

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update utils/model_uploader/trigger_ml_models_release.sh

Co-authored-by: Sayali Gaikawad <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update utils/model_uploader/trigger_ml_models_release.sh

Co-authored-by: Sayali Gaikawad <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update utils/model_uploader/trigger_ml_models_release.sh

Co-authored-by: Sayali Gaikawad <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update ml-models.JenkinsFile

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Removed a modified file from pull request

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Removed a modified file from pull request

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add comment to JenkinsFile

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
Co-authored-by: Sayali Gaikawad <[email protected]>
* Bump torch from 1.13.1 to 2.0.1

Bumps [torch](https://github.com/pytorch/pytorch) from 1.13.1 to 2.0.1.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md)
- [Commits](pytorch/pytorch@v1.13.1...v2.0.1)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update requirements-dev.txt

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update requirements.txt

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Rerun

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Clean demo_tracing_model_torchscript_onnx.ipynb notebook

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update demo_tracing_model_torchscript_onnx.ipynb

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
…Generic Webhook (#240)

* Change to release cred

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_listing_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_listing_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* GitHub Actions Workflow: Update Pretrained Model Listing

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md -

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
* Add BUCKET_NAME

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Original pretrained_model_listing.json

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
…s.json` (#256)

* Delete utils/model_uploader/model_listing directory

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_listing_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_pretrained_model_listing.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_pretrained_model_listing.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_listing_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update update_model_listing.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_listing_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* GitHub Actions Workflow: Update Pretrained Model Listing

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md -

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update run-repository.sh

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Minor bug

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Update run-repository.sh

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update run-repository.sh

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update noxfile.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
…#273)

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Enable excluded_models

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Migrate excluded_models to py file

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Remove debug line

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* GitHub Actions Workflow: Update Pretrained Model Listing

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md -

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
…t-base-tas-b (v.1.0.2)(BOTH) (#272)

* GitHub Actions Workflow: Update Model Upload History - sentence-transformers/msmarco-distilbert-base-tas-b (v.1.0.2)(BOTH)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - sentence-transformers/msmarco-distilbert-base-tas-b (v.1.0.2)(BOTH)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Dhrubo Saha <[email protected]>
Co-authored-by: dhrubo-os <[email protected]>
Co-authored-by: Dhrubo Saha <[email protected]>
…ltilingual-cased-v1 (v.1.0.1)(TORCH_SCRIPT) (#281)

* GitHub Actions Workflow: Update Model Upload History - sentence-transformers/distiluse-base-multilingual-cased-v1 (v.1.0.1)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - sentence-transformers/distiluse-base-multilingual-cased-v1 (v.1.0.1)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
* GitHub Actions Workflow: Update Pretrained Model Listing

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md -

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
… & `model_content_hash_value` to model config automatically (#291)

* Preliminary work: Add generate_hash to utils

Signed-off-by: thanawan-atc <[email protected]>

* More changes

Signed-off-by: thanawan-atc <[email protected]>

* Debug verbose

Signed-off-by: thanawan-atc <[email protected]>

* Linting

Signed-off-by: thanawan-atc <[email protected]>

* Move license step

Signed-off-by: thanawan-atc <[email protected]>

* Debug tests

Signed-off-by: thanawan-atc <[email protected]>

* Correct linting

Signed-off-by: thanawan-atc <[email protected]>

* Decompose functions

Signed-off-by: thanawan-atc <[email protected]>

* Bypassing

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Bypassing

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Add license to model uploader workflow

Signed-off-by: thanawan-atc <[email protected]>

* Fix LICENSE path bug

Signed-off-by: thanawan-atc <[email protected]>

* Get LICENSE with requests

Signed-off-by: thanawan-atc <[email protected]>

* Update CHANGELOG.md

Signed-off-by: thanawan-atc <[email protected]>

* Debug license adding

Signed-off-by: thanawan-atc <[email protected]>

* Debug

Signed-off-by: thanawan-atc <[email protected]>

* Fix license url

Signed-off-by: thanawan-atc <[email protected]>

* Update sentencetransformermodel.py

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: thanawan-atc <[email protected]>
Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update model_uploader.yml

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>

---------

Signed-off-by: Thanawan Atchariyachanvanit <[email protected]>
rawwar and others added 30 commits November 13, 2023 14:27
* replace is_datetime_or_timedelta_dtype

Signed-off-by: kalyan <[email protected]>

* fix formatting

Signed-off-by: kalyan <[email protected]>

* fix import order

Signed-off-by: kalyan <[email protected]>

* update changelog

Signed-off-by: kalyan <[email protected]>

---------

Signed-off-by: kalyan <[email protected]>
Signed-off-by: kalyanr <[email protected]>
#337)

* Added deprecated module to setup.py Vinay Vinod  <[email protected]>

Signed-off-by: Vinay Vinod <[email protected]>

* Added deprecated module to setup.py Vinay Vinod  <[email protected]>

Signed-off-by: Vinay Vinod <[email protected]>

* Update to setup.py Vinay Vinod  <[email protected]>

Signed-off-by: Vinay Vinod <[email protected]>

---------

Signed-off-by: Vinay Vinod <[email protected]>
* add connectors

Signed-off-by: kalyan <[email protected]>

* update

Signed-off-by: kalyan <[email protected]>

* fix

Signed-off-by: kalyan <[email protected]>

* rename

Signed-off-by: kalyanr <[email protected]>

* add tests

Signed-off-by: kalyan <[email protected]>

* fix

Signed-off-by: kalyan <[email protected]>

* fix

Signed-off-by: kalyan <[email protected]>

* lint fix

Signed-off-by: kalyan <[email protected]>

* update changelog

Signed-off-by: kalyan <[email protected]>

* increase test coverage

Signed-off-by: kalyan <[email protected]>

---------

Signed-off-by: kalyan <[email protected]>
Signed-off-by: kalyanr <[email protected]>
* init

Signed-off-by: kalyanr <[email protected]>

* update changelog

Signed-off-by: kalyanr <[email protected]>

* update

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* lint fix

Signed-off-by: kalyanr <[email protected]>

* reuse validate input

Signed-off-by: kalyanr <[email protected]>

* update comment

Signed-off-by: kalyanr <[email protected]>

* change

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* update changelog

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* remove separate model profile module

Signed-off-by: kalyanr <[email protected]>

* fix tests

Signed-off-by: kalyanr <[email protected]>

* fix lint

Signed-off-by: kalyanr <[email protected]>

* fix lint

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* Update ml_commons_client.py

Signed-off-by: Kalyan <[email protected]>

---------

Signed-off-by: kalyanr <[email protected]>
Signed-off-by: Kalyan <[email protected]>
* Update CI and docs to remove references to default admin creds

Signed-off-by: Derek Ho <[email protected]>

* Add changelog line

Signed-off-by: Derek Ho <[email protected]>

* Echo opensearch version

Signed-off-by: Derek Ho <[email protected]>

* Update logic in determining version

Signed-off-by: Derek Ho <[email protected]>

* Change variable ref

Signed-off-by: Derek Ho <[email protected]>

* Modify version logic to be same as build repo

Signed-off-by: Derek Ho <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
…cept-else` block (#370)

* fix

Signed-off-by: kalyanr <[email protected]>

* update

Signed-off-by: kalyanr <[email protected]>

* update changelog

Signed-off-by: kalyanr <[email protected]>

* fix lint

Signed-off-by: kalyanr <[email protected]>

* few more fixes

Signed-off-by: kalyanr <[email protected]>

* few more tests updated

Signed-off-by: kalyanr <[email protected]>

---------

Signed-off-by: kalyanr <[email protected]>
* lint fixes

Signed-off-by: kalyanr <[email protected]>

* isort fix

Signed-off-by: kalyanr <[email protected]>

* update changelog

Signed-off-by: kalyanr <[email protected]>

---------

Signed-off-by: kalyanr <[email protected]>
* remove pins

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* add changelog

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* revert

Signed-off-by: kalyanr <[email protected]>

* remove

Signed-off-by: kalyanr <[email protected]>

* lint fixes

Signed-off-by: kalyanr <[email protected]>

---------

Signed-off-by: kalyanr <[email protected]>
…enkinsFile (#377)

* Switch AL2 to AL2023 agent and DockerHub to ECR images

Signed-off-by: Peter Zhu <[email protected]>

* Add changelog

Signed-off-by: Peter Zhu <[email protected]>

---------

Signed-off-by: Peter Zhu <[email protected]>
* adding cross encoder models in list

Signed-off-by: Dhrubo Saha <[email protected]>

* added changelog

Signed-off-by: Dhrubo Saha <[email protected]>

---------

Signed-off-by: Dhrubo Saha <[email protected]>
* updated req

Signed-off-by: kalyanr <[email protected]>

* fix

Signed-off-by: kalyanr <[email protected]>

* update changelog

Signed-off-by: kalyanr <[email protected]>

---------

Signed-off-by: kalyanr <[email protected]>
* fix

Signed-off-by: kalyanr <[email protected]>

* update changelog

Signed-off-by: kalyanr <[email protected]>

---------

Signed-off-by: kalyanr <[email protected]>
* Init a sparse model auto tracing workflow.
Signed-off-by: conggguan <[email protected]>

* Change the minimum-approvals of sparse model uploader to 2. Add some test case. Remove some redundant lines.

Signed-off-by: conggguan <[email protected]>

* Fix some test cases.

Signed-off-by: conggguan <[email protected]>

* Remove the temp test jupyter notebook.

Signed-off-by: conggguan <[email protected]>

* Change the variable name of inner model, and optimize the license verification.

Signed-off-by: conggguan <[email protected]>

* Address some comments, and nox format.

Signed-off-by: conggguan <[email protected]>

* Fix a bug for NeuralSparseModel's init. And remove a redundant save_pretrained.

Signed-off-by: conggguan <[email protected]>

* [Fix] Deleted some redundant code caused a faiure test case, fixed it.

Signed-off-by: conggguan <[email protected]>

* [Style]:Run a nox -s format to make format identical.

Signed-off-by: conggguan <[email protected]>

* [Fix] Simplify the SparseEncodingModel and fix a bug for multiple texts embeddings.

Signed-off-by: conggguan <[email protected]>

* [Fix] Make register_and_deploy_sparse_encoding_model return proper list but not single map.

Signed-off-by: conggguan <[email protected]>

* [Fix] Fix a bug for register_and_deploy_sparse_encoding_model, it now generate correct list of embedding of input texts.

Signed-off-by: conggguan <[email protected]>

* [Fix] Fix sparse encoding mdoel's test_check_required_fields test case.

Signed-off-by: conggguan <[email protected]>

* [Fix] Renamed a unproper variable name.

Signed-off-by: conggguan <[email protected]>

* [Refactor] Add some comments and extract some constants to a new file.

Signed-off-by: conggguan <[email protected]>

* [Refactor] Simplify and reuse some code from model auto tracing.

Signed-off-by: conggguan <[email protected]>

* [Refactor] Simplify and reuse some code from model auto tracing.

Signed-off-by: conggguan <[email protected]>

* [Refactor] Add a function comments and merge the sparse model trace workflow and dense.

Signed-off-by: conggguan <[email protected]>

* [Refactor] Merge the sparse and dense model's ci branch.

Signed-off-by: conggguan <[email protected]>

* [Refactor] Change for more common API, add a line of comments.

Signed-off-by: conggguan <[email protected]>

---------

Signed-off-by: conggguan <[email protected]>
…arse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT) (#400)

* GitHub Actions Workflow: Update Model Upload History - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
* [Feature] Add a workflow parameter that model uploader can specific a customize prefix.

Signed-off-by: conggguan <[email protected]>

* [Fix] To fix the Jekins trigger's wrong folder parameters bug.

Signed-off-by: conggguan <[email protected]>

* [Comments] Add a comments for model uploader workflow's [Initiate folders].

Signed-off-by: conggguan <[email protected]>

---------

Signed-off-by: conggguan <[email protected]>
…arse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT) (#405)

* GitHub Actions Workflow: Update Model Upload History - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
…arse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT) (#407)

* GitHub Actions Workflow: Update Model Upload History - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Dhrubo Saha <[email protected]>
Co-authored-by: dhrubo-os <[email protected]>
Co-authored-by: Dhrubo Saha <[email protected]>
…arse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT) (#410)

* GitHub Actions Workflow: Update Model Upload History - opensearch-project/opensearch-neural-sparse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - opensearch-project/opensearch-neural-sparse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
* updating listing file with three v2 sparse model

Signed-off-by: Dhrubo Saha <[email protected]>

* adding changelog

Signed-off-by: Dhrubo Saha <[email protected]>

---------

Signed-off-by: Dhrubo Saha <[email protected]>
…a custom prefix when upload_prefix provided. (#413)

* [Feature] Add a workflow parameter that model uploader can specific a customize prefix.

Signed-off-by: conggguan <[email protected]>

* [Fix] To change the model zip file name from hugging face org id to a custom prefix when upload_prefix provided.

Signed-off-by: conggguan <[email protected]>

* [Fix] Revert the redundant history.

Signed-off-by: conggguan <[email protected]>

* [Add] add a changelog item.

Signed-off-by: conggguan <[email protected]>

---------

Signed-off-by: conggguan <[email protected]>
…arse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT) (#417)

* GitHub Actions Workflow: Update Model Upload History - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - opensearch-project/opensearch-neural-sparse-encoding-doc-v2-mini (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
…arse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT) (#419)

* GitHub Actions Workflow: Update Model Upload History - opensearch-project/opensearch-neural-sparse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* GitHub Actions Workflow: Update CHANGELOG.md - opensearch-project/opensearch-neural-sparse-encoding-v2-distill (v.1.0.0)(TORCH_SCRIPT)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

---------

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: dhrubo-os <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.