Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQFP16 Range Validation for Faiss IVF Models #1557

Conversation

naveentatikonda
Copy link
Member

Description

Faiss SQfp16 Range Validation for Faiss IVF Models and to clip out of range values to fp16 range when the clip encoder parameter is set to true.

Issues Resolved

#1138

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed as per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link

codecov bot commented Mar 18, 2024

Codecov Report

Attention: Patch coverage is 85.71429% with 3 lines in your changes are missing coverage. Please review.

Project coverage is 84.43%. Comparing base (774cd8c) to head (efd70d2).

Files Patch % Lines
...nsearch/knn/index/mapper/KNNVectorFieldMapper.java 84.21% 1 Missing and 2 partials ⚠️
Additional details and impacted files
@@                    Coverage Diff                     @@
##             feature/faiss_sqfp16    #1557      +/-   ##
==========================================================
+ Coverage                   84.36%   84.43%   +0.06%     
- Complexity                   1342     1345       +3     
==========================================================
  Files                         171      171              
  Lines                        5507     5511       +4     
  Branches                      545      545              
==========================================================
+ Hits                         4646     4653       +7     
+ Misses                        626      624       -2     
+ Partials                      235      234       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@ryanbogan ryanbogan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Signed-off-by: Naveen Tatikonda <[email protected]>
@naveentatikonda naveentatikonda merged commit 14c371b into opensearch-project:feature/faiss_sqfp16 Mar 18, 2024
52 checks passed
naveentatikonda added a commit that referenced this pull request Mar 18, 2024
* SQFP16 Range Validation for Faiss IVF Models

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>
naveentatikonda added a commit that referenced this pull request Mar 18, 2024
* Add Range Validation for SQFP16 (#1493)

* Add Range Validation for SQFP16 Vector Data

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add index setting to clip vector data to FP16 range

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add CHANGELOG

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add an encoder parameter to clip fp16 range

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add BWC Tests

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>

* SQFP16 Range Validation for Faiss IVF Models (#1557)

* SQFP16 Range Validation for Faiss IVF Models

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>

* Rebase Changes

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 18, 2024
* Add Range Validation for SQFP16 (#1493)

* Add Range Validation for SQFP16 Vector Data

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add index setting to clip vector data to FP16 range

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add CHANGELOG

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add an encoder parameter to clip fp16 range

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add BWC Tests

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>

* SQFP16 Range Validation for Faiss IVF Models (#1557)

* SQFP16 Range Validation for Faiss IVF Models

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>

* Rebase Changes

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>
(cherry picked from commit d63ce27)
naveentatikonda added a commit that referenced this pull request Mar 18, 2024
* Faiss SQFP16 Range Validation and Clipping (#1562)

* Add Range Validation for SQFP16 (#1493)

* Add Range Validation for SQFP16 Vector Data

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add index setting to clip vector data to FP16 range

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add CHANGELOG

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add an encoder parameter to clip fp16 range

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

* Add BWC Tests

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>

* SQFP16 Range Validation for Faiss IVF Models (#1557)

* SQFP16 Range Validation for Faiss IVF Models

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>

* Rebase Changes

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>
(cherry picked from commit d63ce27)

* Fix EntityUtils package

Signed-off-by: Naveen Tatikonda <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>
Co-authored-by: Naveen Tatikonda <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants