[Backport 2.x] Support batch ingestion in bulk API (#12457) (#13306) #13462
Commits on Apr 30, 2024
-
Support batch ingestion in bulk API (opensearch-project#12457) (opens…
…earch-project#13306) * [PoC][issues-12457] Support Batch Ingestion Signed-off-by: Liyun Xiu <[email protected]> * Rewrite batch interface and handle error and metrics Signed-off-by: Liyun Xiu <[email protected]> * Remove unnecessary change Signed-off-by: Liyun Xiu <[email protected]> * Revert some unnecessary test change Signed-off-by: Liyun Xiu <[email protected]> * Keep executeBulkRequest main logic untouched Signed-off-by: Liyun Xiu <[email protected]> * Add UT Signed-off-by: Liyun Xiu <[email protected]> * Add UT & yamlRest test, fix BulkRequest se/deserialization Signed-off-by: Liyun Xiu <[email protected]> * Add missing java docs Signed-off-by: Liyun Xiu <[email protected]> * Remove Writable from BatchIngestionOption Signed-off-by: Liyun Xiu <[email protected]> * Add more UTs Signed-off-by: Liyun Xiu <[email protected]> * Fix spotlesscheck Signed-off-by: Liyun Xiu <[email protected]> * Rename parameter name to batch_size Signed-off-by: Liyun Xiu <[email protected]> * Add more rest yaml tests & update rest spec Signed-off-by: Liyun Xiu <[email protected]> * Remove batch_ingestion_option and only use batch_size Signed-off-by: Liyun Xiu <[email protected]> * Throw invalid request exception for invalid batch_size Signed-off-by: Liyun Xiu <[email protected]> * Update server/src/main/java/org/opensearch/action/bulk/BulkRequest.java Co-authored-by: Andriy Redko <[email protected]> Signed-off-by: Liyun Xiu <[email protected]> * Remove version constant Signed-off-by: Liyun Xiu <[email protected]> --------- Signed-off-by: Liyun Xiu <[email protected]> Signed-off-by: Liyun Xiu <[email protected]> Co-authored-by: Andriy Redko <[email protected]> (cherry picked from commit 1219c56)
-
Adjust changelog item position to trigger CI
Signed-off-by: Liyun Xiu <[email protected]>
-
Merge branch '2.x' into backport/backport-13306-to-2.x
Signed-off-by: Liyun Xiu <[email protected]>
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.