Skip to content

Releases: opensearch-project/OpenSearch

3.2.0

19 Aug 23:45
6adc0bf
Compare
Choose a tag to compare

Version 3.2.0 Release Notes

Compatible with OpenSearch and OpenSearch Dashboards version 3.2.0

Added

  • [Feature Request] Enhance Terms lookup query to support query clause instead of docId (#18195)
  • Add hierarchical routing processors for ingest and search pipelines (#18826)
  • Add ACL-aware routing processors for ingest and search pipelines (#18834)
  • Add support for Warm Indices Write Block on Flood Watermark breach (#18375)
  • FS stats for warm nodes based on addressable space (#18767)
  • Add support for custom index name resolver from cluster plugin (#18593)
  • Rename WorkloadGroupTestUtil to WorkloadManagementTestUtil (#18709)
  • Disallow resize for Warm Index, add Parameterized ITs for close in remote store (#18686)
  • Ability to run Code Coverage with Gradle and produce the jacoco reports locally (#18509)
  • Extend BooleanQuery must_not rewrite to numeric must, term, and terms queries (#18498)
  • [Workload Management] Update logging and Javadoc, rename QueryGroup to WorkloadGroup (#18711)
  • Add NodeResourceUsageStats to ClusterInfo (#18480)
  • Introduce SecureHttpTransportParameters experimental API (to complement SecureTransportParameters counterpart) (#18572)
  • Create equivalents of JSM's AccessController in the java agent (#18346)
  • [WLM] Add WLM mode validation for workload group CRUD requests (#18652)
  • Introduced a new cluster-level API to fetch remote store metadata (segments and translogs) for each shard of an index. (#18257)
  • Add last index request timestamp columns to the _cat/indices API. (10766)
  • Introduce a new pull-based ingestion plugin for file-based indexing (for local testing) (#18591)
  • Add support for search pipeline in search and msearch template (#18564)
  • [Workload Management] Modify logging message in WorkloadGroupService (#18712)
  • Add BooleanQuery rewrite moving constant-scoring must clauses to filter clauses (#18510)
  • Add functionality for plugins to inject QueryCollectorContext during QueryPhase (#18637)
  • Add support for non-timing info in profiler (#18460)
  • [Rule-based auto tagging] Bug fix and improvements (#18726)
  • Extend Approximation Framework to other numeric types (#18530)
  • Add Semantic Version field type mapper and extensive unit tests (#18454)
  • Pass index settings to system ingest processor factories. (#18708)
  • Add fetch phase profiling. (#18664)
  • Include named queries from rescore contexts in matched_queries array (#18697)
  • Add the configurable limit on rule cardinality (#18663)
  • Disable approximation framework when dealing with multiple sorts (#18763)
  • [Experimental] Start in "clusterless" mode if a clusterless ClusterPlugin is loaded (#18479)
  • [Star-Tree] Add star-tree search related stats (#18707)
  • Add support for plugins to profile information (#18656)
  • Add support for Combined Fields query (#18724)
  • Make GRPC transport extensible to allow plugins to register and expose their own GRPC services (#18516)
  • Added approximation support for range queries with now in date field (#18511)
  • Upgrade to protobufs 0.6.0 and clean up deprecated TermQueryProtoUtils code (#18880)
  • Expand fetch phase profiling to multi-shard queries (#18887)
  • Prevent shard initialization failure due to streaming consumer errors (#18877)
  • APIs for stream transport and new stream-based search api action (#18722)
  • Add support for custom remote store segment path prefix to support clusterless configurations (#18750)
  • Added the core process for warming merged segments in remote-store enabled domains (#18683)
  • Streaming aggregation (#18874)
  • Optimize Composite Aggregations by removing unnecessary object allocations (#18531)
  • [Star-Tree] Add search support for ip field type (#18671)
  • [Derived Source] Add integration of derived source feature across various paths like get/search/recovery (#18565)
  • Supporting Scripted Metric Aggregation when reducing aggregations in InternalValueCount and InternalAvg (18411))
  • Support search_after numeric queries with Approximation Framework (#18896)
  • Add skip_list parameter to Numeric Field Mappers (default false) (#18889)
  • Optimization in Numeric Terms Aggregation query for Large Bucket Counts(#18702)
  • Map to proper GRPC status codes and achieve exception handling parity with HTTP APIs(#18925)

Changed

  • Update Subject interface to use CheckedRunnable (#18570)
  • Update SecureAuxTransportSettingsProvider to distinguish between aux transport types (#18616)
  • Make node duress values cacheable (#18649)
  • Change default value of remote_data_ratio, which is used in Searchable Snapshots and Writeable Warm from 0 to 5 and min allowed value to 1 (#18767)
  • Making multi rate limiters in repository dynamic #18069
  • Optimize grouping for segment concurrent search by ensuring that documents within each group are as equal as possible (#18451)
  • Move transport-grpc from a core plugin to a module (#18897)
  • Remove experimental designation from transport-grpc settings (#18915)
  • Rename package org.opensearch.plugin,transport.grpc to org.opensearch.transport.grpc (#18923)

Dependencies

  • Bump stefanzweifel/git-auto-commit-action from 5 to 6 (#18524)
  • Bump Apache Lucene to 10.2.2 (#18573)
  • Bump org.apache.logging.log4j:log4j-core from 2.24.3 to 2.25.1 (#18589, #18744)
  • Bump com.google.code.gson:gson from 2.13.0 to 2.13.1 (#18585)
  • Bump com.azure:azure-core-http-netty from 1.15.11 to 1.15.12 (#18586)
  • Bump com.squareup.okio:okio from 3.13.0 to 3.15.0 (#18645, #18689)
  • Bump com.netflix.nebula.ospackage-base from 11.11.2 to 12.0.0 (#18646)
  • Bump `com.azure:azure-storage-bl...
Read more

2.19.3

21 Aug 21:09
a90f864
Compare
Choose a tag to compare

Version 2.19.3 Release Notes

Compatible with OpenSearch and OpenSearch Dashboards version 2.19.3

Added

  • Reject close index requests, while remote store migration is in progress.(#18327)

Dependencies

  • Bump netty from 4.1.118.Final to 4.1.121.Final (#18192)
  • Bump Apache Lucene to 9.12.2 (#18574)
  • Bump commons-beanutils:commons-beanutils from 1.9.4 to 1.11.0 (#18401)
  • Bump org.apache.poi version from 5.2.5 to 5.4.1 in /plugins/ingest-attachment (#17887)

Fixed

  • Use Bad Request status for InputCoercionException (#18161)
  • Avoid NPE if on SnapshotInfo if 'shallow' boolean not present (#18187)
  • Null check field names in QueryStringQueryBuilder (#18194)
  • Fix illegal argument exception when creating a PIT (#16781)
  • Fix the bug of Access denied error when rolling log files (#18597)

Changed

  • Change single shard assignment log message from warn to debug (#18186)

3.1.0

24 Jun 22:18
8ff7c6e
Compare
Choose a tag to compare

2025-06-17 Version 3.1.0 Release Notes

[3.1]

Added

  • Add support for linux riscv64 platform (#18156)
  • [Rule based auto-tagging] Add get rule API (#17336)
  • [Rule based auto-tagging] Add Delete Rule API (#18184)
  • Add paginated wlm/stats API (#17638)
  • [Rule based auto-tagging] Add Create rule API (#17792)
  • Implement parallel shard refresh behind cluster settings (#17782)
  • Bump OpenSearch Core main branch to 3.0.0 (#18039)
  • [Rule based Auto-tagging] Add wlm ActionFilter (#17791)
  • [Rule based auto-tagging] Add update rule API (#17797)
  • [Rule based auto-tagging] Bug fix for update rule api (#18488)
  • Update API of Message in index to add the timestamp for lag calculation in ingestion polling (#17977)
  • Add Warm Disk Threshold Allocation Decider for Warm shards (#18082)
  • Add composite directory factory (#17988)
  • [Rule based auto-tagging] Add refresh based synchronization service for Rules (#18128)
  • Add pull-based ingestion error metrics and make internal queue size configurable (#18088)
  • Adding support for derive source feature and implementing it for various type of field mappers (#17759)
  • [Security Manager Replacement] Enhance Java Agent to intercept newByteChannel (#17989)
  • Enabled Async Shard Batch Fetch by default (#18139)
  • Allow to get the search request from the QueryCoordinatorContext (#17818)
  • Reject close index requests, while remote store migration is in progress.(#18327)
  • Improve sort-query performance by retaining the default totalHitsThreshold for approximated match_all queries (#18189)
  • Enable testing for ExtensiblePlugins using classpath plugins (#16908)
  • Introduce system generated ingest pipeline (#17817))
  • Added Auto Force Merge Manager to enhance hot to warm migration experience (#18229)
  • Apply cluster state metadata and routing table diff when building cluster state from remote(#18256)
  • Support create mode in pull-based ingestion and add retries for transient failures (#18250))
  • Decouple the init of Crypto Plugin and KeyProvider in CryptoRegistry (18270))
  • Support cluster write block in pull-based ingestion (#18280))
  • Use QueryCoordinatorContext for the rewrite in validate API. (#18272)
  • Upgrade crypto kms plugin dependencies for AWS SDK v2.x. (#18268)
  • Add support for matched_fields with the unified highlighter (#18164)
  • Add BooleanQuery rewrite for must_not RangeQuery clauses (#17655)
  • [repository-s3] Add support for SSE-KMS and S3 bucket owner verification (#18312)
  • Optimize gRPC perf by passing by reference (#18303)
  • Added File Cache Stats - Involves Block level as well as full file level stats (#17538)
  • Added time_in_execution attribute to /_cluster/pending_tasks response (#17780)
  • Added File Cache Pinning (#17617)
  • Support consumer reset in Resume API for pull-based ingestion. This PR includes a breaking change for the experimental pull-based ingestion feature. (#18332)
  • Add FIPS build tooling (#4254)
  • Support Nested Aggregations as part of Star-Tree (#18048)
  • [Star-Tree] Support for date-range queries with star-tree supported aggregations (#17855
  • Added node-left metric to cluster manager (#18421)
  • [Star tree] Remove star tree feature flag and add index setting to configure star tree search on index basis (#18070)
  • Approximation Framework Enhancement: Update the BKD traversal logic to improve the performance on skewed data (#18439)
  • Support system generated ingest pipelines for bulk update operations (#18277))
  • Added FS Health Check Failure metric (#18435)

Changed

  • Create generic DocRequest to better categorize ActionRequests (#18269))
  • Change implementation for percentiles aggregation for latency improvement (#18124)
  • Update FipsMode check to catch NoSuchMethodError (#18427)

Dependencies

  • Update Apache Lucene from 10.1.0 to 10.2.1 (#17961)
  • Bump com.google.code.gson:gson from 2.12.1 to 2.13.1 (#17923, #18266)
  • Bump com.github.spotbugs:spotbugs-annotations from 4.9.0 to 4.9.3 (#17922)
  • Bump com.microsoft.azure:msal4j from 1.18.0 to 1.20.0 (#17925)
  • Update Apache HttpClient5 and HttpCore5 (CVE-2025-27820) (#18152)
  • Bump org.apache.commons:commons-collections4 from 4.4 to 4.5.0 (#18101)
  • Bump netty from 4.1.118.Final to 4.1.121.Final (#18192)
  • Bump org.apache.commons:commons-configuration2 from 2.11.0 to 2.12.0 (#18103, #18262)
  • Bump com.nimbusds:nimbus-jose-jwt from 10.0.2 to 10.3 (#18104, #18336)
  • Bump org.apache.commons:commons-text from 1.13.0 to 1.13.1 (#18102)
  • Bump reactor-netty from 1.2.4 to 1.2.5 (#18243)
  • Bump reactor from 3.5.20 to 3.7.5 (#18243)
  • Bump com.azure:azure-core-http-netty from 1.15.7 to 1.15.11 (#18265)
  • Bump lycheeverse/lychee-action from 2.4.0 to 2.4.1 (#18264)
  • Bump com.maxmind.geoip2:geoip2 from 4.2.1 to 4.3.1 (#18263, #18413)
  • Bump com.azure:azure-json from 1.3.0 to 1.5.0 (#18335)
  • Bump org.jline:jline from 3.29.0 to 3.30.4 (#18368, #18414)
  • Bump com.nimbusds:oauth2-oidc-sdk from 11.23.1 to 11.25 (#18369)
  • Bump gradle/actions from 3 to 4 (#18371)
  • Bump com.azure:azure-storage-common from 12.28.0 to 12.29.0 (#18415)
  • Bump com.squareup.okio:okio from 3.10.2 to 3.12.0 (#18468)
  • Bump com.azure:azure-xml from 1.1.0 to 1.2.0 ([#18469](#1...
Read more

3.0.0

06 May 21:58
dc4efa8
Compare
Choose a tag to compare

2025-04-28 Version 3.0.0 Release Notes

[3.0.0]

Breaking Changes

  • Upgrade to Lucene 10.1.0 - PR (#16366)
  • JDK21 as minimum supported Java runtime (#10745)
  • Remove deprecated terms from Java API (#5214)
  • JPMS Support (Eliminate top level split packages ) Phase-0 only (#8110)
  • Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
  • Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
  • Migrate client transports to Apache HttpClient / Core 5.x (#4459)
  • Validation changes on the Bulk Index API like enforcing 512 byte _id size limit (#6595)
  • Ability to use the node as coordinating node by passing node.roles as empty array (#3412)
  • Treat Setting value with empty array string as empty array (#10625)
  • Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11811)
  • Setting a maximum depth for nested queries (#11670)
  • Fix interchanged formats of total_indexing_buffer_in_bytes and total_indexing_buffer (#17070)
  • Cleanup deprecated thread pool settings (#2595)
  • Replace "blacklist/whitelist" terminology in Java APIs (#1683)
  • Remove deprecated methods from JodaCompatibleZonedDateTime which are called by scripts (#3346)
  • List of deprecated code removal in 3.0- partially done (#2773)
  • Remove mmap.extensions setting (#9392)
  • Remove COMPAT locale provider (#13988)
  • Remove transport-nio plugin (#16887)
  • Deprecate CamelCase PathHierarchy tokenizer name (#10894)
  • Rename Class ending with Plugin to Module under modules dir (#4042)
  • Remove deprecated batch_size parameter from _bulk (#14283)
  • Unset discovery nodes for every transport node actions request (#17682)

Added

  • Support for HTTP/2 (server-side) (#3847)
  • Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
  • Add events correlation engine plugin (#6854)
  • Implement on behalf of token passing for extensions (#8679, #10664)
  • Provide service accounts tokens to extensions (#9618)
  • GHA to verify checklist items completion in PR descriptions (#10800)
  • [WLM] Add WLM support for search scroll API (#16981)
  • Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
  • Add systemd configurations to strengthen OS core security (#17107)
  • Added pull-based Ingestion (APIs, for ingestion source, a Kafka plugin, and IngestionEngine that pulls data from the ingestion source) (#16958)
  • Added ConfigurationUtils to core for the ease of configuration parsing #17223
  • Add cluster and index level settings to limit the total primary shards per node and per index #17295
  • Add execution_hint to cardinality aggregator request (#17312)
  • Arrow Flight RPC plugin with Flight server bootstrap logic and client for internode communication (#16962)
  • Added offset management for the pull-based Ingestion (#17354)
  • Added integ tests for systemd configs (#17410)
  • Add filter function for AbstractQueryBuilder, BoolQueryBuilder, ConstantScoreQueryBuilder(#17409)
  • [Star Tree] [Search] Resolving keyword & numeric bucket aggregation with metric aggregation using star-tree (#17165)
  • Added error handling support for the pull-based ingestion (#17427)
  • Added Warm index setting and Updated nomenclature to differentiate between hot and warm tiering implementation (#17490)
  • Latency and Memory allocation improvements to Multi Term Aggregation queries (#14993)
  • Add logic in master service to optimize performance and retain detailed logging for critical cluster operations. (#14795)
  • Add Setting to adjust the primary constraint weights (#16471)
  • Introduce a setting to disable download of full cluster state from remote on term mismatch(#16798)
  • Added ability to retrieve value from DocValues in a flat_object filed(#16802)
  • Improve performace of NumericTermAggregation by avoiding unnecessary sorting(#17252)
  • Fix Bug - Handle unsigned long in sorting order assertion of LongHashSet (#17207)
  • Implemented computation of segment replication stats at shard level (#17055)
  • [Rule Based Auto-tagging] Add in-memory attribute value store (#17342)
  • Change priority for scheduling reroute during timeout(#16445)
  • [Rule Based Auto-tagging] Add rule schema for auto tagging (#17238)
  • Renaming the node role search to warm (#17573)
  • Introduce a new search node role to hold search only shards (#17620)
  • Fix systemd integTest on deb regarding path ownership check (#17641)
  • Add dfs transformation function in XContentMapValues (#17612)
  • Add tracking for long-running SearchTask post cancellation (#17726)
  • Added Kinesis support as a plugin for the pull-based ingestion (#17615)
  • Add FilterFieldType for developers who want to wrap MappedFieldType (#17627)
  • [Rule Based Auto-tagging] Add in-memory rule processing service (#17365)
  • [Security Manager Replacement] Create initial Java Agent to intercept Socket::connect calls (#17724)
  • Faster terms_query with already sorted terms (#17714)
  • Add ingestion management APIs for pause, resume and get ingestion state (#17631)
  • [Security Manager Replacement] Enhance Java Agent to intercept System::exit (#17746)
  • [Security Manager Replacement] Add a policy parser for Java agent security policies (#17753)
  • [Security Manager Replacement] Implement File Interceptor and add integration tests (#17760)
  • [Security Manager Replacement] Enhance Java Agent to intercept Runtime::halt (#17757)
  • [Security Manager Replacement] Phase off SecurityManager usage in favor of Java Agent ([#1786...
Read more

3.0.0-beta1

23 Apr 00:16
c57c9d3
Compare
Choose a tag to compare

2025-04-15 Version 3.0.0-beta1 Release Notes

[3.0.0]

Breaking Changes

  • Upgrade to Lucene 10.1.0 - PR (#16366)
  • JDK21 as minimum supported Java runtime (#10745)
  • Remove deprecated terms from Java API (#5214)
  • JPMS Support (Eliminate top level split packages ) Phase-0 only (#8110)
  • Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
  • Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
  • Migrate client transports to Apache HttpClient / Core 5.x (#4459)
  • Validation changes on the Bulk Index API like enforcing 512 byte _id size limit (#6595)
  • Ability to use the node as coordinating node by passing node.roles as empty array (#3412)
  • Treat Setting value with empty array string as empty array (#10625)
  • Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11811)
  • Setting a maximum depth for nested queries (#11670)
  • Fix interchanged formats of total_indexing_buffer_in_bytes and total_indexing_buffer (#17070)
  • Cleanup deprecated thread pool settings (#2595)
  • Replace "blacklist/whitelist" terminology in Java APIs (#1683)
  • Remove deprecated methods from JodaCompatibleZonedDateTime which are called by scripts (#3346)
  • List of deprecated code removal in 3.0- partially done (#2773)
  • Remove mmap.extensions setting (#9392)
  • Remove COMPAT locale provider (#13988)
  • Remove transport-nio plugin (#16887)
  • Deprecate CamelCase PathHierarchy tokenizer name (#10894)
  • Rename Class ending with Plugin to Module under modules dir (#4042)
  • Remove deprecated batch_size parameter from _bulk (#14283)

Added

  • Support for HTTP/2 (server-side) (#3847)
  • Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
  • Add events correlation engine plugin (#6854)
  • Implement on behalf of token passing for extensions (#8679, #10664)
  • Provide service accounts tokens to extensions (#9618)
  • GHA to verify checklist items completion in PR descriptions (#10800)
  • [WLM] Add WLM support for search scroll API (#16981)
  • Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
  • Add systemd configurations to strengthen OS core security (#17107)
  • Added pull-based Ingestion (APIs, for ingestion source, a Kafka plugin, and IngestionEngine that pulls data from the ingestion source) (#16958)
  • Added ConfigurationUtils to core for the ease of configuration parsing #17223
  • Add cluster and index level settings to limit the total primary shards per node and per index #17295
  • Add execution_hint to cardinality aggregator request (#17312)
  • Arrow Flight RPC plugin with Flight server bootstrap logic and client for internode communication (#16962)
  • Added offset management for the pull-based Ingestion (#17354)
  • Added integ tests for systemd configs (#17410)
  • Add filter function for AbstractQueryBuilder, BoolQueryBuilder, ConstantScoreQueryBuilder(#17409)
  • [Star Tree] [Search] Resolving keyword & numeric bucket aggregation with metric aggregation using star-tree (#17165)
  • Added error handling support for the pull-based ingestion (#17427)
  • Added Warm index setting and Updated nomenclature to differentiate between hot and warm tiering implementation (#17490)
  • Latency and Memory allocation improvements to Multi Term Aggregation queries (#14993)
  • Add logic in master service to optimize performance and retain detailed logging for critical cluster operations. (#14795)
  • Add Setting to adjust the primary constraint weights (#16471)
  • Introduce a setting to disable download of full cluster state from remote on term mismatch(#16798)
  • Added ability to retrieve value from DocValues in a flat_object filed(#16802)
  • Improve performace of NumericTermAggregation by avoiding unnecessary sorting(#17252)
  • Fix Bug - Handle unsigned long in sorting order assertion of LongHashSet (#17207)
  • Implemented computation of segment replication stats at shard level (#17055)
  • [Rule Based Auto-tagging] Add in-memory attribute value store (#17342)
  • Change priority for scheduling reroute during timeout(#16445)
  • [Rule Based Auto-tagging] Add rule schema for auto tagging (#17238)
  • Renaming the node role search to warm (#17573)
  • Introduce a new search node role to hold search only shards (#17620)
  • Fix systemd integTest on deb regarding path ownership check (#17641)
  • Add dfs transformation function in XContentMapValues (#17612)
  • Add tracking for long-running SearchTask post cancellation (#17726)
  • Added Kinesis support as a plugin for the pull-based ingestion (#17615)
  • Add FilterFieldType for developers who want to wrap MappedFieldType (#17627)
  • [Rule Based Auto-tagging] Add in-memory rule processing service (#17365)
  • [Security Manager Replacement] Create initial Java Agent to intercept Socket::connect calls (#17724)
  • Faster terms_query with already sorted terms (#17714)
  • Add ingestion management APIs for pause, resume and get ingestion state (#17631)
  • [Security Manager Replacement] Enhance Java Agent to intercept System::exit (#17746)
  • [Security Manager Replacement] Add a policy parser for Java agent security policies (#17753)
  • [Security Manager Replacement] Implement File Interceptor and add integration tests (#17760)
  • [Security Manager Replacement] Enhance Java Agent to intercept Runtime::halt (#17757)
  • [Security Manager Replacement] Phase off SecurityManager usage in favor of Java Agent (#17861)
  • Support AutoExpand for SearchReplica ([#17741](https://github.co...
Read more

2.19.2

21 Aug 21:11
e0ba5ee
Compare
Choose a tag to compare

Version 2.19.2 Release Notes

Compatible with OpenSearch and OpenSearch Dashboards version 2.19.2

Added

Dependencies

  • Update tj-actions/changed-files usage from the Github Action checks since it has been compromised (#17601)

Changed

Deprecated

Fixed

  • Fix NPE in node stats due to QueryGroupTasks (#17576)
  • Resolve typo in 2.x jdk version 21 (#17523)
  • Authenticate jenkins calls for gradle check (#17701)

3.0.0-alpha1

18 Mar 22:31
e6ffc62
Compare
Choose a tag to compare

2025-03-17 Version 3.0.0-alpha1 Release Notes

[3.0.0]

Breaking Changes

  • Upgrade to Lucene 10.1.0 - PR (#16366)
  • JDK21 as minimum supported Java runtime (#10745)
  • Remove deprecated terms from Java API (#5214)
  • JPMS Support (Eliminate top level split packages ) Phase-0 only (#8110)
  • Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
  • Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
  • Migrate client transports to Apache HttpClient / Core 5.x (#4459)
  • Validation changes on the Bulk Index API like enforcing 512 byte _id size limit (#6595)
  • Ability to use the node as coordinating node by passing node.roles as empty array (#3412)
  • Treat Setting value with empty array string as empty array (#10625)
  • Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11811)
  • Setting a maximum depth for nested queries (#11670)
  • Fix interchanged formats of total_indexing_buffer_in_bytes and total_indexing_buffer (#17070)
  • Cleanup deprecated thread pool settings (#2595)
  • Replace "blacklist/whitelist" terminology in Java APIs (#1683)
  • Remove deprecated methods from JodaCompatibleZonedDateTime which are called by scripts (#3346)
  • List of deprecated code removal in 3.0- partially done (#2773)
  • Remove mmap.extensions setting (#9392)
  • Remove COMPAT locale provider (#13988)
  • Remove transport-nio plugin (#16887)
  • Deprecate CamelCase PathHierarchy tokenizer name (#10894)
  • Rename Class ending with Plugin to Module under modules dir (#4042)

Added

  • Support for HTTP/2 (server-side) (#3847)
  • Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
  • Add events correlation engine plugin (#6854)
  • Implement on behalf of token passing for extensions (#8679, #10664)
  • Provide service accounts tokens to extensions (#9618)
  • GHA to verify checklist items completion in PR descriptions (#10800)
  • [WLM] Add WLM support for search scroll API (#16981)
  • Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
  • Add systemd configurations to strengthen OS core security (#17107)
  • Added pull-based Ingestion (APIs, for ingestion source, a Kafka plugin, and IngestionEngine that pulls data from the ingestion source) (#16958)
  • Added ConfigurationUtils to core for the ease of configuration parsing #17223
  • Add cluster and index level settings to limit the total primary shards per node and per index #17295
  • Add execution_hint to cardinality aggregator request (#17312)
  • Arrow Flight RPC plugin with Flight server bootstrap logic and client for internode communication (#16962)
  • Added offset management for the pull-based Ingestion (#17354)
  • Added integ tests for systemd configs (#17410)
  • Add filter function for AbstractQueryBuilder, BoolQueryBuilder, ConstantScoreQueryBuilder(#17409)
  • [Star Tree] [Search] Resolving keyword & numeric bucket aggregation with metric aggregation using star-tree (#17165)
  • Added error handling support for the pull-based ingestion (#17427)
  • Added Warm index setting and Updated nomenclature to differentiate between hot and warm tiering implementation (#17490)
  • Latency and Memory allocation improvements to Multi Term Aggregation queries (#14993)
  • Add logic in master service to optimize performance and retain detailed logging for critical cluster operations. (#14795)
  • Add Setting to adjust the primary constraint weights (#16471)
  • Introduce a setting to disable download of full cluster state from remote on term mismatch(#16798)
  • Added ability to retrieve value from DocValues in a flat_object filed(#16802)
  • Improve performace of NumericTermAggregation by avoiding unnecessary sorting(#17252)
  • Fix Bug - Handle unsigned long in sorting order assertion of LongHashSet (#17207)
  • Implemented computation of segment replication stats at shard level (#17055)
  • [Rule Based Auto-tagging] Add in-memory attribute value store (#17342)

Dependencies

  • Bump Apache HttpCore5/HttpClient5 dependencies from 5.2.5/5.3.1 to 5.3.1/5.4.1 to support ExtendedSocketOption in HttpAsyncClient (#16757)
  • Bumps jetty version from 9.4.55.v20240627 to 9.4.57.v20241219 (#17395)
  • Switch main/3.x to use JDK21 LTS version (#17515)
  • Bump org.awaitility:awaitility from 4.2.0 to 4.3.0 (#17230, #17439)
  • Bump dnsjava:dnsjava from 3.6.2 to 3.6.3 (#17231)
  • Bump com.google.code.gson:gson from 2.11.0 to 2.12.1 (#17229)
  • Bump org.jruby.joni:joni from 2.2.1 to 2.2.3 (#17136)
  • Bump org.apache.ant:ant from 1.10.14 to 1.10.15 (#17288)
  • Bump reactor_netty from 1.1.26 to 1.1.27 (#17322)
  • Bump me.champeau.gradle.japicmp from 0.4.5 to 0.4.6 (#17375)
  • Bump com.google.api.grpc:proto-google-common-protos from 2.37.1 to 2.52.0 (#17379)
  • Bump net.minidev:json-smart from 2.5.1 to 2.5.2 (#17378)
  • Bump com.netflix.nebula.ospackage-base from 11.10.1 to 11.11.1 (#17374)
  • Bump ch.qos.logback:logback-classic from 1.5.16 to 1.5.17 (#17497)
  • Bump software.amazon.awssdk from 2.20.86 to 2.30.31 (#17396)
  • Bump org.jruby.jcodings:jcodings from 1.0.61 to 1.0.63 (#17560)
  • Bump com.azure:azure-storage-blob from 12.28.1 to 12.29.1 (#17562)

Changed

  • Changed locale provider from COMPAT to CLDR (#14345)
  • Change http code on create index API with bad input raising NotXContentException from 500 to 400 (#4773)
  • Improve summary error message for invalid setting updates ([#4792](ht...
Read more

2.19.1

27 Feb 23:31
2e4741f
Compare
Choose a tag to compare

2025-02-27 Version 2.19.1 Release Notes

[2.19.1]

Added

  • Add execution_hint to cardinality aggregator request (#17420)

Dependencies

  • Bump netty from 4.1.117.Final to 4.1.118.Final (#17320)
  • Bump jetty version from 9.4.55.v20240627 to 9.4.57.v20241219

Changed

Deprecated

Fixed

  • Fix HTTP API calls that hang with 'Accept-Encoding: zstd' (#17408)

1.3.20

11 Dec 23:23
31afd17
Compare
Choose a tag to compare

2024-12-09 Version 1.3.20 Release Notes

Dependencies

  • Bump icu4j from 62.1 to 62.2 (#15469)
  • Bump org.bouncycastle:bc-fips from 1.0.2.4 to 1.0.2.5 (#13446)
  • Bump Netty from 4.1.112.Final to 4.1.115.Final (#16661)
  • Bump avro from 1.11.3 to 1.11.4 (#16773)
  • Bump commonsio to 2.16.0 (#16780)
  • Bump protobuf-java to 3.25.5 (#16792)
  • Bump snappy-java to 1.1.10.7 (#16792)
  • Bump mime4j-core to 0.8.11 (#16810)

Fixed

  • Update help output for _cat (#14722)
  • Bugfix to guard against stack overflow errors caused by very large reg-ex input (#16101)

2.18.0

05 Nov 23:17
99a9a81
Compare
Choose a tag to compare

2024-10-28 Version 2.18.0 Release Notes

[2.18.0]

Added

  • [Workload Management] Add orchestrator for wlm resiliency (QueryGroupService) (#15925)
  • [Offline Nodes] Adds offline-tasks library containing various interfaces to be used for Offline Background Tasks. (#13574)
  • Add support for async deletion in S3BlobContainer (#15621)
  • [Workload Management] QueryGroup resource cancellation framework changes (#15651)
  • [Workload Management] Add QueryGroup Stats API Logic (15777)
  • Implement WithFieldName interface in ValuesSourceAggregationBuilder & FieldSortBuilder (#15916)
  • Add successfulSearchShardIndices in searchRequestContext (#15967, #16110)
  • Fallback to Remote cluster-state on Term-Version check mismatch - (#15424)
  • [Tiered Caching] Segmented cache changes (#16047)
  • Add support for msearch API to pass search pipeline name - (#15923)
  • Add success and failure metrics for async shard fetch (#15976)
  • Add support to dynamically resize threadpools size. (#16236)
  • [S3 Repository] Change default retry mechanism of s3 clients to Standard Mode (#15978)
  • [Workload Management] Add Integration Tests for Workload Management CRUD APIs (#15955)
  • Add new metric REMOTE_STORE to NodeStats API response (#15611)
  • New phone & phone-search analyzer + tokenizer (#15915)
  • Add _list/indices API as paginated alternate to _cat/indices (#14718)
  • Add changes to block calls in cat shards, indices and segments based on dynamic limit settings (#15986)
  • Flat object field use IndexOrDocValuesQuery to optimize query (#14383)
  • Add method to return dynamic SecureTransportParameters from SecureTransportSettingsProvider interface (#16387
  • Add _list/shards API as paginated alternate to _cat/shards (#14641)
  • [Star Tree - Search] Add support for metric aggregations with/without term query (15289)
  • URI path filtering support in cluster stats API (#15938)
  • Add support for renaming aliases during snapshot restore (#16292)

Dependencies

  • Bump org.apache.logging.log4j:log4j-core from 2.23.1 to 2.24.0 (#15858)
  • Bump com.azure:azure-identity from 1.13.0 to 1.13.2 (#15578)
  • Bump protobuf from 3.22.3 to 3.25.4 (#15684)
  • Bump peter-evans/create-pull-request from 6 to 7 (#15863)
  • Bump com.nimbusds:oauth2-oidc-sdk from 11.9.1 to 11.19.1 (#15862)
  • Bump com.microsoft.azure:msal4j from 1.17.0 to 1.17.2 (#15945, #16406)
  • Bump ch.qos.logback:logback-core from 1.5.6 to 1.5.10 (#15946, #16307)
  • Update protobuf from 3.25.4 to 3.25.5 (#16011)
  • Bump org.roaringbitmap:RoaringBitmap from 1.2.1 to 1.3.0 (#16040)
  • Bump com.nimbusds:nimbus-jose-jwt from 9.40 to 9.41.1 (#16038)
  • Bump actions/github-script from 5 to 7 (#16039)
  • Bump dnsjava:dnsjava from 3.6.1 to 3.6.2 (#16041)
  • Bump com.maxmind.geoip2:geoip2 from 4.2.0 to 4.2.1 (#16042)
  • Bump com.maxmind.db:maxmind-db from 3.1.0 to 3.1.1 (#16137)
  • Bump Apache lucene from 9.11.1 to 9.12.0 (#15333)
  • Bump com.azure:azure-core-http-netty from 1.15.3 to 1.15.5 (#16133, #16311)
  • Bump netty from 4.1.112.Final to 4.1.114.Final (#16182)
  • Bump com.google.api-client:google-api-client from 2.2.0 to 2.7.0 (#16216)
  • Bump com.azure:azure-json from 1.1.0 to 1.3.0 (#16217)
  • Bump io.grpc:grpc-api from 1.57.2 to 1.68.0 (#16213)
  • Bump org.jline:jline from 3.26.3 to 3.27.0 (#16135)
  • Bump com.squareup.okio:okio from 3.9.0 to 3.9.1 (#16212)
  • Bump lycheeverse/lychee-action from 1.10.0 to 2.0.2 (#16310)
  • Bump com.google.code.gson:gson from 2.10.1 to 2.11.0 (#16308)
  • Bump io.grpc:grpc-api from 1.57.2 to 1.68.0 (#16213)
  • Bump me.champeau.gradle.japicmp from 0.4.3 to 0.4.4 (#16309)
  • Bump com.google.oauth-client:google-oauth-client from 1.35.0 to 1.36.0 (#16306)

Changed

  • Add support for docker compose v2 in TestFixturesPlugin (#16049)
  • Remove identity-related feature flagged code from the RestController (#15430)
  • Remove Identity FeatureFlag (#16024)
  • Ensure RestHandler.Wrapper delegates all implementations to the wrapped handler (#16154)
  • Enable coordinator search.request_stats_enabled by default (#16290)
  • Optimise clone operation for incremental full cluster snapshots (#16296)
  • Code cleanup: Remove ApproximateIndexOrDocValuesQuery (#16273)
  • Update last seen cluster state in the commit phase (#16215)
  • Make multiple settings dynamic for tuning on larger clusters(#16347)

Fixed

  • Fix wildcard query containing escaped character (#15737)
  • Fix case-insensitive query on wildcard field (#15882)
  • Add validation for the search backpressure cancellation settings (#15501)
  • Fix search_as_you_type not supporting multi-fields (#15988)
  • Avoid infinite loop when flat_object field contains invalid token (#15985)
  • Fix infinite loop in nested agg (#15931)
  • Fix update settings with null replica not honoring cluster setting bug (#14948)
  • Fix race condition in node-join and node-left (#15521)
  • Streaming bulk request hangs (#16158)
  • Fix warnings from SLF4J on startup when repository-s3 is installed (#16194)
  • Fix protobuf-java leak through client library dependencies (#16254)
  • Fix multi-search with template doesn't return status code (#16265)
  • [Streaming Indexing] Fix intermittent 'The bulk request must be terminated by a newline [\n]' fa...
Read more