Releases: opensearch-project/OpenSearch
Releases · opensearch-project/OpenSearch
3.2.0
Version 3.2.0 Release Notes
Compatible with OpenSearch and OpenSearch Dashboards version 3.2.0
Added
- [Feature Request] Enhance Terms lookup query to support query clause instead of docId (#18195)
- Add hierarchical routing processors for ingest and search pipelines (#18826)
- Add ACL-aware routing processors for ingest and search pipelines (#18834)
- Add support for Warm Indices Write Block on Flood Watermark breach (#18375)
- FS stats for warm nodes based on addressable space (#18767)
- Add support for custom index name resolver from cluster plugin (#18593)
- Rename WorkloadGroupTestUtil to WorkloadManagementTestUtil (#18709)
- Disallow resize for Warm Index, add Parameterized ITs for close in remote store (#18686)
- Ability to run Code Coverage with Gradle and produce the jacoco reports locally (#18509)
- Extend BooleanQuery must_not rewrite to numeric must, term, and terms queries (#18498)
- [Workload Management] Update logging and Javadoc, rename QueryGroup to WorkloadGroup (#18711)
- Add NodeResourceUsageStats to ClusterInfo (#18480)
- Introduce SecureHttpTransportParameters experimental API (to complement SecureTransportParameters counterpart) (#18572)
- Create equivalents of JSM's AccessController in the java agent (#18346)
- [WLM] Add WLM mode validation for workload group CRUD requests (#18652)
- Introduced a new cluster-level API to fetch remote store metadata (segments and translogs) for each shard of an index. (#18257)
- Add last index request timestamp columns to the
_cat/indices
API. (10766) - Introduce a new pull-based ingestion plugin for file-based indexing (for local testing) (#18591)
- Add support for search pipeline in search and msearch template (#18564)
- [Workload Management] Modify logging message in WorkloadGroupService (#18712)
- Add BooleanQuery rewrite moving constant-scoring must clauses to filter clauses (#18510)
- Add functionality for plugins to inject QueryCollectorContext during QueryPhase (#18637)
- Add support for non-timing info in profiler (#18460)
- [Rule-based auto tagging] Bug fix and improvements (#18726)
- Extend Approximation Framework to other numeric types (#18530)
- Add Semantic Version field type mapper and extensive unit tests (#18454)
- Pass index settings to system ingest processor factories. (#18708)
- Add fetch phase profiling. (#18664)
- Include named queries from rescore contexts in matched_queries array (#18697)
- Add the configurable limit on rule cardinality (#18663)
- Disable approximation framework when dealing with multiple sorts (#18763)
- [Experimental] Start in "clusterless" mode if a clusterless ClusterPlugin is loaded (#18479)
- [Star-Tree] Add star-tree search related stats (#18707)
- Add support for plugins to profile information (#18656)
- Add support for Combined Fields query (#18724)
- Make GRPC transport extensible to allow plugins to register and expose their own GRPC services (#18516)
- Added approximation support for range queries with now in date field (#18511)
- Upgrade to protobufs 0.6.0 and clean up deprecated TermQueryProtoUtils code (#18880)
- Expand fetch phase profiling to multi-shard queries (#18887)
- Prevent shard initialization failure due to streaming consumer errors (#18877)
- APIs for stream transport and new stream-based search api action (#18722)
- Add support for custom remote store segment path prefix to support clusterless configurations (#18750)
- Added the core process for warming merged segments in remote-store enabled domains (#18683)
- Streaming aggregation (#18874)
- Optimize Composite Aggregations by removing unnecessary object allocations (#18531)
- [Star-Tree] Add search support for ip field type (#18671)
- [Derived Source] Add integration of derived source feature across various paths like get/search/recovery (#18565)
- Supporting Scripted Metric Aggregation when reducing aggregations in InternalValueCount and InternalAvg (18411))
- Support
search_after
numeric queries with Approximation Framework (#18896) - Add skip_list parameter to Numeric Field Mappers (default false) (#18889)
- Optimization in Numeric Terms Aggregation query for Large Bucket Counts(#18702)
- Map to proper GRPC status codes and achieve exception handling parity with HTTP APIs(#18925)
Changed
- Update Subject interface to use CheckedRunnable (#18570)
- Update SecureAuxTransportSettingsProvider to distinguish between aux transport types (#18616)
- Make node duress values cacheable (#18649)
- Change default value of remote_data_ratio, which is used in Searchable Snapshots and Writeable Warm from 0 to 5 and min allowed value to 1 (#18767)
- Making multi rate limiters in repository dynamic #18069
- Optimize grouping for segment concurrent search by ensuring that documents within each group are as equal as possible (#18451)
- Move transport-grpc from a core plugin to a module (#18897)
- Remove
experimental
designation from transport-grpc settings (#18915) - Rename package org.opensearch.plugin,transport.grpc to org.opensearch.transport.grpc (#18923)
Dependencies
- Bump
stefanzweifel/git-auto-commit-action
from 5 to 6 (#18524) - Bump Apache Lucene to 10.2.2 (#18573)
- Bump
org.apache.logging.log4j:log4j-core
from 2.24.3 to 2.25.1 (#18589, #18744) - Bump
com.google.code.gson:gson
from 2.13.0 to 2.13.1 (#18585) - Bump
com.azure:azure-core-http-netty
from 1.15.11 to 1.15.12 (#18586) - Bump
com.squareup.okio:okio
from 3.13.0 to 3.15.0 (#18645, #18689) - Bump
com.netflix.nebula.ospackage-base
from 11.11.2 to 12.0.0 (#18646) - Bump `com.azure:azure-storage-bl...
2.19.3
Version 2.19.3 Release Notes
Compatible with OpenSearch and OpenSearch Dashboards version 2.19.3
Added
- Reject close index requests, while remote store migration is in progress.(#18327)
Dependencies
- Bump
netty
from 4.1.118.Final to 4.1.121.Final (#18192) - Bump Apache Lucene to 9.12.2 (#18574)
- Bump
commons-beanutils:commons-beanutils
from 1.9.4 to 1.11.0 (#18401) - Bump
org.apache.poi
version from 5.2.5 to 5.4.1 in /plugins/ingest-attachment (#17887)
Fixed
- Use Bad Request status for InputCoercionException (#18161)
- Avoid NPE if on SnapshotInfo if 'shallow' boolean not present (#18187)
- Null check field names in QueryStringQueryBuilder (#18194)
- Fix illegal argument exception when creating a PIT (#16781)
- Fix the bug of Access denied error when rolling log files (#18597)
Changed
- Change single shard assignment log message from warn to debug (#18186)
3.1.0
2025-06-17 Version 3.1.0 Release Notes
[3.1]
Added
- Add support for linux riscv64 platform (#18156)
- [Rule based auto-tagging] Add get rule API (#17336)
- [Rule based auto-tagging] Add Delete Rule API (#18184)
- Add paginated wlm/stats API (#17638)
- [Rule based auto-tagging] Add Create rule API (#17792)
- Implement parallel shard refresh behind cluster settings (#17782)
- Bump OpenSearch Core main branch to 3.0.0 (#18039)
- [Rule based Auto-tagging] Add wlm
ActionFilter
(#17791) - [Rule based auto-tagging] Add update rule API (#17797)
- [Rule based auto-tagging] Bug fix for update rule api (#18488)
- Update API of Message in index to add the timestamp for lag calculation in ingestion polling (#17977)
- Add Warm Disk Threshold Allocation Decider for Warm shards (#18082)
- Add composite directory factory (#17988)
- [Rule based auto-tagging] Add refresh based synchronization service for
Rule
s (#18128) - Add pull-based ingestion error metrics and make internal queue size configurable (#18088)
- Adding support for derive source feature and implementing it for various type of field mappers (#17759)
- [Security Manager Replacement] Enhance Java Agent to intercept newByteChannel (#17989)
- Enabled Async Shard Batch Fetch by default (#18139)
- Allow to get the search request from the QueryCoordinatorContext (#17818)
- Reject close index requests, while remote store migration is in progress.(#18327)
- Improve sort-query performance by retaining the default
totalHitsThreshold
for approximatedmatch_all
queries (#18189) - Enable testing for ExtensiblePlugins using classpath plugins (#16908)
- Introduce system generated ingest pipeline (#17817))
- Added Auto Force Merge Manager to enhance hot to warm migration experience (#18229)
- Apply cluster state metadata and routing table diff when building cluster state from remote(#18256)
- Support create mode in pull-based ingestion and add retries for transient failures (#18250))
- Decouple the init of Crypto Plugin and KeyProvider in CryptoRegistry (18270))
- Support cluster write block in pull-based ingestion (#18280))
- Use QueryCoordinatorContext for the rewrite in validate API. (#18272)
- Upgrade crypto kms plugin dependencies for AWS SDK v2.x. (#18268)
- Add support for
matched_fields
with the unified highlighter (#18164) - Add BooleanQuery rewrite for must_not RangeQuery clauses (#17655)
- [repository-s3] Add support for SSE-KMS and S3 bucket owner verification (#18312)
- Optimize gRPC perf by passing by reference (#18303)
- Added File Cache Stats - Involves Block level as well as full file level stats (#17538)
- Added time_in_execution attribute to /_cluster/pending_tasks response (#17780)
- Added File Cache Pinning (#17617)
- Support consumer reset in Resume API for pull-based ingestion. This PR includes a breaking change for the experimental pull-based ingestion feature. (#18332)
- Add FIPS build tooling (#4254)
- Support Nested Aggregations as part of Star-Tree (#18048)
- [Star-Tree] Support for date-range queries with star-tree supported aggregations (#17855
- Added node-left metric to cluster manager (#18421)
- [Star tree] Remove star tree feature flag and add index setting to configure star tree search on index basis (#18070)
- Approximation Framework Enhancement: Update the BKD traversal logic to improve the performance on skewed data (#18439)
- Support system generated ingest pipelines for bulk update operations (#18277))
- Added FS Health Check Failure metric (#18435)
Changed
- Create generic DocRequest to better categorize ActionRequests (#18269))
- Change implementation for
percentiles
aggregation for latency improvement (#18124) - Update FipsMode check to catch NoSuchMethodError (#18427)
Dependencies
- Update Apache Lucene from 10.1.0 to 10.2.1 (#17961)
- Bump
com.google.code.gson:gson
from 2.12.1 to 2.13.1 (#17923, #18266) - Bump
com.github.spotbugs:spotbugs-annotations
from 4.9.0 to 4.9.3 (#17922) - Bump
com.microsoft.azure:msal4j
from 1.18.0 to 1.20.0 (#17925) - Update Apache HttpClient5 and HttpCore5 (CVE-2025-27820) (#18152)
- Bump
org.apache.commons:commons-collections4
from 4.4 to 4.5.0 (#18101) - Bump
netty
from 4.1.118.Final to 4.1.121.Final (#18192) - Bump
org.apache.commons:commons-configuration2
from 2.11.0 to 2.12.0 (#18103, #18262) - Bump
com.nimbusds:nimbus-jose-jwt
from 10.0.2 to 10.3 (#18104, #18336) - Bump
org.apache.commons:commons-text
from 1.13.0 to 1.13.1 (#18102) - Bump
reactor-netty
from 1.2.4 to 1.2.5 (#18243) - Bump
reactor
from 3.5.20 to 3.7.5 (#18243) - Bump
com.azure:azure-core-http-netty
from 1.15.7 to 1.15.11 (#18265) - Bump
lycheeverse/lychee-action
from 2.4.0 to 2.4.1 (#18264) - Bump
com.maxmind.geoip2:geoip2
from 4.2.1 to 4.3.1 (#18263, #18413) - Bump
com.azure:azure-json
from 1.3.0 to 1.5.0 (#18335) - Bump
org.jline:jline
from 3.29.0 to 3.30.4 (#18368, #18414) - Bump
com.nimbusds:oauth2-oidc-sdk
from 11.23.1 to 11.25 (#18369) - Bump
gradle/actions
from 3 to 4 (#18371) - Bump
com.azure:azure-storage-common
from 12.28.0 to 12.29.0 (#18415) - Bump
com.squareup.okio:okio
from 3.10.2 to 3.12.0 (#18468) - Bump
com.azure:azure-xml
from 1.1.0 to 1.2.0 ([#18469](#1...
3.0.0
2025-04-28 Version 3.0.0 Release Notes
[3.0.0]
Breaking Changes
- Upgrade to Lucene 10.1.0 - PR (#16366)
- JDK21 as minimum supported Java runtime (#10745)
- Remove deprecated terms from Java API (#5214)
- JPMS Support (Eliminate top level split packages ) Phase-0 only (#8110)
- Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
- Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
- Migrate client transports to Apache HttpClient / Core 5.x (#4459)
- Validation changes on the Bulk Index API like enforcing 512 byte _id size limit (#6595)
- Ability to use the node as coordinating node by passing node.roles as empty array (#3412)
- Treat Setting value with empty array string as empty array (#10625)
- Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11811)
- Setting a maximum depth for nested queries (#11670)
- Fix interchanged formats of total_indexing_buffer_in_bytes and total_indexing_buffer (#17070)
- Cleanup deprecated thread pool settings (#2595)
- Replace "blacklist/whitelist" terminology in Java APIs (#1683)
- Remove deprecated methods from JodaCompatibleZonedDateTime which are called by scripts (#3346)
- List of deprecated code removal in 3.0- partially done (#2773)
- Remove mmap.extensions setting (#9392)
- Remove COMPAT locale provider (#13988)
- Remove transport-nio plugin (#16887)
- Deprecate CamelCase PathHierarchy tokenizer name (#10894)
- Rename Class ending with Plugin to Module under modules dir (#4042)
- Remove deprecated
batch_size
parameter from_bulk
(#14283) - Unset discovery nodes for every transport node actions request (#17682)
Added
- Support for HTTP/2 (server-side) (#3847)
- Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
- Add events correlation engine plugin (#6854)
- Implement on behalf of token passing for extensions (#8679, #10664)
- Provide service accounts tokens to extensions (#9618)
- GHA to verify checklist items completion in PR descriptions (#10800)
- [WLM] Add WLM support for search scroll API (#16981)
- Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
- Add systemd configurations to strengthen OS core security (#17107)
- Added pull-based Ingestion (APIs, for ingestion source, a Kafka plugin, and IngestionEngine that pulls data from the ingestion source) (#16958)
- Added ConfigurationUtils to core for the ease of configuration parsing #17223
- Add cluster and index level settings to limit the total primary shards per node and per index #17295
- Add execution_hint to cardinality aggregator request (#17312)
- Arrow Flight RPC plugin with Flight server bootstrap logic and client for internode communication (#16962)
- Added offset management for the pull-based Ingestion (#17354)
- Added integ tests for systemd configs (#17410)
- Add filter function for AbstractQueryBuilder, BoolQueryBuilder, ConstantScoreQueryBuilder(#17409)
- [Star Tree] [Search] Resolving keyword & numeric bucket aggregation with metric aggregation using star-tree (#17165)
- Added error handling support for the pull-based ingestion (#17427)
- Added Warm index setting and Updated nomenclature to differentiate between hot and warm tiering implementation (#17490)
- Latency and Memory allocation improvements to Multi Term Aggregation queries (#14993)
- Add logic in master service to optimize performance and retain detailed logging for critical cluster operations. (#14795)
- Add Setting to adjust the primary constraint weights (#16471)
- Introduce a setting to disable download of full cluster state from remote on term mismatch(#16798)
- Added ability to retrieve value from DocValues in a flat_object filed(#16802)
- Improve performace of NumericTermAggregation by avoiding unnecessary sorting(#17252)
- Fix Bug - Handle unsigned long in sorting order assertion of LongHashSet (#17207)
- Implemented computation of segment replication stats at shard level (#17055)
- [Rule Based Auto-tagging] Add in-memory attribute value store (#17342)
- Change priority for scheduling reroute during timeout(#16445)
- [Rule Based Auto-tagging] Add rule schema for auto tagging (#17238)
- Renaming the node role search to warm (#17573)
- Introduce a new search node role to hold search only shards (#17620)
- Fix systemd integTest on deb regarding path ownership check (#17641)
- Add dfs transformation function in XContentMapValues (#17612)
- Add tracking for long-running SearchTask post cancellation (#17726)
- Added Kinesis support as a plugin for the pull-based ingestion (#17615)
- Add FilterFieldType for developers who want to wrap MappedFieldType (#17627)
- [Rule Based Auto-tagging] Add in-memory rule processing service (#17365)
- [Security Manager Replacement] Create initial Java Agent to intercept Socket::connect calls (#17724)
- Faster
terms_query
with already sorted terms (#17714) - Add ingestion management APIs for pause, resume and get ingestion state (#17631)
- [Security Manager Replacement] Enhance Java Agent to intercept System::exit (#17746)
- [Security Manager Replacement] Add a policy parser for Java agent security policies (#17753)
- [Security Manager Replacement] Implement File Interceptor and add integration tests (#17760)
- [Security Manager Replacement] Enhance Java Agent to intercept Runtime::halt (#17757)
- [Security Manager Replacement] Phase off SecurityManager usage in favor of Java Agent ([#1786...
3.0.0-beta1
2025-04-15 Version 3.0.0-beta1 Release Notes
[3.0.0]
Breaking Changes
- Upgrade to Lucene 10.1.0 - PR (#16366)
- JDK21 as minimum supported Java runtime (#10745)
- Remove deprecated terms from Java API (#5214)
- JPMS Support (Eliminate top level split packages ) Phase-0 only (#8110)
- Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
- Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
- Migrate client transports to Apache HttpClient / Core 5.x (#4459)
- Validation changes on the Bulk Index API like enforcing 512 byte _id size limit (#6595)
- Ability to use the node as coordinating node by passing node.roles as empty array (#3412)
- Treat Setting value with empty array string as empty array (#10625)
- Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11811)
- Setting a maximum depth for nested queries (#11670)
- Fix interchanged formats of total_indexing_buffer_in_bytes and total_indexing_buffer (#17070)
- Cleanup deprecated thread pool settings (#2595)
- Replace "blacklist/whitelist" terminology in Java APIs (#1683)
- Remove deprecated methods from JodaCompatibleZonedDateTime which are called by scripts (#3346)
- List of deprecated code removal in 3.0- partially done (#2773)
- Remove mmap.extensions setting (#9392)
- Remove COMPAT locale provider (#13988)
- Remove transport-nio plugin (#16887)
- Deprecate CamelCase PathHierarchy tokenizer name (#10894)
- Rename Class ending with Plugin to Module under modules dir (#4042)
- Remove deprecated
batch_size
parameter from_bulk
(#14283)
Added
- Support for HTTP/2 (server-side) (#3847)
- Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
- Add events correlation engine plugin (#6854)
- Implement on behalf of token passing for extensions (#8679, #10664)
- Provide service accounts tokens to extensions (#9618)
- GHA to verify checklist items completion in PR descriptions (#10800)
- [WLM] Add WLM support for search scroll API (#16981)
- Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
- Add systemd configurations to strengthen OS core security (#17107)
- Added pull-based Ingestion (APIs, for ingestion source, a Kafka plugin, and IngestionEngine that pulls data from the ingestion source) (#16958)
- Added ConfigurationUtils to core for the ease of configuration parsing #17223
- Add cluster and index level settings to limit the total primary shards per node and per index #17295
- Add execution_hint to cardinality aggregator request (#17312)
- Arrow Flight RPC plugin with Flight server bootstrap logic and client for internode communication (#16962)
- Added offset management for the pull-based Ingestion (#17354)
- Added integ tests for systemd configs (#17410)
- Add filter function for AbstractQueryBuilder, BoolQueryBuilder, ConstantScoreQueryBuilder(#17409)
- [Star Tree] [Search] Resolving keyword & numeric bucket aggregation with metric aggregation using star-tree (#17165)
- Added error handling support for the pull-based ingestion (#17427)
- Added Warm index setting and Updated nomenclature to differentiate between hot and warm tiering implementation (#17490)
- Latency and Memory allocation improvements to Multi Term Aggregation queries (#14993)
- Add logic in master service to optimize performance and retain detailed logging for critical cluster operations. (#14795)
- Add Setting to adjust the primary constraint weights (#16471)
- Introduce a setting to disable download of full cluster state from remote on term mismatch(#16798)
- Added ability to retrieve value from DocValues in a flat_object filed(#16802)
- Improve performace of NumericTermAggregation by avoiding unnecessary sorting(#17252)
- Fix Bug - Handle unsigned long in sorting order assertion of LongHashSet (#17207)
- Implemented computation of segment replication stats at shard level (#17055)
- [Rule Based Auto-tagging] Add in-memory attribute value store (#17342)
- Change priority for scheduling reroute during timeout(#16445)
- [Rule Based Auto-tagging] Add rule schema for auto tagging (#17238)
- Renaming the node role search to warm (#17573)
- Introduce a new search node role to hold search only shards (#17620)
- Fix systemd integTest on deb regarding path ownership check (#17641)
- Add dfs transformation function in XContentMapValues (#17612)
- Add tracking for long-running SearchTask post cancellation (#17726)
- Added Kinesis support as a plugin for the pull-based ingestion (#17615)
- Add FilterFieldType for developers who want to wrap MappedFieldType (#17627)
- [Rule Based Auto-tagging] Add in-memory rule processing service (#17365)
- [Security Manager Replacement] Create initial Java Agent to intercept Socket::connect calls (#17724)
- Faster
terms_query
with already sorted terms (#17714) - Add ingestion management APIs for pause, resume and get ingestion state (#17631)
- [Security Manager Replacement] Enhance Java Agent to intercept System::exit (#17746)
- [Security Manager Replacement] Add a policy parser for Java agent security policies (#17753)
- [Security Manager Replacement] Implement File Interceptor and add integration tests (#17760)
- [Security Manager Replacement] Enhance Java Agent to intercept Runtime::halt (#17757)
- [Security Manager Replacement] Phase off SecurityManager usage in favor of Java Agent (#17861)
- Support AutoExpand for SearchReplica ([#17741](https://github.co...
2.19.2
Version 2.19.2 Release Notes
Compatible with OpenSearch and OpenSearch Dashboards version 2.19.2
Added
Dependencies
- Update tj-actions/changed-files usage from the Github Action checks since it has been compromised (#17601)
Changed
Deprecated
Fixed
3.0.0-alpha1
2025-03-17 Version 3.0.0-alpha1 Release Notes
[3.0.0]
Breaking Changes
- Upgrade to Lucene 10.1.0 - PR (#16366)
- JDK21 as minimum supported Java runtime (#10745)
- Remove deprecated terms from Java API (#5214)
- JPMS Support (Eliminate top level split packages ) Phase-0 only (#8110)
- Add ThreadContextPermission for stashAndMergeHeaders and stashWithOrigin (#15039)
- Add ThreadContextPermission for markAsSystemContext and allow core to perform the method (#15016)
- Migrate client transports to Apache HttpClient / Core 5.x (#4459)
- Validation changes on the Bulk Index API like enforcing 512 byte _id size limit (#6595)
- Ability to use the node as coordinating node by passing node.roles as empty array (#3412)
- Treat Setting value with empty array string as empty array (#10625)
- Ensure Jackson default maximums introduced in 2.16.0 do not conflict with OpenSearch settings (#11811)
- Setting a maximum depth for nested queries (#11670)
- Fix interchanged formats of total_indexing_buffer_in_bytes and total_indexing_buffer (#17070)
- Cleanup deprecated thread pool settings (#2595)
- Replace "blacklist/whitelist" terminology in Java APIs (#1683)
- Remove deprecated methods from JodaCompatibleZonedDateTime which are called by scripts (#3346)
- List of deprecated code removal in 3.0- partially done (#2773)
- Remove mmap.extensions setting (#9392)
- Remove COMPAT locale provider (#13988)
- Remove transport-nio plugin (#16887)
- Deprecate CamelCase PathHierarchy tokenizer name (#10894)
- Rename Class ending with Plugin to Module under modules dir (#4042)
Added
- Support for HTTP/2 (server-side) (#3847)
- Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
- Add events correlation engine plugin (#6854)
- Implement on behalf of token passing for extensions (#8679, #10664)
- Provide service accounts tokens to extensions (#9618)
- GHA to verify checklist items completion in PR descriptions (#10800)
- [WLM] Add WLM support for search scroll API (#16981)
- Views, simplify data access and manipulation by providing a virtual layer over one or more indices (#11957)
- Add systemd configurations to strengthen OS core security (#17107)
- Added pull-based Ingestion (APIs, for ingestion source, a Kafka plugin, and IngestionEngine that pulls data from the ingestion source) (#16958)
- Added ConfigurationUtils to core for the ease of configuration parsing #17223
- Add cluster and index level settings to limit the total primary shards per node and per index #17295
- Add execution_hint to cardinality aggregator request (#17312)
- Arrow Flight RPC plugin with Flight server bootstrap logic and client for internode communication (#16962)
- Added offset management for the pull-based Ingestion (#17354)
- Added integ tests for systemd configs (#17410)
- Add filter function for AbstractQueryBuilder, BoolQueryBuilder, ConstantScoreQueryBuilder(#17409)
- [Star Tree] [Search] Resolving keyword & numeric bucket aggregation with metric aggregation using star-tree (#17165)
- Added error handling support for the pull-based ingestion (#17427)
- Added Warm index setting and Updated nomenclature to differentiate between hot and warm tiering implementation (#17490)
- Latency and Memory allocation improvements to Multi Term Aggregation queries (#14993)
- Add logic in master service to optimize performance and retain detailed logging for critical cluster operations. (#14795)
- Add Setting to adjust the primary constraint weights (#16471)
- Introduce a setting to disable download of full cluster state from remote on term mismatch(#16798)
- Added ability to retrieve value from DocValues in a flat_object filed(#16802)
- Improve performace of NumericTermAggregation by avoiding unnecessary sorting(#17252)
- Fix Bug - Handle unsigned long in sorting order assertion of LongHashSet (#17207)
- Implemented computation of segment replication stats at shard level (#17055)
- [Rule Based Auto-tagging] Add in-memory attribute value store (#17342)
Dependencies
- Bump Apache HttpCore5/HttpClient5 dependencies from 5.2.5/5.3.1 to 5.3.1/5.4.1 to support ExtendedSocketOption in HttpAsyncClient (#16757)
- Bumps
jetty
version from 9.4.55.v20240627 to 9.4.57.v20241219 (#17395) - Switch main/3.x to use JDK21 LTS version (#17515)
- Bump
org.awaitility:awaitility
from 4.2.0 to 4.3.0 (#17230, #17439) - Bump
dnsjava:dnsjava
from 3.6.2 to 3.6.3 (#17231) - Bump
com.google.code.gson:gson
from 2.11.0 to 2.12.1 (#17229) - Bump
org.jruby.joni:joni
from 2.2.1 to 2.2.3 (#17136) - Bump
org.apache.ant:ant
from 1.10.14 to 1.10.15 (#17288) - Bump
reactor_netty
from 1.1.26 to 1.1.27 (#17322) - Bump
me.champeau.gradle.japicmp
from 0.4.5 to 0.4.6 (#17375) - Bump
com.google.api.grpc:proto-google-common-protos
from 2.37.1 to 2.52.0 (#17379) - Bump
net.minidev:json-smart
from 2.5.1 to 2.5.2 (#17378) - Bump
com.netflix.nebula.ospackage-base
from 11.10.1 to 11.11.1 (#17374) - Bump
ch.qos.logback:logback-classic
from 1.5.16 to 1.5.17 (#17497) - Bump
software.amazon.awssdk
from 2.20.86 to 2.30.31 (#17396) - Bump
org.jruby.jcodings:jcodings
from 1.0.61 to 1.0.63 (#17560) - Bump
com.azure:azure-storage-blob
from 12.28.1 to 12.29.1 (#17562)
Changed
2.19.1
2025-02-27 Version 2.19.1 Release Notes
[2.19.1]
Added
- Add execution_hint to cardinality aggregator request (#17420)
Dependencies
- Bump netty from 4.1.117.Final to 4.1.118.Final (#17320)
- Bump
jetty
version from 9.4.55.v20240627 to 9.4.57.v20241219
Changed
Deprecated
Fixed
- Fix HTTP API calls that hang with 'Accept-Encoding: zstd' (#17408)
1.3.20
2024-12-09 Version 1.3.20 Release Notes
Dependencies
- Bump
icu4j
from 62.1 to 62.2 (#15469) - Bump
org.bouncycastle:bc-fips
from 1.0.2.4 to 1.0.2.5 (#13446) - Bump
Netty
from 4.1.112.Final to 4.1.115.Final (#16661) - Bump
avro
from 1.11.3 to 1.11.4 (#16773) - Bump
commonsio
to 2.16.0 (#16780) - Bump
protobuf-java
to 3.25.5 (#16792) - Bump
snappy-java
to 1.1.10.7 (#16792) - Bump
mime4j-core
to 0.8.11 (#16810)
Fixed
2.18.0
2024-10-28 Version 2.18.0 Release Notes
[2.18.0]
Added
- [Workload Management] Add orchestrator for wlm resiliency (QueryGroupService) (#15925)
- [Offline Nodes] Adds offline-tasks library containing various interfaces to be used for Offline Background Tasks. (#13574)
- Add support for async deletion in S3BlobContainer (#15621)
- [Workload Management] QueryGroup resource cancellation framework changes (#15651)
- [Workload Management] Add QueryGroup Stats API Logic (15777)
- Implement WithFieldName interface in ValuesSourceAggregationBuilder & FieldSortBuilder (#15916)
- Add successfulSearchShardIndices in searchRequestContext (#15967, #16110)
- Fallback to Remote cluster-state on Term-Version check mismatch - (#15424)
- [Tiered Caching] Segmented cache changes (#16047)
- Add support for msearch API to pass search pipeline name - (#15923)
- Add success and failure metrics for async shard fetch (#15976)
- Add support to dynamically resize threadpools size. (#16236)
- [S3 Repository] Change default retry mechanism of s3 clients to Standard Mode (#15978)
- [Workload Management] Add Integration Tests for Workload Management CRUD APIs (#15955)
- Add new metric REMOTE_STORE to NodeStats API response (#15611)
- New
phone
&phone-search
analyzer + tokenizer (#15915) - Add _list/indices API as paginated alternate to _cat/indices (#14718)
- Add changes to block calls in cat shards, indices and segments based on dynamic limit settings (#15986)
- Flat object field use IndexOrDocValuesQuery to optimize query (#14383)
- Add method to return dynamic SecureTransportParameters from SecureTransportSettingsProvider interface (#16387
- Add _list/shards API as paginated alternate to _cat/shards (#14641)
- [Star Tree - Search] Add support for metric aggregations with/without term query (15289)
- URI path filtering support in cluster stats API (#15938)
- Add support for renaming aliases during snapshot restore (#16292)
Dependencies
- Bump
org.apache.logging.log4j:log4j-core
from 2.23.1 to 2.24.0 (#15858) - Bump
com.azure:azure-identity
from 1.13.0 to 1.13.2 (#15578) - Bump
protobuf
from 3.22.3 to 3.25.4 (#15684) - Bump
peter-evans/create-pull-request
from 6 to 7 (#15863) - Bump
com.nimbusds:oauth2-oidc-sdk
from 11.9.1 to 11.19.1 (#15862) - Bump
com.microsoft.azure:msal4j
from 1.17.0 to 1.17.2 (#15945, #16406) - Bump
ch.qos.logback:logback-core
from 1.5.6 to 1.5.10 (#15946, #16307) - Update protobuf from 3.25.4 to 3.25.5 (#16011)
- Bump
org.roaringbitmap:RoaringBitmap
from 1.2.1 to 1.3.0 (#16040) - Bump
com.nimbusds:nimbus-jose-jwt
from 9.40 to 9.41.1 (#16038) - Bump
actions/github-script
from 5 to 7 (#16039) - Bump
dnsjava:dnsjava
from 3.6.1 to 3.6.2 (#16041) - Bump
com.maxmind.geoip2:geoip2
from 4.2.0 to 4.2.1 (#16042) - Bump
com.maxmind.db:maxmind-db
from 3.1.0 to 3.1.1 (#16137) - Bump Apache lucene from 9.11.1 to 9.12.0 (#15333)
- Bump
com.azure:azure-core-http-netty
from 1.15.3 to 1.15.5 (#16133, #16311) - Bump
netty
from 4.1.112.Final to 4.1.114.Final (#16182) - Bump
com.google.api-client:google-api-client
from 2.2.0 to 2.7.0 (#16216) - Bump
com.azure:azure-json
from 1.1.0 to 1.3.0 (#16217) - Bump
io.grpc:grpc-api
from 1.57.2 to 1.68.0 (#16213) - Bump
org.jline:jline
from 3.26.3 to 3.27.0 (#16135) - Bump
com.squareup.okio:okio
from 3.9.0 to 3.9.1 (#16212) - Bump
lycheeverse/lychee-action
from 1.10.0 to 2.0.2 (#16310) - Bump
com.google.code.gson:gson
from 2.10.1 to 2.11.0 (#16308) - Bump
io.grpc:grpc-api
from 1.57.2 to 1.68.0 (#16213) - Bump
me.champeau.gradle.japicmp
from 0.4.3 to 0.4.4 (#16309) - Bump
com.google.oauth-client:google-oauth-client
from 1.35.0 to 1.36.0 (#16306)
Changed
- Add support for docker compose v2 in TestFixturesPlugin (#16049)
- Remove identity-related feature flagged code from the RestController (#15430)
- Remove Identity FeatureFlag (#16024)
- Ensure RestHandler.Wrapper delegates all implementations to the wrapped handler (#16154)
- Enable coordinator search.request_stats_enabled by default (#16290)
- Optimise clone operation for incremental full cluster snapshots (#16296)
- Code cleanup: Remove ApproximateIndexOrDocValuesQuery (#16273)
- Update last seen cluster state in the commit phase (#16215)
- Make multiple settings dynamic for tuning on larger clusters(#16347)
Fixed
- Fix wildcard query containing escaped character (#15737)
- Fix case-insensitive query on wildcard field (#15882)
- Add validation for the search backpressure cancellation settings (#15501)
- Fix search_as_you_type not supporting multi-fields (#15988)
- Avoid infinite loop when
flat_object
field contains invalid token (#15985) - Fix infinite loop in nested agg (#15931)
- Fix update settings with null replica not honoring cluster setting bug (#14948)
- Fix race condition in node-join and node-left (#15521)
- Streaming bulk request hangs (#16158)
- Fix warnings from SLF4J on startup when repository-s3 is installed (#16194)
- Fix protobuf-java leak through client library dependencies (#16254)
- Fix multi-search with template doesn't return status code (#16265)
- [Streaming Indexing] Fix intermittent 'The bulk request must be terminated by a newline [\n]' fa...