Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large field caps requests can cause memory pressure in smaller heaps #110130

Open
benwtrent opened this issue Jun 25, 2024 · 1 comment
Open

Large field caps requests can cause memory pressure in smaller heaps #110130

benwtrent opened this issue Jun 25, 2024 · 1 comment
Labels
>enhancement :Search/Search Search-related issues that do not fall into other categories Team:Search Foundations Meta label for the Search Foundations team in Elasticsearch Team:Search Meta label for search team

Comments

@benwtrent
Copy link
Member

Description

When using a smaller heap, and gathering a large number of field caps, the memory pressure can be pretty large.

For example, some of the smaller heap sizes seen are < 1GB in size, but its possible for a field-caps response to use more than 200MB. One API request taking >20% of heap can cause issues.

This issue is to track two possible things:

  • Should we and can we track field caps in the circuit breaker?
  • Can we reject exceptionally large field-caps requests (by default) on tiny heaps?
  • Is there any way to make heap usage for field-caps any cheaper?

These are rather, ambitious and potentially ambiguous questions. Opening this issue for potential discussion.

@benwtrent benwtrent added >enhancement :Search/Search Search-related issues that do not fall into other categories Team:Search Foundations Meta label for the Search Foundations team in Elasticsearch labels Jun 25, 2024
@elasticsearchmachine elasticsearchmachine added the Team:Search Meta label for search team label Jun 25, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

@javanna javanna removed the Team:Search Meta label for search team label Jun 25, 2024
@elasticsearchmachine elasticsearchmachine added the Team:Search Meta label for search team label Jun 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :Search/Search Search-related issues that do not fall into other categories Team:Search Foundations Meta label for the Search Foundations team in Elasticsearch Team:Search Meta label for search team
Projects
None yet
Development

No branches or pull requests

3 participants