Skip to content
This repository has been archived by the owner on Apr 1, 2024. It is now read-only.

[DON'T MERGE] Show diff between branch-2.10.5.11 and 99cb86 special release #5988

Open
wants to merge 8 commits into
base: branch-2.10.5.11
Choose a base branch
from

Commits on Dec 28, 2023

  1. InflightReadsLimiter - limit the memory used by reads end-to-end (#5920)

    * InflightReadsLimiter - limit the memory used by reads end-to-end (from storage/cache to the write to the consumer channel) (apache#18245)
    
    * InflightReadsLimiter - limit the memory used by reads end-to-end (from storage/cache to the write to the consumer channel)
    
    Motivation:
    
    Broker can go out of memory due to many reads enqueued on the PersistentDispatcherMultipleConsumers dispatchMessagesThread (that is used in case of dispatcherDispatchMessagesInSubscriptionThread set to true, that is the default value)
    The limit of the amount of memory retained due to reads MUST take into account also the entries coming from the Cache.
    
    When dispatcherDispatchMessagesInSubscriptionThread is false (the behaviour of Pulsar 2.10) there is some kind of natural (but still unpredictable!!) back pressure mechanism because the thread that receives the entries from BK of the cache dispatches immediately and synchronously the entries to the consumer and releases them
    
    Modifications:
    
    - Add a new component (InflightReadsLimiter) that keeps track of the overall amount of memory retained due to inflight reads.
    - Add a new configuration entry managedLedgerMaxReadsInFlightSizeInMB
    - The feature is disabled by default
    - Add new metrics to track the values
    
    * Change error message
    
    * checkstyle
    
    * Fix license
    
    * remove duplicate method after cherry-pick
    
    * Rename onDeallocate
    
    (cherry picked from commit 6fec66b)
    (cherry picked from commit 47c98e5)
    
    * [fix][broker][branch-2.10] limit the memory used by reads end-to-end
    
    (cherry picked from commit eeb80e1)
    
    * remove gpg plugin
    
    * remove release profile
    
    * remove release plugin
    
    * Revert "remove release plugin"
    
    This reverts commit 20522ea.
    
    * Revert "remove release profile"
    
    This reverts commit 64627fd.
    
    * Revert "remove gpg plugin"
    
    This reverts commit 8054d59.
    
    ---------
    
    Co-authored-by: Enrico Olivelli <[email protected]>
    2 people authored and mattisonchao committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    36c383c View commit details
    Browse the repository at this point in the history
  2. Revert "Revert "[improve][broker][branch-2.10] Backport Linux metrics…

    … changes from master branch (apache#20659)""
    
    This reverts commit a47c6ac.
    mattisonchao committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    01717a0 View commit details
    Browse the repository at this point in the history
  3. [improve][sec] Support for Elliptic Curve Cryptography (EC, ECC) (cer…

    …tificates/private keys) (apache#21621)
    
    (cherry picked from commit e1d06b5)
    mattisonchao committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    9546a04 View commit details
    Browse the repository at this point in the history
  4. By pass gpg check

    mattisonchao committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    9a7d504 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2023

  1. Configuration menu
    Copy the full SHA
    b92e928 View commit details
    Browse the repository at this point in the history
  2. Fix license check

    mattisonchao committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    b773e5b View commit details
    Browse the repository at this point in the history
  3. Fix flaky test

    mattisonchao committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    d20dede View commit details
    Browse the repository at this point in the history

Commits on Jan 1, 2024

  1. Revert "By pass gpg check"

    This reverts commit 9a7d504.
    mattisonchao committed Jan 1, 2024
    Configuration menu
    Copy the full SHA
    614c474 View commit details
    Browse the repository at this point in the history