Implement configurable memory limiting

[oleg-lvovitch-aws]

Tell us more about this new feature.

This has been requested by several customers and is necessary to integrate into products like Trino.
Currently we allocate memory as we see fit, maximizing for performance and cache hits. We need to implement a mechanism by which the library can be configured to not exceed certain memory footprint at any given time.
We should primarily focus on the Block allocations, as those are the primary source of memory pressure.

Code of Conduct

• I agree to follow this project's Code of Conduct