allow filtering by limit and offset or using a cursor on the results

[dwiel]

No description provided.

[dwiel]

This is difficult. The simplest solution I can think of at the moment is to convert the execution model to use generators so that limit can simply be use at the end to only pull the first N elements out of the iterator. Otherwise, it may be difficult to communicate the limit throughout the query. There would be backtracking when you pull the first 10 elements out of a function, then place a constraint which brings the count down to 5, so you have to go back to the first function and get 5 more out, then run constraints on those, etc.

Also complicating matters are optimizations which require many -> many operations, like SQL queries where it is easier to pass a set of ids in and get a set out, then to make many small queries with one id each. Perhaps even in this case the SQL driver can support a generator model of return.