Performance: Forwarding

[bw-solana]

Forwarding is entirely broken by design.

The bandwidth available to swqos peers to send me to forward, by design, is much higher than the bandwidth I have in swqos to the leader, which means that when we're forwarding, the forwarding buffer gets huge since ingest rate >> output rate. But this seems fixable if staked overrides don’t grant more than their own stake amount to peers.

Forwarding is entangled with the scheduler, which is currently in the performance critical path. Forwarding is being split out into separate stage (decouple from banking stage).

• ForwardingStage #3222