Scalable jobserver for rustc#7731

Merged

bors merged 26 commits intorust-lang:masterfrom

Mark-Simulacrum:chatty-jobserver

Jan 22, 2020

Commits on Jan 22, 2020

Wire up methods for informing job queue of rustc jobserver state
Mark-Simulacrum
committed
Communicate jobserver information with each rustc
Mark-Simulacrum
committed
Record the amount of rustc internal parallelism
Mark-Simulacrum
committed
Add documentation about the job queue and rustc
Mark-Simulacrum
committed
Gate Cargo changes behind -Zjobserver-per-rustc
Mark-Simulacrum
committed
Introduce newtype wrapping JobId
Mark-Simulacrum
committed
Drop crossbeam scopes from job queue
Mark-Simulacrum
committed
Move local variables to struct fields
Mark-Simulacrum
committed
Split out work spawning
Mark-Simulacrum
committed
Split out granting rustc token requests
Mark-Simulacrum
committed
Split out event handler into separate function
Mark-Simulacrum
committed
Split waiting for an event out of the primary drainer
Mark-Simulacrum
committed
Do not send acquired tokens to waiting rustc threads
Mark-Simulacrum
committed
Refactor rustc_tokens to a HashMap
Mark-Simulacrum
committed
Document ordering constraint on providing thread tokens
Mark-Simulacrum
committed
Take JobQueue by-value in drain_the_queue
Mark-Simulacrum
committed
Move transient state to separate struct
Mark-Simulacrum
committed
Add some commentary
Mark-Simulacrum
committed
Pop thread token requests from the front
Mark-Simulacrum
committed
Reintroduce crossbeam threads
Mark-Simulacrum
committed
Refactor rustc thread granting loop
Mark-Simulacrum
committed
Use an expect instead of directly panicking
Mark-Simulacrum
committed
Refactor to_send_clients to use a BTreeMap
Mark-Simulacrum
committed
Elaborate on some documentation
Mark-Simulacrum
committed
Stop threading Client through into the NeedsToken message
Mark-Simulacrum
committed
Move token truncation to just before waiting
Mark-Simulacrum
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Scalable jobserver for rustc#7731

Scalable jobserver for rustc#7731
bors merged 26 commits intorust-lang:masterfrom
Mark-Simulacrum:chatty-jobserver

Commits on Jan 22, 2020

Wire up methods for informing job queue of rustc jobserver state

Communicate jobserver information with each rustc

Record the amount of rustc internal parallelism

Add documentation about the job queue and rustc

Gate Cargo changes behind -Zjobserver-per-rustc

Introduce newtype wrapping JobId

Drop crossbeam scopes from job queue

Move local variables to struct fields

Split out work spawning

Split out granting rustc token requests

Split out event handler into separate function

Split waiting for an event out of the primary drainer

Do not send acquired tokens to waiting rustc threads

Refactor rustc_tokens to a HashMap

Document ordering constraint on providing thread tokens

Take JobQueue by-value in drain_the_queue

Move transient state to separate struct

Add some commentary

Pop thread token requests from the front

Reintroduce crossbeam threads

Refactor rustc thread granting loop

Use an expect instead of directly panicking

Refactor to_send_clients to use a BTreeMap

Elaborate on some documentation

Stop threading Client through into the NeedsToken message

Move token truncation to just before waiting