File tree Expand file tree Collapse file tree 1 file changed +4
-4
lines changed Expand file tree Collapse file tree 1 file changed +4
-4
lines changed Original file line number Diff line number Diff line change @@ -198,14 +198,14 @@ environment.
198198 logger.info(f " { self .uid} trainer cleaned up " )
199199
200200 Actor endpoints can be invoked in a variety of patterns. We'll explore a concrete example in `Step 4: Execute the Training Workflow `_,
201- but here are some common usages:
201+ but here is some pseudocode with common usages:
202202
203203.. code-block :: python
204204
205205 try :
206- # where mesh0 is 4 nodes * 8 GPUs
207- proc_mesh = mesh0.spawn_procs({" gpus" : 32 })
208- trainer_actors = proc_mesh.spawn(... )
206+ # where mesh0 is made of N nodes, each node having 8 GPUs
207+ proc_mesh = mesh0.spawn_procs({" gpus" : 8 })
208+ trainer_actors = proc_mesh.spawn(" trainers " , TrainerActor, ... )
209209
210210 # Call on all ranks
211211 await trainer_actors.ping_rank.call()
You can’t perform that action at this time.
0 commit comments