Skip to content

Commit

Permalink
update docstring
Browse files Browse the repository at this point in the history
  • Loading branch information
samsja committed Sep 26, 2024
1 parent 3be4213 commit df1616c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/zeroband/diloco.py
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@ def sync_pseudo_gradient(self, model: nn.Module):

def sync_inner_model(self, model: nn.Module):
"""
Sync the inner model from the global process group to the local process group
Sync the inner model from the CPU outer model to GPU
"""

self._logger.debug("sync inner model")
Expand Down

0 comments on commit df1616c

Please sign in to comment.