Skip to content

Commit

Permalink
Update docs/proposals/ShardingFormalism.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kevinch-nv authored Nov 20, 2024
1 parent 36689e5 commit 8939ddf
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/proposals/ShardingFormalism.md
Original file line number Diff line number Diff line change
Expand Up @@ -184,7 +184,7 @@ This rule is extended to the case of more than two broadcast axes accordingly.
**Constraints on input sharding**
* No constraints on input sharding.
* Sharding along non-reduction axes is straightforward. It indicates
parallelization of the iteration over the non-reduction axes, and is straightforward.
parallelization of the iteration over the non-reduction axes.
* Sharding along reduction axes is permitted. It indicates parallelization of the reduction
loop, but this involves performing the reduction in two steps. In the first step, the
reduction is done locally on the shard, and in the second step the reduction is done
Expand Down

0 comments on commit 8939ddf

Please sign in to comment.