[WIP] Streaming DiLoCo prototype#203

H-Huang wants to merge 1 commit intometa-pytorch:mainmeta-pytorch/torchft:mainfrom

H-Huang:streaming_dilocoH-Huang/torchft:streaming_dilocoCopy head branch name to clipboard