CHANGELOG.md

0.0.26 (2022-02-13)

Bug Fixes

• type: fix some code mistake (3e1a81d)

Features

• ddp: logger when rank == 0, or no ddp (792709b)
• decode: add some transformer decode code (52b044b)
• schedule: cosine schedule with warmup (87c8886)

Performance Improvements

• runner: logger missing_keys and unexpected_key in runner (a9e3ff9)

0.0.20 (2022-02-02)

Bug Fixes

• bert: change LayerNorm to layer_norm (a99831e)

Features

• bert: add tokenizer part (054df14)
• layers: fix import for layerNorm (eb61b31)
• nlp: init basic bert code (f9cb13a)