Skip to content

Commit af74343

Browse files
Update README with list of supported nn modules
1 parent a047153 commit af74343

File tree

1 file changed

+43
-0
lines changed

1 file changed

+43
-0
lines changed

README.md

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -203,6 +203,49 @@ The repository contains custom online inference-friendly versions of common netw
203203
- `co.continual` - conversion function from non-continual modules to continual modules
204204
- `co.forward_stepping` - functional wrapper, which enhances temporally local non-continual modules with the forward_stepping functions
205205

206+
In addition, we support a wide range of modules from `torch.nn`:
207+
208+
- Activation
209+
- `nn.BatchNorm1d`
210+
- `nn.Threshold`
211+
- `nn.ReLU`
212+
- `nn.RReLU`
213+
- `nn.Hardtanh`
214+
- `nn.ReLU6`
215+
- `nn.Sigmoid`
216+
- `nn.Hardsigmoid`
217+
- `nn.Tanh`
218+
- `nn.SiLU`
219+
- `nn.Hardswish`
220+
- `nn.ELU`
221+
- `nn.CELU`
222+
- `nn.SELU`
223+
- `nn.GLU`
224+
- `nn.GELU`
225+
- `nn.Hardshrink`
226+
- `nn.LeakyReLU`
227+
- `nn.LogSigmoid`
228+
- `nn.Softplus`
229+
- `nn.Softshrink`
230+
- `nn.PReLU`
231+
- `nn.Softsign`
232+
- `nn.Tanhshrink`
233+
- `nn.Softmin`
234+
- `nn.Softmax`
235+
- `nn.Softmax2d`
236+
- `nn.LogSoftmax`
237+
238+
- Batch Normalisation
239+
- `nn.BatchNorm1d`
240+
- `nn.BatchNorm2d`
241+
- `nn.BatchNorm3d`
242+
243+
- Dropout
244+
- `nn.Dropout`
245+
- `nn.Dropout2d`
246+
- `nn.Dropout3d`
247+
- `nn.AlphaDropout`
248+
- `nn.FeatureAlphaDropout`
206249

207250
## Advanced examples
208251

0 commit comments

Comments
 (0)