File tree Expand file tree Collapse file tree 1 file changed +43
-0
lines changed Expand file tree Collapse file tree 1 file changed +43
-0
lines changed Original file line number Diff line number Diff line change @@ -203,6 +203,49 @@ The repository contains custom online inference-friendly versions of common netw
203
203
- ` co.continual ` - conversion function from non-continual modules to continual modules
204
204
- ` co.forward_stepping ` - functional wrapper, which enhances temporally local non-continual modules with the forward_stepping functions
205
205
206
+ In addition, we support a wide range of modules from ` torch.nn ` :
207
+
208
+ - Activation
209
+ - ` nn.BatchNorm1d `
210
+ - ` nn.Threshold `
211
+ - ` nn.ReLU `
212
+ - ` nn.RReLU `
213
+ - ` nn.Hardtanh `
214
+ - ` nn.ReLU6 `
215
+ - ` nn.Sigmoid `
216
+ - ` nn.Hardsigmoid `
217
+ - ` nn.Tanh `
218
+ - ` nn.SiLU `
219
+ - ` nn.Hardswish `
220
+ - ` nn.ELU `
221
+ - ` nn.CELU `
222
+ - ` nn.SELU `
223
+ - ` nn.GLU `
224
+ - ` nn.GELU `
225
+ - ` nn.Hardshrink `
226
+ - ` nn.LeakyReLU `
227
+ - ` nn.LogSigmoid `
228
+ - ` nn.Softplus `
229
+ - ` nn.Softshrink `
230
+ - ` nn.PReLU `
231
+ - ` nn.Softsign `
232
+ - ` nn.Tanhshrink `
233
+ - ` nn.Softmin `
234
+ - ` nn.Softmax `
235
+ - ` nn.Softmax2d `
236
+ - ` nn.LogSoftmax `
237
+
238
+ - Batch Normalisation
239
+ - ` nn.BatchNorm1d `
240
+ - ` nn.BatchNorm2d `
241
+ - ` nn.BatchNorm3d `
242
+
243
+ - Dropout
244
+ - ` nn.Dropout `
245
+ - ` nn.Dropout2d `
246
+ - ` nn.Dropout3d `
247
+ - ` nn.AlphaDropout `
248
+ - ` nn.FeatureAlphaDropout `
206
249
207
250
## Advanced examples
208
251
You can’t perform that action at this time.
0 commit comments