Skip to content

Add backwards UnitTests to existing models #352

@vlasenkoalexey

Description

@vlasenkoalexey

Currently in our UnitTests we only test forward pass for HF and TP models.
It would make a lot of sense to also test backwards pass and compare loss and if possible gradient updates.
Probably it would make sense to put it into some kind of test utility to make it reusable for different models.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions