Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ResNet Bottleneck Architecture #1957

Closed

Conversation

MaximilianSchreff
Copy link
Contributor

This series of commits adds the forward pass of the residual network bottleneck architecture as introduces by "Deep Residual Learning for Image Recognition" by Kaiming He et. al. and refined in "ResNet v1.5 for PyTorch" by NVIDIA.

The individual components (bottleneck residual block, bottleneck residual layer) has been unit tested and the tests were added to the NN test suite and the whole bottleneck ResNet has been tested against the implementation of PyTorch which was not added to the test suite.

@phaniarnab

@MaximilianSchreff
Copy link
Contributor Author

Notice that this neural network will likely only work in the training loop with the fixed bug of nested lists from #1956

@j143
Copy link
Contributor

j143 commented Dec 17, 2023

Hi @MaximilianSchreff , thanks a lot for working on this. Nice to see that the code is document in the functions.

can we create one small .md file with instructions on how to run, limitations, a quick example! If you have any images/diagrams (even hand drawn rough diagrams also fine).

May be like this: https://pytorch.org/hub/nvidia_deeplearningexamples_resnet50/

Regards

@j143 j143 added this to the systemds-3.2.0 milestone Dec 17, 2023
@MaximilianSchreff
Copy link
Contributor Author

@j143 Thank you for the feedback!
I'm still developing the backward pass for the models. I will create a fully training loop example and instructions once I implemented the backward pass.

@MaximilianSchreff
Copy link
Contributor Author

Content merged by other PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants