Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better SVD computation for convolution #89

Draft
wants to merge 4 commits into
base: master
Choose a base branch
from
Draft

Better SVD computation for convolution #89

wants to merge 4 commits into from

Commits on Jul 26, 2024

  1. fix(compute_layer_sv): remove bias and activation in convolution SVD 

    When building the equivalent matrix of a convolution layer, the bias and
activation must be removed to only keep the convolutional operation of the
layer.
By cloning the layer and setting use_bias=False and activation=None, only
the convolution is performed.
Note that cloning the model already built the new model with the correct
input shape.
    @cofri
    cofri committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    080f4a1 View commit details
    Browse the repository at this point in the history

  2. feat(compute_layer_sv): sparse SVD computation

    @cofri
    cofri committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    8286dfb View commit details
    Browse the repository at this point in the history

  3. test(compute_layer_sv): add unit test with bias and activation 

    SpectralConv2D SV computation must remove bias and activation before
computing the equivalent matrix. A unit test of a SpectralConv2D with
bias and ReLU is added.
    @cofri
    cofri committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    96eadf3 View commit details
    Browse the repository at this point in the history

  4. chore: update GitHub actions to latest versions

    @cofri
    cofri committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    b92c497 View commit details
    Browse the repository at this point in the history