Skip to content

Commit

Permalink
output_dim is a hparam
Browse files Browse the repository at this point in the history
  • Loading branch information
matsen committed Sep 27, 2024
1 parent cbd8484 commit e0084dd
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions netam/models.py
Original file line number Diff line number Diff line change
Expand Up @@ -598,6 +598,7 @@ def hyperparameters(self):
"dim_feedforward": self.dim_feedforward,
"layer_count": self.encoder.num_layers,
"dropout_prob": self.pos_encoder.dropout.p,
"output_dim": self.linear.out_features,
}

def init_weights(self) -> None:
Expand Down

0 comments on commit e0084dd

Please sign in to comment.