Updated bias model training code #29

laurahanu · 2021-09-03T15:26:15Z

updated dataloaders to be able to load and merge both training datasets from the 1st and 2nd Jigsaw challenges (mentioned in Detoxify Roadmap #26).
new config for updated unbiased model
script to convert the weights saved during training to the format expected by Detoxify
updated unbiased model

jamt9000 · 2021-09-03T15:35:23Z

convert_weights.py

+        "config": checkpoint["hyper_parameters"]["config"],
+    }
+    for k, v in checkpoint["state_dict"].items():
+        name = k[6:]  # remove `model.`


Check it actually starts with model. here

…pdated_bias_model

laurahanu added 5 commits September 3, 2021 20:38

handle combined datasets

5eb1cf3

new config for unbiased model with combined datasets

58bfef9

checkpoint_callback is bool in newer lightning versions

9df8aaa

script to covert weights into expected detoxify foormat

9e0dd60

update tqdm version

8d5b1cf

jamt9000 reviewed Sep 3, 2021

View reviewed changes

laurahanu added 5 commits September 3, 2021 21:24

only change model keys of key name starts with 'model'

5700981

updated model link for 'unbiased' model

3885a62

reinstate checkpoint_callback

91cbb24

Merge branch 'master' of https://github.com/unitaryai/detoxify into u…

eb2c134

…pdated_bias_model

update to new version

e0415cb

laurahanu merged commit bdc84bd into master Sep 3, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Updated bias model training code #29

Updated bias model training code #29

laurahanu commented Sep 3, 2021 •

edited

Loading

jamt9000 Sep 3, 2021

laurahanu Sep 3, 2021

Updated bias model training code #29

Updated bias model training code #29

Conversation

laurahanu commented Sep 3, 2021 • edited Loading

jamt9000 Sep 3, 2021

Choose a reason for hiding this comment

laurahanu Sep 3, 2021

Choose a reason for hiding this comment

laurahanu commented Sep 3, 2021 •

edited

Loading