Skip to content

Commit

Permalink
error line fix
Browse files Browse the repository at this point in the history
  • Loading branch information
nmowmita committed Feb 16, 2024
1 parent 329ea57 commit 9cf8ff7
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions lm_eval/tasks/crowspairsde.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,8 +26,7 @@
with nine types of bias, like race, religion, and age. In CrowS-Pairs a model is presented with two sentences: one
that is more stereotyping and another that is less stereotyping. The data focuses on stereotypes about historically
disadvantaged groups and contrasts them with advantaged groups. We find that all three of the widely-used MLMs we
evaluate substantially favor sentences that express stereotypes in every category in CrowS-Pairs. As work on building
less biased models advances, this dataset can be used as a benchmark to evaluate progress.", } """
evaluate substantially favor sentences that express stereotypes in every category in CrowS-Pairs. As work on building less biased models advances, this dataset can be used as a benchmark to evaluate progress.", } """


class CrowsPairsDE(Task):
Expand Down

0 comments on commit 9cf8ff7

Please sign in to comment.