Skip to content

Commit c60b2c3

Browse files
authored
Update README.md
1 parent d71d2b6 commit c60b2c3

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

README.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -3,10 +3,7 @@
33
Huggingface Datasets is a great library, but it lacks standardization, and datasets require preprocessing work to be used interchangeably.
44
`tasksource` automates this and facilitates multi-task learning scaling and reproducibility.
55

6-
Each dataset is standardized to either `MultipleChoice`, `Classification`, or `TokenClassification` dataset with identical fields.
7-
We do not support generation tasks as they are addressed by [promptsource](https://github.com/bigscience-workshop/promptsource).
8-
9-
All implemented preprocessings can be found in [tasks.py](https://github.com/sileod/tasksource/blob/main/src/tasksource/tasks.py) or [tasks.md](https://github.com/sileod/tasksource/blob/main/tasks.md). A preprocessing is a function that takes a dataset as input and returns a standardized dataset. The preprocessing annotation is designed to be concise human-readable.
6+
Each dataset is standardized to either `MultipleChoice`, `Classification`, or `TokenClassification` dataset with identical fields. We do not support generation tasks as they are addressed by [promptsource](https://github.com/bigscience-workshop/promptsource). All implemented preprocessings are in [tasks.py](https://github.com/sileod/tasksource/blob/main/src/tasksource/tasks.py) or [tasks.md](https://github.com/sileod/tasksource/blob/main/tasks.md). A preprocessing is a function that accepts a dataset and returns the standardized dataset. Preprocessing code is concise and human-readable.
107

118
### Installation and usage:
129
`pip install tasksource`

0 commit comments

Comments
 (0)