This repository contains code for training a tokenizer on BabyLM 10M corpus. To train a tokenizer, clone this repository, install the requirements and run the following command:
python scripts/train_bbpe.py
The code is based on BabyBERTa.
forked from phueb/BabyBERTa
-
Notifications
You must be signed in to change notification settings - Fork 0
upunaprosk/BabyBERTa
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Source code for CoNLL 2021 paper by Huebner et al. 2021
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%