Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch aligning student corpus to fast_align #717

Draft
wants to merge 1 commit into
base: aln_chunks
Choose a base branch
from

Switch aligning student corpus to fast_align

02f7390
Select commit
Loading
Failed to load commit list.
Draft

Switch aligning student corpus to fast_align #717

Switch aligning student corpus to fast_align
02f7390
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / train-vocab-ru-en succeeded Jul 1, 2024 in 10m 4s

FirefoxCI (pull_request)

train vocab for ru-en

Details

View task in Taskcluster
View logs in Taskcluster


[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x32>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x33>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x34>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x35>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x36>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x37>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x38>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x39>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x40>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x41>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x42>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x43>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x44>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x45>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x46>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x47>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x48>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x49>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x50>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x51>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x52>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x53>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x54>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x55>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x56>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x57>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x58>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x59>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x60>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x61>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x62>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x63>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x64>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x65>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x66>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x67>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x68>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x69>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x70>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x71>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x72>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x73>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x74>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x75>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x76>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x77>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x78>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x79>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7E>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7F>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x80>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x81>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x82>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x83>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x84>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x85>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x86>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x87>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x88>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x89>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8A>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8B>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8C>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8D>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8E>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8F>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x90>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x91>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x92>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x93>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x94>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x95>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x96>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x97>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x98>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x99>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9A>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9B>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9C>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9D>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9E>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9F>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xED>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(396) LOG(INFO) Normalizing sentences...
[task 2024-07-01T23:32:50.183Z] trainer_interface.cc(457) LOG(INFO) all chars count=1272185
[task 2024-07-01T23:32:50.183Z] trainer_interface.cc(478) LOG(INFO) Alphabet size=249
[task 2024-07-01T23:32:50.183Z] trainer_interface.cc(479) LOG(INFO) Final character coverage=1
[task 2024-07-01T23:32:50.223Z] trainer_interface.cc(511) LOG(INFO) Done! preprocessed 10000 sentences.
[task 2024-07-01T23:32:50.316Z] unigram_model_trainer.cc(138) LOG(INFO) Making suffix array...
[task 2024-07-01T23:32:50.484Z] unigram_model_trainer.cc(142) LOG(INFO) Extracting frequent sub strings...
[task 2024-07-01T23:32:50.572Z] unigram_model_trainer.cc(193) LOG(INFO) Initialized 75097 seed sentencepieces
[task 2024-07-01T23:32:50.640Z] trainer_interface.cc(517) LOG(INFO) Tokenizing input sentences with whitespace: 10000
[task 2024-07-01T23:32:50.676Z] trainer_interface.cc(527) LOG(INFO) Done! 34066
[task 2024-07-01T23:32:50.679Z] unigram_model_trainer.cc(488) LOG(INFO) Using 34066 sentences for EM training
[task 2024-07-01T23:32:50.735Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=23112 obj=13.2723 num_tokens=71059 num_tokens/piece=3.07455
[task 2024-07-01T23:32:50.776Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=20455 obj=10.7749 num_tokens=71424 num_tokens/piece=3.49176
[task 2024-07-01T23:32:50.916Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=15333 obj=10.8571 num_tokens=76308 num_tokens/piece=4.97672
[task 2024-07-01T23:32:50.948Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=15319 obj=10.7936 num_tokens=76321 num_tokens/piece=4.98211
[task 2024-07-01T23:32:51.067Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=11488 obj=11.1117 num_tokens=84525 num_tokens/piece=7.35768
[task 2024-07-01T23:32:51.101Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=11487 obj=11.0351 num_tokens=84538 num_tokens/piece=7.35945
[task 2024-07-01T23:32:51.195Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=8614 obj=11.4896 num_tokens=94318 num_tokens/piece=10.9494
[task 2024-07-01T23:32:51.220Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=8614 obj=11.4026 num_tokens=94314 num_tokens/piece=10.9489
[task 2024-07-01T23:32:51.298Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=6460 obj=11.9235 num_tokens=104879 num_tokens/piece=16.2351
[task 2024-07-01T23:32:51.324Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=6460 obj=11.837 num_tokens=104875 num_tokens/piece=16.2345
[task 2024-07-01T23:32:51.389Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=4845 obj=12.4339 num_tokens=116087 num_tokens/piece=23.9602
[task 2024-07-01T23:32:51.413Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=4845 obj=12.3419 num_tokens=116085 num_tokens/piece=23.9598
[task 2024-07-01T23:32:51.466Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=3633 obj=13.0301 num_tokens=127118 num_tokens/piece=34.9898
[task 2024-07-01T23:32:51.483Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=3633 obj=12.9275 num_tokens=127118 num_tokens/piece=34.9898
[task 2024-07-01T23:32:51.528Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=2724 obj=13.7219 num_tokens=137914 num_tokens/piece=50.6292
[task 2024-07-01T23:32:51.546Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=2724 obj=13.6068 num_tokens=137914 num_tokens/piece=50.6292
[task 2024-07-01T23:32:51.584Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=2043 obj=14.4933 num_tokens=148323 num_tokens/piece=72.6006
[task 2024-07-01T23:32:51.596Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=2043 obj=14.3668 num_tokens=148327 num_tokens/piece=72.6025
[task 2024-07-01T23:32:51.625Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=1532 obj=15.3798 num_tokens=159442 num_tokens/piece=104.074
[task 2024-07-01T23:32:51.640Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=1532 obj=15.2275 num_tokens=159450 num_tokens/piece=104.08
[task 2024-07-01T23:32:51.668Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=1149 obj=16.3875 num_tokens=171771 num_tokens/piece=149.496
[task 2024-07-01T23:32:51.684Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=1149 obj=16.2025 num_tokens=171778 num_tokens/piece=149.502
[task 2024-07-01T23:32:51.717Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=1100 obj=16.372 num_tokens=174158 num_tokens/piece=158.325
[task 2024-07-01T23:32:51.731Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=1100 obj=16.3456 num_tokens=174159 num_tokens/piece=158.326
[task 2024-07-01T23:32:51.732Z] trainer_interface.cc(605) LOG(INFO) Saving model: artifacts/vocab.model
[task 2024-07-01T23:32:51.732Z] trainer_interface.cc(616) LOG(INFO) Saving vocabs: artifacts/vocab.vocab
[task 2024-07-01T23:32:51.748Z] + rm artifacts/data.src.txt artifacts/data.trg.txt
[task 2024-07-01T23:32:51.749Z] + mv artifacts/vocab.model artifacts/vocab.spm
[fetches 2024-07-01T23:32:51.750Z] removing /builds/worker/fetches
[fetches 2024-07-01T23:32:52.001Z] finished
[taskcluster 2024-07-01 23:32:52.262Z] === Task Finished ===
[taskcluster 2024-07-01 23:32:52.803Z] Successful task run with exit code: 0 completed in 30.393 seconds