Switch aligning student corpus to fast_align #717
Draft
firefoxci-taskcluster / train-vocab-ru-en
succeeded
Jul 1, 2024 in 10m 4s
FirefoxCI (pull_request)
train vocab for ru-en
Details
View task in Taskcluster
View logs in Taskcluster
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x32>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x33>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x34>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x35>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x36>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x37>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x38>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x39>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x3F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x40>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x41>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x42>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x43>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x44>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x45>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x46>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x47>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x48>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x49>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x4F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x50>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x51>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x52>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x53>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x54>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x55>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x56>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x57>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x58>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x59>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x5F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x60>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x61>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x62>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x63>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x64>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x65>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x66>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x67>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x68>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x69>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6E>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x6F>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x70>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x71>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x72>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x73>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x74>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x75>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x76>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x77>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x78>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x79>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7A>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7B>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7C>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7D>
[task 2024-07-01T23:32:50.141Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7E>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x7F>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x80>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x81>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x82>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x83>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x84>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x85>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x86>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x87>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x88>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x89>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8A>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8B>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8C>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8D>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8E>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x8F>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x90>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x91>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x92>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x93>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x94>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x95>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x96>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x97>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x98>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x99>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9A>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9B>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9C>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9D>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9E>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0x9F>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xA9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xAF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xB9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xBF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xC9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xCF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xD9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xDF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xE9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xED>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xEF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF0>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF1>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF2>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF3>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF4>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF5>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF6>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF7>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF8>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xF9>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFA>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFB>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFC>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFD>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFE>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(391) LOG(INFO) Adding meta_piece: <0xFF>
[task 2024-07-01T23:32:50.142Z] trainer_interface.cc(396) LOG(INFO) Normalizing sentences...
[task 2024-07-01T23:32:50.183Z] trainer_interface.cc(457) LOG(INFO) all chars count=1272185
[task 2024-07-01T23:32:50.183Z] trainer_interface.cc(478) LOG(INFO) Alphabet size=249
[task 2024-07-01T23:32:50.183Z] trainer_interface.cc(479) LOG(INFO) Final character coverage=1
[task 2024-07-01T23:32:50.223Z] trainer_interface.cc(511) LOG(INFO) Done! preprocessed 10000 sentences.
[task 2024-07-01T23:32:50.316Z] unigram_model_trainer.cc(138) LOG(INFO) Making suffix array...
[task 2024-07-01T23:32:50.484Z] unigram_model_trainer.cc(142) LOG(INFO) Extracting frequent sub strings...
[task 2024-07-01T23:32:50.572Z] unigram_model_trainer.cc(193) LOG(INFO) Initialized 75097 seed sentencepieces
[task 2024-07-01T23:32:50.640Z] trainer_interface.cc(517) LOG(INFO) Tokenizing input sentences with whitespace: 10000
[task 2024-07-01T23:32:50.676Z] trainer_interface.cc(527) LOG(INFO) Done! 34066
[task 2024-07-01T23:32:50.679Z] unigram_model_trainer.cc(488) LOG(INFO) Using 34066 sentences for EM training
[task 2024-07-01T23:32:50.735Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=23112 obj=13.2723 num_tokens=71059 num_tokens/piece=3.07455
[task 2024-07-01T23:32:50.776Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=20455 obj=10.7749 num_tokens=71424 num_tokens/piece=3.49176
[task 2024-07-01T23:32:50.916Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=15333 obj=10.8571 num_tokens=76308 num_tokens/piece=4.97672
[task 2024-07-01T23:32:50.948Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=15319 obj=10.7936 num_tokens=76321 num_tokens/piece=4.98211
[task 2024-07-01T23:32:51.067Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=11488 obj=11.1117 num_tokens=84525 num_tokens/piece=7.35768
[task 2024-07-01T23:32:51.101Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=11487 obj=11.0351 num_tokens=84538 num_tokens/piece=7.35945
[task 2024-07-01T23:32:51.195Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=8614 obj=11.4896 num_tokens=94318 num_tokens/piece=10.9494
[task 2024-07-01T23:32:51.220Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=8614 obj=11.4026 num_tokens=94314 num_tokens/piece=10.9489
[task 2024-07-01T23:32:51.298Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=6460 obj=11.9235 num_tokens=104879 num_tokens/piece=16.2351
[task 2024-07-01T23:32:51.324Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=6460 obj=11.837 num_tokens=104875 num_tokens/piece=16.2345
[task 2024-07-01T23:32:51.389Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=4845 obj=12.4339 num_tokens=116087 num_tokens/piece=23.9602
[task 2024-07-01T23:32:51.413Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=4845 obj=12.3419 num_tokens=116085 num_tokens/piece=23.9598
[task 2024-07-01T23:32:51.466Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=3633 obj=13.0301 num_tokens=127118 num_tokens/piece=34.9898
[task 2024-07-01T23:32:51.483Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=3633 obj=12.9275 num_tokens=127118 num_tokens/piece=34.9898
[task 2024-07-01T23:32:51.528Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=2724 obj=13.7219 num_tokens=137914 num_tokens/piece=50.6292
[task 2024-07-01T23:32:51.546Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=2724 obj=13.6068 num_tokens=137914 num_tokens/piece=50.6292
[task 2024-07-01T23:32:51.584Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=2043 obj=14.4933 num_tokens=148323 num_tokens/piece=72.6006
[task 2024-07-01T23:32:51.596Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=2043 obj=14.3668 num_tokens=148327 num_tokens/piece=72.6025
[task 2024-07-01T23:32:51.625Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=1532 obj=15.3798 num_tokens=159442 num_tokens/piece=104.074
[task 2024-07-01T23:32:51.640Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=1532 obj=15.2275 num_tokens=159450 num_tokens/piece=104.08
[task 2024-07-01T23:32:51.668Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=1149 obj=16.3875 num_tokens=171771 num_tokens/piece=149.496
[task 2024-07-01T23:32:51.684Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=1149 obj=16.2025 num_tokens=171778 num_tokens/piece=149.502
[task 2024-07-01T23:32:51.717Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=0 size=1100 obj=16.372 num_tokens=174158 num_tokens/piece=158.325
[task 2024-07-01T23:32:51.731Z] unigram_model_trainer.cc(504) LOG(INFO) EM sub_iter=1 size=1100 obj=16.3456 num_tokens=174159 num_tokens/piece=158.326
[task 2024-07-01T23:32:51.732Z] trainer_interface.cc(605) LOG(INFO) Saving model: artifacts/vocab.model
[task 2024-07-01T23:32:51.732Z] trainer_interface.cc(616) LOG(INFO) Saving vocabs: artifacts/vocab.vocab
[task 2024-07-01T23:32:51.748Z] + rm artifacts/data.src.txt artifacts/data.trg.txt
[task 2024-07-01T23:32:51.749Z] + mv artifacts/vocab.model artifacts/vocab.spm
[fetches 2024-07-01T23:32:51.750Z] removing /builds/worker/fetches
[fetches 2024-07-01T23:32:52.001Z] finished
[taskcluster 2024-07-01 23:32:52.262Z] === Task Finished ===
[taskcluster 2024-07-01 23:32:52.803Z] Successful task run with exit code: 0 completed in 30.393 seconds
Loading