Added wordpiece todo

mkranzlein · Aug 22, 2023 · 0b35e81 · 0b35e81
1 parent 91f8518
commit 0b35e81
Showing 1 changed file with 1 addition and 0 deletions.
diff --git a/README.md b/README.md
@@ -45,6 +45,7 @@ def some_function(x: Float[torch.Tensor, "10, 768"]):
 I recommend taking a look at the [jaxtyping docs](https://docs.kidger.site/jaxtyping/).
 
 ## TODOs
+- Eval needs to account for wordpiece splits
 - Some long documents are too big for GPU vram right now
 - Batching right now should allow for single documents, but worth testing
 - Chunking logic could be more clear