Add link to tech report. Fix typo in usage example #2

2024-08-24 11:07:58 +08:00
parent 95b68409da
commit c384c7fe48
13 changed files with 2598 additions and 60 deletions
--- a/tokenizer.json
+++ b/tokenizer.json
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79e3e522635f3171300913bb421464a87de6222182a0570b9b2ccba2a964b2b4
+size 9085657