EngineX-Ascend/enginex-ascend-910-llama.cpp
10
0
Fork 0
Code Issues Pull Requests Actions 4 Projects Releases Wiki Activity
Files
8a052c131ed3525313cdb84e5ae4e2b6cf8d2e24
enginex-ascend-910-llama.cpp/examples/batched.swift
History
eastriver 2568a4bf54 main.swift : fix eos checking (#4197) 
llama_token_eos(const struct llama_model *) is currently getting struct llama_context type variable context as a parameter.
2023-11-24 11:25:10 +02:00
..
Sources
main.swift : fix eos checking (#4197)
2023-11-24 11:25:10 +02:00
.gitignore
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00
Makefile
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00
Package.swift
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00
README.md
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00

README.md

This is a swift clone of examples/batched.

$ make $ ./swift MODEL_PATH [PROMPT] [PARALLEL]