EngineX-Ascend/enginex-ascend-910-llama.cpp
10
0
Fork 0
Code Issues Pull Requests Actions 4 Projects Releases Wiki Activity
Files
5cf5e7d490dfdd2e70bface2d35dfd14aa44b4fb
enginex-ascend-910-llama.cpp/examples/batched.swift
History
Georgi Gerganov 40f74e4d73 llama : add option to render special/control tokens (#6807) 
* make : fix common dep on llama.h

* llama : add option to render special tokens

* readme : add API change notice

ggml-ci

* swift : fix build
2024-04-21 18:36:45 +03:00
..
Sources
llama : add option to render special/control tokens (#6807)
2024-04-21 18:36:45 +03:00
.gitignore
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00
Makefile
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00
Package.swift
examples : add batched.swift + improve CI for swift (#3562)
2023-10-11 06:14:05 -05:00
README.md
batched.swift : update README.md (#4214)
2023-11-30 23:45:17 +02:00

README.md

This is a swift clone of examples/batched.

$ make $ ./batched_swift MODEL_PATH [PROMPT] [PARALLEL]