ggml-org/llama.cpp
b7751
This is a swift clone of examples/batched.
examples/batched
$ ./llama-batched-swift MODEL_PATH [PROMPT] [PARALLEL]