docs: 添加容器运行说明及注意事项
添加运行容器的命令示例,并强调必须使用 `--no-mmap` 参数以避免错误
This commit is contained in:
11
README.md
11
README.md
@@ -9,3 +9,14 @@ docker build -t enginex-iluvatar/iluvatar-llama.cpp:b7516-bi150 .
|
||||
```
|
||||
|
||||
最新镜像:git.modelhub.org.cn:9443/enginex-iluvatar/iluvatar-llama.cpp:b7516-bi150
|
||||
|
||||
运行容器
|
||||
**注意**:必须使用 `--no-mmap` 参数关闭内存映射,否则会报错
|
||||
```bash
|
||||
docker run -it --rm \
|
||||
-v <model_dir>:/app/models \
|
||||
--privileged \
|
||||
-e CUDA_VISIBLE_DEVICES=0 \
|
||||
git.modelhub.org.cn:9443/enginex-iluvatar/iluvatar-llama.cpp:b7516-bi150
|
||||
/app/llama-cli -m /app/models/xxx.gguf --no-mmap -p "你好"
|
||||
```
|
||||
Reference in New Issue
Block a user