初始化项目,由ModelHub XC社区提供模型
Model: YoAbriel/KodaLite-1.3B-GGUF Source: Original Platform
This commit is contained in:
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
kodalite-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
kodalite-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
kodalite-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
52
README.md
Normal file
52
README.md
Normal file
@@ -0,0 +1,52 @@
|
|||||||
|
---
|
||||||
|
language: en
|
||||||
|
license: apache-2.0
|
||||||
|
library_name: gguf
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
tags:
|
||||||
|
- text-generation
|
||||||
|
- gguf
|
||||||
|
- llama.cpp
|
||||||
|
- ollama
|
||||||
|
base_model: YoAbriel/KodaLite-1.3B
|
||||||
|
---
|
||||||
|
|
||||||
|
# KodaLite-1.3B — GGUF quantizations
|
||||||
|
|
||||||
|
GGUF versions of [YoAbriel/KodaLite-1.3B](https://huggingface.co/YoAbriel/KodaLite-1.3B).
|
||||||
|
|
||||||
|
## Files
|
||||||
|
|
||||||
|
| File | Quant | Size | Use case |
|
||||||
|
|---|---|---|---|
|
||||||
|
| kodalite-f16.gguf | F16 | ~2.5 GB | Full precision reference |
|
||||||
|
| kodalite-Q8_0.gguf | Q8_0 | ~1.3 GB | Near-lossless |
|
||||||
|
| kodalite-Q4_K_M.gguf | Q4_K_M | ~800 MB | Best size/quality tradeoff |
|
||||||
|
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
### llama.cpp
|
||||||
|
```bash
|
||||||
|
llama-cli -m kodalite-Q4_K_M.gguf --reverse-prompt '<|end|>' -p '<|user|>\nHello\n<|assistant|>\n' -n 150
|
||||||
|
```
|
||||||
|
|
||||||
|
### Ollama
|
||||||
|
```bash
|
||||||
|
cat > Modelfile << EOF
|
||||||
|
FROM ./kodalite-Q4_K_M.gguf
|
||||||
|
TEMPLATE """<|user|>
|
||||||
|
{{ .Prompt }}
|
||||||
|
<|assistant|>
|
||||||
|
"""
|
||||||
|
PARAMETER stop "<|end|>"
|
||||||
|
EOF
|
||||||
|
ollama create kodalite -f Modelfile
|
||||||
|
ollama run kodalite
|
||||||
|
```
|
||||||
|
|
||||||
|
### LM Studio / Jan
|
||||||
|
Load the .gguf file directly. Stop sequence: <|end|>
|
||||||
|
|
||||||
|
## License
|
||||||
|
|
||||||
|
Apache 2.0
|
||||||
3
kodalite-Q4_K_M.gguf
Normal file
3
kodalite-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d54289eb41f44217745b95cc9c72a4b7dd09541a3d670a953f7d9432297efdb7
|
||||||
|
size 830377216
|
||||||
3
kodalite-Q8_0.gguf
Normal file
3
kodalite-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e4e9d774df206180af88d766e86cfdaae05070dfe5eebaeed540c14f0e033451
|
||||||
|
size 1350610400
|
||||||
3
kodalite-f16.gguf
Normal file
3
kodalite-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e56d427061fd18f30833980e244ad566bf433ee8a6e81f454816c8a87cefa780
|
||||||
|
size 2540399840
|
||||||
Reference in New Issue
Block a user