初始化项目,由ModelHub XC社区提供模型
Model: YoAbriel/KodaLite-1.3B-GGUF Source: Original Platform
This commit is contained in:
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
kodalite-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
kodalite-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
kodalite-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
52
README.md
Normal file
52
README.md
Normal file
@@ -0,0 +1,52 @@
|
||||
---
|
||||
language: en
|
||||
license: apache-2.0
|
||||
library_name: gguf
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- text-generation
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- ollama
|
||||
base_model: YoAbriel/KodaLite-1.3B
|
||||
---
|
||||
|
||||
# KodaLite-1.3B — GGUF quantizations
|
||||
|
||||
GGUF versions of [YoAbriel/KodaLite-1.3B](https://huggingface.co/YoAbriel/KodaLite-1.3B).
|
||||
|
||||
## Files
|
||||
|
||||
| File | Quant | Size | Use case |
|
||||
|---|---|---|---|
|
||||
| kodalite-f16.gguf | F16 | ~2.5 GB | Full precision reference |
|
||||
| kodalite-Q8_0.gguf | Q8_0 | ~1.3 GB | Near-lossless |
|
||||
| kodalite-Q4_K_M.gguf | Q4_K_M | ~800 MB | Best size/quality tradeoff |
|
||||
|
||||
## Usage
|
||||
|
||||
### llama.cpp
|
||||
```bash
|
||||
llama-cli -m kodalite-Q4_K_M.gguf --reverse-prompt '<|end|>' -p '<|user|>\nHello\n<|assistant|>\n' -n 150
|
||||
```
|
||||
|
||||
### Ollama
|
||||
```bash
|
||||
cat > Modelfile << EOF
|
||||
FROM ./kodalite-Q4_K_M.gguf
|
||||
TEMPLATE """<|user|>
|
||||
{{ .Prompt }}
|
||||
<|assistant|>
|
||||
"""
|
||||
PARAMETER stop "<|end|>"
|
||||
EOF
|
||||
ollama create kodalite -f Modelfile
|
||||
ollama run kodalite
|
||||
```
|
||||
|
||||
### LM Studio / Jan
|
||||
Load the .gguf file directly. Stop sequence: <|end|>
|
||||
|
||||
## License
|
||||
|
||||
Apache 2.0
|
||||
3
kodalite-Q4_K_M.gguf
Normal file
3
kodalite-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d54289eb41f44217745b95cc9c72a4b7dd09541a3d670a953f7d9432297efdb7
|
||||
size 830377216
|
||||
3
kodalite-Q8_0.gguf
Normal file
3
kodalite-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e4e9d774df206180af88d766e86cfdaae05070dfe5eebaeed540c14f0e033451
|
||||
size 1350610400
|
||||
3
kodalite-f16.gguf
Normal file
3
kodalite-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e56d427061fd18f30833980e244ad566bf433ee8a6e81f454816c8a87cefa780
|
||||
size 2540399840
|
||||
Reference in New Issue
Block a user