初始化项目,由ModelHub XC社区提供模型
Model: matrixportalx/Turkish-Llama3-8B-Merged-GGUF Source: Original Platform
This commit is contained in:
48
.gitattributes
vendored
Normal file
48
.gitattributes
vendored
Normal file
@@ -0,0 +1,48 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
turkish-llama3-8b-merged.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
42
README.md
Normal file
42
README.md
Normal file
@@ -0,0 +1,42 @@
|
|||||||
|
---
|
||||||
|
base_model:
|
||||||
|
- meta-llama/Meta-Llama-3-8B
|
||||||
|
- ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
|
||||||
|
- ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1
|
||||||
|
tags:
|
||||||
|
- merge
|
||||||
|
- mergekit
|
||||||
|
- lazymergekit
|
||||||
|
- meta-llama/Meta-Llama-3-8B
|
||||||
|
- ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
|
||||||
|
- ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1
|
||||||
|
---
|
||||||
|
|
||||||
|
# Turkish-Llama3-8B-Merged GGUF Quantized Models
|
||||||
|
|
||||||
|
## Technical Details
|
||||||
|
- **Quantization Tool:** llama.cpp
|
||||||
|
- **Version:** ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
|
||||||
|
|
||||||
|
## Model Information
|
||||||
|
- **Base Model:** [matrixportal/Turkish-Llama3-8B-Merged](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged)
|
||||||
|
- **Quantized by:** [matrixportal](https://huggingface.co/matrixportal)
|
||||||
|
|
||||||
|
## Available Files
|
||||||
|
| 🚀 Download | 🔢 Type | 📝 Description |
|
||||||
|
|------------|---------|---------------|
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q2_k.gguf) | Q2 K | Tiny size, lowest quality (emergency use only) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_s.gguf) | Q3 K S | Very small, low quality (basic tasks) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_m.gguf) | Q3 K M | Small, acceptable quality |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_l.gguf) | Q3 K L | Small, better than Q3_K_M (good for low RAM) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_0.gguf) | Q4 0 | Standard 4-bit (fast on ARM) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_k_s.gguf) | Q4 K S | 4-bit optimized (good space savings) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_0.gguf) | Q5 0 | 5-bit high quality |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_k_s.gguf) | Q5 K S | 5-bit optimized |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_k_m.gguf) | Q5 K M | 5-bit best (recommended HQ option) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q6_k.gguf) | Q6 K | 6-bit near-perfect (premium quality) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q8_0.gguf) | Q8 0 | 8-bit maximum (overkill for most) |
|
||||||
|
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.f16.gguf) | F16 | Full precision (maximum accuracy) |
|
||||||
|
|
||||||
|
💡 **Q4 K M** provides the best balance for most use cases
|
||||||
3
turkish-llama3-8b-merged.f16.gguf
Normal file
3
turkish-llama3-8b-merged.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:057fdb49d9ec9980a7a1ee7d28342f7890f04dfe9ee4885422da695fc982c0c7
|
||||||
|
size 16068891808
|
||||||
3
turkish-llama3-8b-merged.q2_k.gguf
Normal file
3
turkish-llama3-8b-merged.q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:408ce43c2c8c038e803431b813c6b10ab4715b7ef16a14c1338eec01d3e5d7d6
|
||||||
|
size 3179132064
|
||||||
3
turkish-llama3-8b-merged.q3_k_l.gguf
Normal file
3
turkish-llama3-8b-merged.q3_k_l.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7041aa93f9d033f4eb7a7817757eaac0d77639ddade13d1514d6c4dd94d980dd
|
||||||
|
size 4321957024
|
||||||
3
turkish-llama3-8b-merged.q3_k_m.gguf
Normal file
3
turkish-llama3-8b-merged.q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:262bfe6069f2b54de69b007186836b7d5d788716beffcb327cc5a36c9c90dc1c
|
||||||
|
size 4018918560
|
||||||
3
turkish-llama3-8b-merged.q3_k_s.gguf
Normal file
3
turkish-llama3-8b-merged.q3_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:00284d3ed8eedc1802001368d6f305ae5aa1b703169fab88121c5a61e16565e6
|
||||||
|
size 3664499872
|
||||||
3
turkish-llama3-8b-merged.q4_0.gguf
Normal file
3
turkish-llama3-8b-merged.q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:157a7a15acb858c6c7bb3fc2cb3a6e909c09487c1552ad9b504c13e302508b69
|
||||||
|
size 4661212320
|
||||||
3
turkish-llama3-8b-merged.q4_k_m.gguf
Normal file
3
turkish-llama3-8b-merged.q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:04e9ce5d62134dbc98f7a3c2a128246c4384a8eeefefffa6e1d8f11ece5e28a3
|
||||||
|
size 4920734880
|
||||||
3
turkish-llama3-8b-merged.q4_k_s.gguf
Normal file
3
turkish-llama3-8b-merged.q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b96ed14433c833634e6ec9e2800363998388cb88a580eca5bbb59763003853c1
|
||||||
|
size 4692669600
|
||||||
3
turkish-llama3-8b-merged.q5_0.gguf
Normal file
3
turkish-llama3-8b-merged.q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ea9e861079483c977de25caa8ded61a45c1fcb0bb6ff027925fa136c4c16edb3
|
||||||
|
size 5599294624
|
||||||
3
turkish-llama3-8b-merged.q5_k_m.gguf
Normal file
3
turkish-llama3-8b-merged.q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9d16c416017fbb834d7eca4cdb23e789cdee7624df03838819f5fe4b4cc3fee7
|
||||||
|
size 5732988064
|
||||||
3
turkish-llama3-8b-merged.q5_k_s.gguf
Normal file
3
turkish-llama3-8b-merged.q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:992c044f1031f06c135548045299f420020d920abda8c5a9e0e314b0deaa8744
|
||||||
|
size 5599294624
|
||||||
3
turkish-llama3-8b-merged.q6_k.gguf
Normal file
3
turkish-llama3-8b-merged.q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:939b797f041afa39b6160e1392a9e70f7dd15b33408f5fc3ca01b435835d493b
|
||||||
|
size 6596007072
|
||||||
3
turkish-llama3-8b-merged.q8_0.gguf
Normal file
3
turkish-llama3-8b-merged.q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3167b33cd7a1086c537d03bdcc8d01ef9285675357a3aceb7079e5c6f43a0df0
|
||||||
|
size 8540771488
|
||||||
Reference in New Issue
Block a user