初始化项目,由ModelHub XC社区提供模型
Model: matrixportalx/Turkish-Llama3-8B-Merged-GGUF Source: Original Platform
This commit is contained in:
48
.gitattributes
vendored
Normal file
48
.gitattributes
vendored
Normal file
@@ -0,0 +1,48 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
turkish-llama3-8b-merged.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
42
README.md
Normal file
42
README.md
Normal file
@@ -0,0 +1,42 @@
|
||||
---
|
||||
base_model:
|
||||
- meta-llama/Meta-Llama-3-8B
|
||||
- ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
|
||||
- ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1
|
||||
tags:
|
||||
- merge
|
||||
- mergekit
|
||||
- lazymergekit
|
||||
- meta-llama/Meta-Llama-3-8B
|
||||
- ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1
|
||||
- ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1
|
||||
---
|
||||
|
||||
# Turkish-Llama3-8B-Merged GGUF Quantized Models
|
||||
|
||||
## Technical Details
|
||||
- **Quantization Tool:** llama.cpp
|
||||
- **Version:** ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no
|
||||
|
||||
## Model Information
|
||||
- **Base Model:** [matrixportal/Turkish-Llama3-8B-Merged](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged)
|
||||
- **Quantized by:** [matrixportal](https://huggingface.co/matrixportal)
|
||||
|
||||
## Available Files
|
||||
| 🚀 Download | 🔢 Type | 📝 Description |
|
||||
|------------|---------|---------------|
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q2_k.gguf) | Q2 K | Tiny size, lowest quality (emergency use only) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_s.gguf) | Q3 K S | Very small, low quality (basic tasks) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_m.gguf) | Q3 K M | Small, acceptable quality |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_l.gguf) | Q3 K L | Small, better than Q3_K_M (good for low RAM) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_0.gguf) | Q4 0 | Standard 4-bit (fast on ARM) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_k_s.gguf) | Q4 K S | 4-bit optimized (good space savings) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_0.gguf) | Q5 0 | 5-bit high quality |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_k_s.gguf) | Q5 K S | 5-bit optimized |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_k_m.gguf) | Q5 K M | 5-bit best (recommended HQ option) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q6_k.gguf) | Q6 K | 6-bit near-perfect (premium quality) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q8_0.gguf) | Q8 0 | 8-bit maximum (overkill for most) |
|
||||
| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.f16.gguf) | F16 | Full precision (maximum accuracy) |
|
||||
|
||||
💡 **Q4 K M** provides the best balance for most use cases
|
||||
3
turkish-llama3-8b-merged.f16.gguf
Normal file
3
turkish-llama3-8b-merged.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:057fdb49d9ec9980a7a1ee7d28342f7890f04dfe9ee4885422da695fc982c0c7
|
||||
size 16068891808
|
||||
3
turkish-llama3-8b-merged.q2_k.gguf
Normal file
3
turkish-llama3-8b-merged.q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:408ce43c2c8c038e803431b813c6b10ab4715b7ef16a14c1338eec01d3e5d7d6
|
||||
size 3179132064
|
||||
3
turkish-llama3-8b-merged.q3_k_l.gguf
Normal file
3
turkish-llama3-8b-merged.q3_k_l.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7041aa93f9d033f4eb7a7817757eaac0d77639ddade13d1514d6c4dd94d980dd
|
||||
size 4321957024
|
||||
3
turkish-llama3-8b-merged.q3_k_m.gguf
Normal file
3
turkish-llama3-8b-merged.q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:262bfe6069f2b54de69b007186836b7d5d788716beffcb327cc5a36c9c90dc1c
|
||||
size 4018918560
|
||||
3
turkish-llama3-8b-merged.q3_k_s.gguf
Normal file
3
turkish-llama3-8b-merged.q3_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:00284d3ed8eedc1802001368d6f305ae5aa1b703169fab88121c5a61e16565e6
|
||||
size 3664499872
|
||||
3
turkish-llama3-8b-merged.q4_0.gguf
Normal file
3
turkish-llama3-8b-merged.q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:157a7a15acb858c6c7bb3fc2cb3a6e909c09487c1552ad9b504c13e302508b69
|
||||
size 4661212320
|
||||
3
turkish-llama3-8b-merged.q4_k_m.gguf
Normal file
3
turkish-llama3-8b-merged.q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:04e9ce5d62134dbc98f7a3c2a128246c4384a8eeefefffa6e1d8f11ece5e28a3
|
||||
size 4920734880
|
||||
3
turkish-llama3-8b-merged.q4_k_s.gguf
Normal file
3
turkish-llama3-8b-merged.q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b96ed14433c833634e6ec9e2800363998388cb88a580eca5bbb59763003853c1
|
||||
size 4692669600
|
||||
3
turkish-llama3-8b-merged.q5_0.gguf
Normal file
3
turkish-llama3-8b-merged.q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ea9e861079483c977de25caa8ded61a45c1fcb0bb6ff027925fa136c4c16edb3
|
||||
size 5599294624
|
||||
3
turkish-llama3-8b-merged.q5_k_m.gguf
Normal file
3
turkish-llama3-8b-merged.q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9d16c416017fbb834d7eca4cdb23e789cdee7624df03838819f5fe4b4cc3fee7
|
||||
size 5732988064
|
||||
3
turkish-llama3-8b-merged.q5_k_s.gguf
Normal file
3
turkish-llama3-8b-merged.q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:992c044f1031f06c135548045299f420020d920abda8c5a9e0e314b0deaa8744
|
||||
size 5599294624
|
||||
3
turkish-llama3-8b-merged.q6_k.gguf
Normal file
3
turkish-llama3-8b-merged.q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:939b797f041afa39b6160e1392a9e70f7dd15b33408f5fc3ca01b435835d493b
|
||||
size 6596007072
|
||||
3
turkish-llama3-8b-merged.q8_0.gguf
Normal file
3
turkish-llama3-8b-merged.q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3167b33cd7a1086c537d03bdcc8d01ef9285675357a3aceb7079e5c6f43a0df0
|
||||
size 8540771488
|
||||
Reference in New Issue
Block a user