commit 8bb00ea5a02752fad29eb59606c75bacb86d3a53 Author: ModelHub XC Date: Thu Jul 23 02:43:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: matrixportalx/Turkish-Llama3-8B-Merged-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..30a1423 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,48 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q2_k.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q4_0.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q5_0.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q6_k.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.q8_0.gguf filter=lfs diff=lfs merge=lfs -text +turkish-llama3-8b-merged.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..a1b5178 --- /dev/null +++ b/README.md @@ -0,0 +1,42 @@ +--- +base_model: +- meta-llama/Meta-Llama-3-8B +- ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1 +- ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1 +tags: +- merge +- mergekit +- lazymergekit +- meta-llama/Meta-Llama-3-8B +- ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1 +- ytu-ce-cosmos/Turkish-Llama-8b-DPO-v0.1 +--- + +# Turkish-Llama3-8B-Merged GGUF Quantized Models + +## Technical Details +- **Quantization Tool:** llama.cpp +- **Version:** ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no + +## Model Information +- **Base Model:** [matrixportal/Turkish-Llama3-8B-Merged](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged) +- **Quantized by:** [matrixportal](https://huggingface.co/matrixportal) + +## Available Files +| 🚀 Download | 🔢 Type | 📝 Description | +|------------|---------|---------------| +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q2_k.gguf) | Q2 K | Tiny size, lowest quality (emergency use only) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_s.gguf) | Q3 K S | Very small, low quality (basic tasks) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_m.gguf) | Q3 K M | Small, acceptable quality | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q3_k_l.gguf) | Q3 K L | Small, better than Q3_K_M (good for low RAM) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_0.gguf) | Q4 0 | Standard 4-bit (fast on ARM) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_k_s.gguf) | Q4 K S | 4-bit optimized (good space savings) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q4_k_m.gguf) | Q4 K M | 4-bit balanced (recommended default) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_0.gguf) | Q5 0 | 5-bit high quality | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_k_s.gguf) | Q5 K S | 5-bit optimized | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q5_k_m.gguf) | Q5 K M | 5-bit best (recommended HQ option) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q6_k.gguf) | Q6 K | 6-bit near-perfect (premium quality) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.q8_0.gguf) | Q8 0 | 8-bit maximum (overkill for most) | +| [Download](https://huggingface.co/matrixportal/Turkish-Llama3-8B-Merged-GGUF/resolve/main/turkish-llama3-8b-merged.f16.gguf) | F16 | Full precision (maximum accuracy) | + +💡 **Q4 K M** provides the best balance for most use cases \ No newline at end of file diff --git a/turkish-llama3-8b-merged.f16.gguf b/turkish-llama3-8b-merged.f16.gguf new file mode 100644 index 0000000..eec607a --- /dev/null +++ b/turkish-llama3-8b-merged.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:057fdb49d9ec9980a7a1ee7d28342f7890f04dfe9ee4885422da695fc982c0c7 +size 16068891808 diff --git a/turkish-llama3-8b-merged.q2_k.gguf b/turkish-llama3-8b-merged.q2_k.gguf new file mode 100644 index 0000000..35ac3ba --- /dev/null +++ b/turkish-llama3-8b-merged.q2_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:408ce43c2c8c038e803431b813c6b10ab4715b7ef16a14c1338eec01d3e5d7d6 +size 3179132064 diff --git a/turkish-llama3-8b-merged.q3_k_l.gguf b/turkish-llama3-8b-merged.q3_k_l.gguf new file mode 100644 index 0000000..88ea7d6 --- /dev/null +++ b/turkish-llama3-8b-merged.q3_k_l.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7041aa93f9d033f4eb7a7817757eaac0d77639ddade13d1514d6c4dd94d980dd +size 4321957024 diff --git a/turkish-llama3-8b-merged.q3_k_m.gguf b/turkish-llama3-8b-merged.q3_k_m.gguf new file mode 100644 index 0000000..71a60a6 --- /dev/null +++ b/turkish-llama3-8b-merged.q3_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:262bfe6069f2b54de69b007186836b7d5d788716beffcb327cc5a36c9c90dc1c +size 4018918560 diff --git a/turkish-llama3-8b-merged.q3_k_s.gguf b/turkish-llama3-8b-merged.q3_k_s.gguf new file mode 100644 index 0000000..6a088c4 --- /dev/null +++ b/turkish-llama3-8b-merged.q3_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00284d3ed8eedc1802001368d6f305ae5aa1b703169fab88121c5a61e16565e6 +size 3664499872 diff --git a/turkish-llama3-8b-merged.q4_0.gguf b/turkish-llama3-8b-merged.q4_0.gguf new file mode 100644 index 0000000..9fb1fb3 --- /dev/null +++ b/turkish-llama3-8b-merged.q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:157a7a15acb858c6c7bb3fc2cb3a6e909c09487c1552ad9b504c13e302508b69 +size 4661212320 diff --git a/turkish-llama3-8b-merged.q4_k_m.gguf b/turkish-llama3-8b-merged.q4_k_m.gguf new file mode 100644 index 0000000..81008a5 --- /dev/null +++ b/turkish-llama3-8b-merged.q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:04e9ce5d62134dbc98f7a3c2a128246c4384a8eeefefffa6e1d8f11ece5e28a3 +size 4920734880 diff --git a/turkish-llama3-8b-merged.q4_k_s.gguf b/turkish-llama3-8b-merged.q4_k_s.gguf new file mode 100644 index 0000000..df7bdc1 --- /dev/null +++ b/turkish-llama3-8b-merged.q4_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b96ed14433c833634e6ec9e2800363998388cb88a580eca5bbb59763003853c1 +size 4692669600 diff --git a/turkish-llama3-8b-merged.q5_0.gguf b/turkish-llama3-8b-merged.q5_0.gguf new file mode 100644 index 0000000..e492ad4 --- /dev/null +++ b/turkish-llama3-8b-merged.q5_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ea9e861079483c977de25caa8ded61a45c1fcb0bb6ff027925fa136c4c16edb3 +size 5599294624 diff --git a/turkish-llama3-8b-merged.q5_k_m.gguf b/turkish-llama3-8b-merged.q5_k_m.gguf new file mode 100644 index 0000000..0800c9d --- /dev/null +++ b/turkish-llama3-8b-merged.q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d16c416017fbb834d7eca4cdb23e789cdee7624df03838819f5fe4b4cc3fee7 +size 5732988064 diff --git a/turkish-llama3-8b-merged.q5_k_s.gguf b/turkish-llama3-8b-merged.q5_k_s.gguf new file mode 100644 index 0000000..2117c06 --- /dev/null +++ b/turkish-llama3-8b-merged.q5_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:992c044f1031f06c135548045299f420020d920abda8c5a9e0e314b0deaa8744 +size 5599294624 diff --git a/turkish-llama3-8b-merged.q6_k.gguf b/turkish-llama3-8b-merged.q6_k.gguf new file mode 100644 index 0000000..a6f572f --- /dev/null +++ b/turkish-llama3-8b-merged.q6_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:939b797f041afa39b6160e1392a9e70f7dd15b33408f5fc3ca01b435835d493b +size 6596007072 diff --git a/turkish-llama3-8b-merged.q8_0.gguf b/turkish-llama3-8b-merged.q8_0.gguf new file mode 100644 index 0000000..624d8f5 --- /dev/null +++ b/turkish-llama3-8b-merged.q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3167b33cd7a1086c537d03bdcc8d01ef9285675357a3aceb7079e5c6f43a0df0 +size 8540771488