prithivMLmods/Luth-Instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: prithivMLmods/Luth-Instruct-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-22 14:48:13 +08:00
commit beb61f6df9
41 changed files with 242 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6a335f0ed7218bbf82a67c467cbd4a80aaee216e03509dc8208b3d22cef85e0
size 1198182016

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2eae2ffb3bbad008ad88122954a1fa1e454fc4f69a0c9f1fa45e2200607304f9
size 1198182016

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b68be7d3aa6c7e5fac3ae7ca3391a3735ced9956fda89d523ebc1c8369aabb3c
size 2390150784

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e20adb023b3d67c3261cdac571d764312426a2031037fcc5e933972555fdfce6
size 296237696

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33505193189e0c75b13b5df7a0e1e397632e2b6c0f9187ab03e020de537e52fc
size 368491136

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:070d7bb2f7281445fc47db71cbe1fb06959632ec5fc928da39c491dd2e1deb18
size 347126400

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6300be850a0151b5ffd70f9924812fd2997d60e88dc39873193a5089ef25a30
size 323074688

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b88914ef1694a0380841479e5f0bf582fa5dd2151ead1118c03d4cd7cd49fb3
size 381565568

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb76dbff6347fee8b1960a50923fc4f6243017e834554e089c9af8172b51bd80
size 409090688

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1132e2c1508c2acc7d3dc097a4ac476402c04751706901dee2e9c196e8e53eba
size 396704384

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1132e2c1508c2acc7d3dc097a4ac476402c04751706901dee2e9c196e8e53eba
size 396704384

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de5b05e40fc0b4776e4c46561a8dfd5ec7effc0e5e9384f73c36c19c7e431263
size 383269504

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59b1d8702b81d00f11720130c216f7debfa307b74880a11e16c52e8327af2933
size 436615808

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eeaed49d9547b9a0a312d300fb61205f74cd8615114ea7385e1226347c9628de
size 464140928

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac3e1c79278d13eca15c93abc75b9563a4c4c71b71a273729875c9133007aa9f
size 444414592

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac3e1c79278d13eca15c93abc75b9563a4c4c71b71a273729875c9133007aa9f
size 444414592

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33677b706d28017a8e6c9e819a7301a2df230222deeb518d2cdedcc479d0d736
size 436615808

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38565715c4027c6fe00c98cb3e73a4346004ed6f11f5205634cf8a9a41f888b1
size 495106688

3
Luth-0.6B-Instruct-GGUF/Luth-0.6B-Instruct.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a391ac347c439a851a6f38e84645a455819c286f5ace6c446d10704617ea825
size 639446656

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5cca42fa6ab6249c7df3afe0938de7b4b1ebd9c73bfed7c0cefe6ffa63934ad
size 3447348864

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b603bf0453d98af2ecfd46cfdd888db567d04a1f7d3a2f59ecb69da2f455211
size 3447348864

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:787a8d0f57adb45d8a3287b1d9326c7b6e2c045ec9b3d8df3cdd556f5c2e9b80
size 6888251008

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb7b7c80fc197a15e78c3fce18ff39f5d9560869b597fb0dc1462e899fd69996
size 777795200

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce461bb062336759f28fea1fabd033671f9087b1aa23f39a9ebf5948d901aecb
size 1003501184

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91173e85c9cb236f3a3c794c4f552a55c5c5053b4080fb678bf6e3e728c2ce95
size 939538048

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7d81bbc03e1531e587067d45b3ce33100207c4b72885139903f0238e8fafc95
size 867251840

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a204db91a2b5fe23a8f3575ee0fd246e804b2e77ca1ba0b9b71c112c6d7c33d5
size 1054422656

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c7bf8b4d0a15c966e7cca25a1183e6b49e827770f1247a578841dc0c8ef3ba8
size 1142503040

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce4f87b084fa2c48dbe769deb414b91f8f41fab130a5b7985e6abbe5fb282b21
size 1107408512

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce4f87b084fa2c48dbe769deb414b91f8f41fab130a5b7985e6abbe5fb282b21
size 1107408512

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:702baa4cc336a36ce8f375634a08158fed57bef9363b71d8b5c8e0aa798ed048
size 1060189824

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c730930de16d0aa0a1dfa4426fd32a64066166b3bf7a5d1f3b9f0cb18bbbf164
size 1230583424

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c96132e676ea5cffc3e1ac1d5bfa21985a4f2291f8a336d8afd24ba4ce33a2d
size 1318663808

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58da51c61fdce92cb3e473cd1940895877543a07528f88e6ac5ed801b2e14603
size 1257879168

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58da51c61fdce92cb3e473cd1940895877543a07528f88e6ac5ed801b2e14603
size 1257879168

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be0f3eecd65fcf885153e878a84ca4cd91685c945dad1454283102ee06b86791
size 1230583424

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d377b20731aded698ea9cf9690f10bbb2befee20f09073be087a9c31d7ae351
size 1417754240

3
Luth-1.7B-Instruct-GGUF/Luth-1.7B-Instruct.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50126a538058976d13cf86b50be93ca670f2edd5fdbeddd1c0921535856b2062
size 1834425984

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
license: apache-2.0
base_model:
- kurakurai/Luth-1.7B-Instruct
language:
- fr
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- text-generation-inference
---
# **Luth-Instruct-GGUF**
> Luth-1.7B-Instruct is a French fine-tuned variant of the Qwen3-1.7B model, enhanced using the Luth-SFT dataset to significantly improve its capabilities in French instruction following, mathematics, and general knowledge while maintaining and even boosting its English performance. It was trained by full fine-tuning with Axolotl and later merged with the base Qwen3-1.7B, thus preserving its English competencies alongside marked improvements in French benchmarks. The model demonstrates strong performance on selected French and English benchmarks, including ifeval, gpqa-diamond, mmlu, math-500, arc-chall, and hellaswag, showing notable gains over comparable models in both languages. It is designed for tasks requiring bilingual proficiency with pronounced strength in French and is supported by available evaluation, training, and data scripts on GitHub. The model is suitable for instruction-following applications in contexts demanding enhanced French language understanding without compromising English language capabilities. It is openly accessible under an appropriate license for research and usage.
| Model Name | Model Size | Download Link |
|------------|------|---------------|
| **Luth-1.7B-Instruct-GGUF** | 1.7B | [Hugging Face](https://huggingface.co/prithivMLmods/Luth-Instruct-GGUF/tree/main/Luth-1.7B-Instruct-GGUF) |
| **Luth-0.6B-Instruct-GGUF** | 0.6B | [Hugging Face](https://huggingface.co/prithivMLmods/Luth-Instruct-GGUF/tree/main/Luth-0.6B-Instruct-GGUF) |
## Model Files
### Luth-1.7B-Instruct
| File Name | Quant Type | File Size |
| - | - | - |
| Luth-1.7B-Instruct.BF16.gguf | BF16 | 3.45 GB |
| Luth-1.7B-Instruct.F16.gguf | F16 | 3.45 GB |
| Luth-1.7B-Instruct.F32.gguf | F32 | 6.89 GB |
| Luth-1.7B-Instruct.Q2_K.gguf | Q2_K | 778 MB |
| Luth-1.7B-Instruct.Q3_K_L.gguf | Q3_K_L | 1 GB |
| Luth-1.7B-Instruct.Q3_K_M.gguf | Q3_K_M | 940 MB |
| Luth-1.7B-Instruct.Q3_K_S.gguf | Q3_K_S | 867 MB |
| Luth-1.7B-Instruct.Q4_0.gguf | Q4_0 | 1.05 GB |
| Luth-1.7B-Instruct.Q4_1.gguf | Q4_1 | 1.14 GB |
| Luth-1.7B-Instruct.Q4_K.gguf | Q4_K | 1.11 GB |
| Luth-1.7B-Instruct.Q4_K_M.gguf | Q4_K_M | 1.11 GB |
| Luth-1.7B-Instruct.Q4_K_S.gguf | Q4_K_S | 1.06 GB |
| Luth-1.7B-Instruct.Q5_0.gguf | Q5_0 | 1.23 GB |
| Luth-1.7B-Instruct.Q5_1.gguf | Q5_1 | 1.32 GB |
| Luth-1.7B-Instruct.Q5_K.gguf | Q5_K | 1.26 GB |
| Luth-1.7B-Instruct.Q5_K_M.gguf | Q5_K_M | 1.26 GB |
| Luth-1.7B-Instruct.Q5_K_S.gguf | Q5_K_S | 1.23 GB |
| Luth-1.7B-Instruct.Q6_K.gguf | Q6_K | 1.42 GB |
| Luth-1.7B-Instruct.Q8_0.gguf | Q8_0 | 1.83 GB |
### Luth-0.6B-Instruct
| File Name | Quant Type | File Size |
| - | - | - |
| Luth-0.6B-Instruct.BF16.gguf | BF16 | 1.2 GB |
| Luth-0.6B-Instruct.F16.gguf | F16 | 1.2 GB |
| Luth-0.6B-Instruct.F32.gguf | F32 | 2.39 GB |
| Luth-0.6B-Instruct.Q2_K.gguf | Q2_K | 296 MB |
| Luth-0.6B-Instruct.Q3_K_L.gguf | Q3_K_L | 368 MB |
| Luth-0.6B-Instruct.Q3_K_M.gguf | Q3_K_M | 347 MB |
| Luth-0.6B-Instruct.Q3_K_S.gguf | Q3_K_S | 323 MB |
| Luth-0.6B-Instruct.Q4_0.gguf | Q4_0 | 382 MB |
| Luth-0.6B-Instruct.Q4_1.gguf | Q4_1 | 409 MB |
| Luth-0.6B-Instruct.Q4_K.gguf | Q4_K | 397 MB |
| Luth-0.6B-Instruct.Q4_K_M.gguf | Q4_K_M | 397 MB |
| Luth-0.6B-Instruct.Q4_K_S.gguf | Q4_K_S | 383 MB |
| Luth-0.6B-Instruct.Q5_0.gguf | Q5_0 | 437 MB |
| Luth-0.6B-Instruct.Q5_1.gguf | Q5_1 | 464 MB |
| Luth-0.6B-Instruct.Q5_K.gguf | Q5_K | 444 MB |
| Luth-0.6B-Instruct.Q5_K_M.gguf | Q5_K_M | 444 MB |
| Luth-0.6B-Instruct.Q5_K_S.gguf | Q5_K_S | 437 MB |
| Luth-0.6B-Instruct.Q6_K.gguf | Q6_K | 495 MB |
| Luth-0.6B-Instruct.Q8_0.gguf | Q8_0 | 639 MB |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}