Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-11 14:00:59 +08:00
commit efc9f61045
16 changed files with 174 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.f16.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dqnMath-v0.1-3B-HF.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: DQN-Labs/dqnMath-v0.1-3B-HF
library_name: mlx
language:
- en
- fr
- es
- de
- it
- pt
- nl
- zh
- ja
- ko
- ar
license: apache-2.0
inference: true
pipeline_tag: text-generation
tags:
- mlx
---
# GGUF Files for dqnMath-v0.1-3B-HF
These are the GGUF files for [DQN-Labs/dqnMath-v0.1-3B-HF](https://huggingface.co/DQN-Labs/dqnMath-v0.1-3B-HF).
## Downloads
| GGUF Link | Quantization | Description |
| ---- | ----- | ----------- |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q2_K.gguf) | Q2_K | Lowest quality |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q3_K_S.gguf) | Q3_K_S | |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.IQ3_S.gguf) | IQ3_S | Integer quant, preferable over Q3_K_S |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.IQ3_M.gguf) | IQ3_M | Integer quant |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q3_K_M.gguf) | Q3_K_M | |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q3_K_L.gguf) | Q3_K_L | |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.IQ4_XS.gguf) | IQ4_XS | Integer quant |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q4_K_S.gguf) | Q4_K_S | Fast with good performance |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q4_K_M.gguf) | Q4_K_M | **Recommended:** Perfect mix of speed and performance |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q5_K_S.gguf) | Q5_K_S | |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q5_K_M.gguf) | Q5_K_M | |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q6_K.gguf) | Q6_K | Very good quality |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.Q8_0.gguf) | Q8_0 | Best quality |
| [Download](https://huggingface.co/Flexan/DQN-Labs-dqnMath-v0.1-3B-HF-GGUF/resolve/main/dqnMath-v0.1-3B-HF.f16.gguf) | f16 | Full precision, don't bother; use a quant |
## Note from Flexan
I provide GGUFs and quantizations of publicly available models that do not have a GGUF equivalent available yet,
usually for models **I deem interesting and wish to try out**.
If there are some quants missing that you'd like me to add, you may request one in the community tab.
If you want to request a public model to be converted, you can also request that in the community tab.
If you have questions regarding this model, please refer to [the original model repo](https://huggingface.co/DQN-Labs/dqnMath-v0.1-3B-HF).
You can find more info about me and what I do [here](https://huggingface.co/Flexan/Flexan).
# DQN-Labs/dqnMath-v0.1-3B-HF
This model [DQN-Labs/dqnMath-v0.1-3B-HF](https://huggingface.co/DQN-Labs/dqnMath-v0.1-3B-HF) was
converted to MLX format from [LakoMoor/Ministral-3-3B-Text-Only](https://huggingface.co/LakoMoor/Ministral-3-3B-Text-Only)
using mlx-lm version **0.29.1**.
## Use with mlx
```bash
pip install mlx-lm
```
```python
from mlx_lm import load, generate
model, tokenizer = load("DQN-Labs/dqnMath-v0.1-3B-HF")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
```

3
dqnMath-v0.1-3B-HF.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cecb5eed894246a4a06a4eb5da8729881f624a176ba517f04980a5d1e08d543e
size 1704744224

3
dqnMath-v0.1-3B-HF.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d12b46145bf2754a31c80928a8aab3f549fa0052b5f87ecf8a06cd5d6f5f97ab
size 1650013472

3
dqnMath-v0.1-3B-HF.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b9327917a14411b96bbb40f0638186363a8e3db55c223a15293c46806ba4c95
size 1972548896

3
dqnMath-v0.1-3B-HF.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c3717fe648e0a4ab071ca95426b678bc4415627cdeb5c4c5746f4ea77f59d1b
size 1458959648

3
dqnMath-v0.1-3B-HF.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1cd0599b2bc500dc0522be6e4f71ae68bea2f40416a9d4372a3f7d93aa153f5c
size 1934357792

3
dqnMath-v0.1-3B-HF.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6cf2d65e2e61dabd44e6b0ea00e264fd4294f0cb12de69998baf826217187132
size 1795552544

3
dqnMath-v0.1-3B-HF.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ba3cdfdc6dd8a04ed05070267ba27218c34b2a92450eeae7036dc6baf824ef4
size 1639150880

3
dqnMath-v0.1-3B-HF.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c386dab985eed036c42d68d60c7be2d3b185b4a6756649270afb83d884a8032f
size 2146497824

3
dqnMath-v0.1-3B-HF.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08043b4f470efe9462bbbf85265086895e11704029d1d737dd767bb0a554009e
size 2053256480

3
dqnMath-v0.1-3B-HF.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f129195ed80188c4e65d8da822ebe9fd1442051e0bd1b3deb40e03778f5fc5ad
size 2473653536

3
dqnMath-v0.1-3B-HF.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:246674744c26979258a912401e0a6e2829d59b04c24b11a649bd75e72804696b
size 2419340576

3
dqnMath-v0.1-3B-HF.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f6b3d151c0855350f1b7305caf5a150bcdcaf1b541770d76cb332e54686fc6c
size 2821256480

3
dqnMath-v0.1-3B-HF.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b3ee5eaf0e6fb909d88f0811fff6297254b93257fce9b5c293103dcad071fb5
size 3651679520

3
dqnMath-v0.1-3B-HF.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18f0529a666063a5ead38373e1f3c62347734572c4df500404fa3306acd8bfbe
size 6866220320