duyntnet/OpenMath-Mistral-7B-v0.1-hf-imatrix-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: duyntnet/OpenMath-Mistral-7B-v0.1-hf-imatrix-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 16:18:16 +08:00
commit ab96c75932
29 changed files with 168 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

62
.gitattributes vendored Normal file
View File

@@ -0,0 +1,62 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-Mistral-7B-v0.1-hf-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

3
OpenMath-Mistral-7B-v0.1-hf-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ab0f3b099aaabfafeb03ba6021db4e44ab31ecd243d1aef5ed2c954e6a54ed8
size 1754446304

3
OpenMath-Mistral-7B-v0.1-hf-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ac0e7ce348d3ca4b0cf9b60528932bad4913a4bf26d77e4706fa4b414746cf1
size 1612102112

3
OpenMath-Mistral-7B-v0.1-hf-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45503090ed277f67f23e651316ac884f6f5378dc42b2b7ea0a5a5bd1aeb2313d
size 2500712928

3
OpenMath-Mistral-7B-v0.1-hf-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5dc4adc68da302be2b5a1ab03e9bd4a239d3de2190b1f769d8a4b6966ea28036
size 2310920672

3
OpenMath-Mistral-7B-v0.1-hf-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34ef847350400ed57af49f42222efc812711624bee4e8a52cc0335a9e6fbe481
size 2198256096

3
OpenMath-Mistral-7B-v0.1-hf-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e791692d7979710b4ca109cee4c2e1d630b250d96b3598d0cd5b0d9f3ebb3753
size 1991686624

3
OpenMath-Mistral-7B-v0.1-hf-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0a8812d9e89b76f552e6ccfd12bf496e84f9556647292a70cfc2bf218e911b5
size 3284892128

3
OpenMath-Mistral-7B-v0.1-hf-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2867e91a37d1fc99689ed4385b2cfdf9bd5bb575609feeb31a51fe1971acece
size 3182393824

3
OpenMath-Mistral-7B-v0.1-hf-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5889acc172be556b8a88dd39fc63982ca582c4cc7248d0d679f9de01346e0297
size 3018815968

3
OpenMath-Mistral-7B-v0.1-hf-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2785c1c11d8519fa669791bffe213bba1f7461c377167e69f9a4ae28d51bb5f3
size 2827344352

3
OpenMath-Mistral-7B-v0.1-hf-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:018fb514c3f61f92bdb6b38b379fea628a1db15e4ee482afaccbdc638288bfcf
size 4125694432

3
OpenMath-Mistral-7B-v0.1-hf-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b910dd4f3be707cb7c79ea8109911a327b082f0b6a7a7c66657adb5d7a3bdf4
size 3907688928

3
OpenMath-Mistral-7B-v0.1-hf-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d03de1eb608c9b93ad5ffc872f84cea5ae35435a1898ca2da6c284bcb24336f7
size 2719242720

3
OpenMath-Mistral-7B-v0.1-hf-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52166ab2b5668a56c4286c1c041645a43e0ceef8c06066b008d51bda7da61217
size 2528926176

3
OpenMath-Mistral-7B-v0.1-hf-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76bfb0a73ce6facf95e3e1e31d8a02a3347e157620e9525040d6767bf5cd7e7e
size 3822025184

3
OpenMath-Mistral-7B-v0.1-hf-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fcceca203a969651e0aa92d92631adc4981abb2e0006d1d5aed8320308bf634
size 3518986720

3
OpenMath-Mistral-7B-v0.1-hf-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:33de7b64f331da443f2c99c6f00954422a210003262b49486cf1eed2a4ea6a23
size 3164568032

3
OpenMath-Mistral-7B-v0.1-hf-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:738cbc0879a851ea25d1bfd2e8a4dff319ff775a73ca34c9235038859b462e05
size 4123597280

3
OpenMath-Mistral-7B-v0.1-hf-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:994e18f89051e99d944a8ef775252e6788299b0e1485873053e53992dc140991
size 4553316832

3
OpenMath-Mistral-7B-v0.1-hf-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff84a5c97be8b8f9e1af808178238a368122610b0f4ee3ccaa49f723232a90c3
size 4368439776

3
OpenMath-Mistral-7B-v0.1-hf-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1468211e01a350855cf3ab2828334b2ba183dc6c647331a3c42abb811c352748
size 4140374496

3
OpenMath-Mistral-7B-v0.1-hf-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:953a3d64fa46f77f8a42ef49adee6ce8d2793460e0695934c7751f58234791f9
size 5012396512

3
OpenMath-Mistral-7B-v0.1-hf-Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6254ffc6d05e2eb083b94f33fb9497b8273f97dd437a8f68e5213c4dd46942dc
size 5442116064

3
OpenMath-Mistral-7B-v0.1-hf-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ee4dfa65e7496d8dd3d0c5cf42bc18c96236a882fdc781118c66f866f7ed206
size 5131409888

3
OpenMath-Mistral-7B-v0.1-hf-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c1edd0219ed02fbe40904c076a157010b1174539b0aae72231e20683fcda121
size 4997716448

3
OpenMath-Mistral-7B-v0.1-hf-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb1e2c6dd50a024bc547ccf232eb7009f545bef3d13190d7b1ec314af997756b
size 5942065632

3
OpenMath-Mistral-7B-v0.1-hf-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3d01ca152f21658892797046ab31b1d8aa2fdb5203d3ddbe883aecdcbca3eb6
size 7695858144

25
README.md Normal file
View File

@@ -0,0 +1,25 @@
---
license: other
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- transformers
- gguf
- imatrix
- OpenMath-Mistral-7B-v0.1-hf
---
Quantizations of https://huggingface.co/nvidia/OpenMath-Mistral-7B-v0.1-hf
# From original readme
OpenMath models were designed to solve mathematical problems by integrating text-based reasoning with code blocks
executed by Python interpreter. The models were trained on [OpenMathInstruct-1](https://huggingface.co/datasets/nvidia/OpenMathInstruct-1),
a math instruction tuning dataset with 1.8M problem-solution pairs generated using permissively licensed
[Mixtral-8x7B](https://huggingface.co/mistralai/Mixtral-8x7B-v0.1) model.
## How to use the models?
Try to [run inference with our models](https://github.com/Kipok/NeMo-Skills/blob/main/docs/inference.md) with just a few commands!