mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-11 21:21:10 +08:00
commit f4bc27d052
27 changed files with 217 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:324c3e4a7a75961a11c7d8ef8a45d5c5140f333b66b1f3f26fc971d90c6cf47d
size 1650972192

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2fd9fcfb6beea7068e4a97be297c166eb215e741eeba1a6d2ab4b14a44e55d1
size 1528583712

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:82eab00ce7d7be21d1a0fca959f1dab136bc162d5dee8d10823a9c66ce271db4
size 2359752224

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62352b95f1cd0073d0a87df62115585af39c16909913b23dfacaf674ebb8df61
size 2196567584

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08f1e393c9e76917108d60f57434a231d80e1d1b3fb07a217d1fbb942770cfd7
size 2034914848

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de6f4b6259723d16eb958d27682fbc1af1250c397b9ee7923291d83e08d3199b
size 1854952992

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2b9b63bce2a9ff3f762cde210468c31737d3c066a8ff4a03e9f83d5e2e85580
size 3114866208

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac7af29433034eac94176de5f9bae028fdb9b4eb53eaf2372ae4b30fbd95a095
size 2948306464

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15f7a6a854e68c2d7304a9bc7ace6428113900e5c7724100e0730c57af2bc02b
size 2796525088

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c42a993b64955385d789974258e3b3642c013fcac9d73df4e22bcdd942cde47b
size 2585392672

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:080b6c4153a1b3e35be321c0aebdcabe4c25caff5465d56e9d2d887069ccaca3
size 3825808928

3
OpenMath-CodeLlama-7b-Python-hf.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aedb84811d8101ba60c8463dd930e435c0bbbdfe49962e8b2ea3aa4edc698fcb
size 3619337760

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5a9f5b245c4266fbd27c501e20a6c8594494c80896b1f60d031123422b54824
size 2532865568

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6090b0a10abe8795bb9421f6690b4c2a13840025926e180cb6453da3dc2a649e
size 2319545888

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17b0635229a4f39488e739d1074d511acc44312fbe104d6a0ca2311c0bb205f6
size 3597112864

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e8dc2177b43dfa0b499b86453017464bb0d15b6190e7f4c46a5571dafe9c2f0
size 3298006560

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4128e83c269bf9b57ea50cbfb5e5d60c13233eeb619af044087b49d2a27d56db
size 2948306464

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:040850f4a46f97c3283c4dab41569092ce343cf7540fb664b36380c9c18571ef
size 3837081120

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b50ea174325213cbda615cfa2cf7f0dca5a8f5c7c36ddc6a71a51c471bbf11de
size 4238751264

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01e08566ca37908c7e757f9970bcb8af91760d40e83641716e5ae7f1e554d81f
size 4081006112

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a52ac52bd43d62b8e3315d37a52790d2ff3a4e3748c8e9156d147491da0eca9
size 3856741920

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5aa6bf7f06512c3da3e3026342f5524ad82d93f8411d67683e80deb36852921
size 4783158816

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4b0a70971c417be5c7d5c45d612512d164234a9316d74f0492270a32930b33c
size 4651693600

3
OpenMath-CodeLlama-7b-Python-hf.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c010e4d15ff319177f3e566839f8e4c874059d1df66598225cfcfb0d03cae6f
size 5529196064

82
README.md Normal file
View File

@@ -0,0 +1,82 @@
---
base_model: nvidia/OpenMath-CodeLlama-7b-Python-hf
datasets:
- nvidia/OpenMathInstruct-1
language:
- en
library_name: transformers
license: llama2
quantized_by: mradermacher
tags:
- nvidia
- code
- math
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/nvidia/OpenMath-CodeLlama-7b-Python-hf
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ1_S.gguf) | i1-IQ1_S | 1.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ1_M.gguf) | i1-IQ1_M | 1.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_S.gguf) | i1-IQ2_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ2_M.gguf) | i1-IQ2_M | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q2_K.gguf) | i1-Q2_K | 2.6 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.7 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_S.gguf) | i1-IQ3_S | 3.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ3_M.gguf) | i1-IQ3_M | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-IQ4_NL.gguf) | i1-IQ4_NL | 3.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q4_0.gguf) | i1-Q4_0 | 3.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q4_1.gguf) | i1-Q4_1 | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q5_K_M.gguf) | i1-Q5_K_M | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/OpenMath-CodeLlama-7b-Python-hf-i1-GGUF/resolve/main/OpenMath-CodeLlama-7b-Python-hf.i1-Q6_K.gguf) | i1-Q6_K | 5.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0e1f70aadf6781b108c7207764e22a01165884b1c8ba6457427ec6496165c4d
size 4562173