mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 01:19:09 +08:00
commit 6bac9e63b7
27 changed files with 248 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2ce857819d1d4e05fe29f1881ae8f19189cffbca63944b129afd795e26c5169
size 2787278944

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0102f41cc26061b0b64251e26d45051c98f48ad41c66bfda686c98a581baf3ee
size 2580281440

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d02064a12eb4b760ea6923b34317196766dc30a6e13266c5c415644d221dc430
size 3866822752

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7222db8ddc611808ecde81402fc9df8a4a972d3472e87ddeffe1e6b3a01abde6
size 3590826080

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f27ae3d15c19a6fcb6628bd031752e744a946e15b7c8d2572f895e98c5cb41b1
size 3425130592

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9282879e2dd2701d4d32ca74d3208232074a6859192333d447ed7fb0d4c7a7af
size 3132274784

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:673b869946b6c37e63f1ef2587c2fef611a0bfdbb3585a3af066563a07380281
size 5021931616

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:189933e91ffa631073862428eda462c2dfce1481304e245f9a05ddbff03e28dc
size 4905193568

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:539b527f14e2ac6eb27b12ece35e3afdba419e35c2b7e8eb6fd77192a0a7fefb
size 4678971488

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a1c330e9dcda5e5c76acd161bab39e328d546c85c4e9573832f380c1de24fa6
size 4364367968

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25ab729b31a402632dc85ade3e85828232daf207123b6cd8a20a2e95a1700faf
size 6276933728

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:657fe0b3ead2df889c8d7e9db3cffa8082595b4c03a232464d9bc224f4289ad1
size 5956438112

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:206370b258c0ef5dcaf0917622edf70b189694da2dbc529d92a7f32a2577c534
size 4207990880

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d379bb2c70b53915568180eec33124ced56980e4f7203b2e677de43374938115
size 3943147616

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a03dac6b414d1f05c5023d88df238a192bb78424caf3e9439fc093002d8fdaa
size 5789093984

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:152ffd77ef27001f7b588e2a558f6a91bb5bb6dfb8059311057b885dc58d3b18
size 5373005920

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:987f72dbe056600ade21b3ba30752d67de13cc22d143f80b9394f4eb80ebc0ab
size 4894957664

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7092fd7593f208a49d2d90034f57094f47483ecb2601e1e64818e2211c443ca1
size 6288517216

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1774bd433187ecf959eecd99aa7eb3b5aea87f08e83f73e74365ace2d5fc4b29
size 6913108064

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e17de08f5688402b6b47752a2cb9fc8427dfb808a5a95f83b9602b2ff400cb8
size 6644824160

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef5292b33978591e4801bb3feb5fb796325bb844ecaed74e155fcfec9af246bb
size 6310652000

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1d0c9beba4b1216a87c9403e2bb5ec375b65cbaa7f98950e09ff946362ef639
size 7753398368

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d59dde669d05eb28c3a490607ca7f56593efe61bbbb6388095c415d4bf36aa5e
size 7558916192

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7f5792675d3ff80f0fa99731a5614fe4ea4a4b6e06186875616720cf2c8f92c
size 8931258464

3
Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f0ea03281aabebea32f88c3f173873add580e7d4b0c5ce6ec123087c3cca565
size 6840480

113
README.md Normal file
View File

@@ -0,0 +1,113 @@
---
base_model: DavidAU/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B
datasets:
- microsoft/NextCoderDataset
- microsoft/NextCoderDataset-Conversational
- bigcode/commitpackft
- bigcode/starcoderdata
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- merge
- programming
- code generation
- code
- codeqwen
- coding
- coder
- qwen2
- chat
- qwen
- qwen-coder
- code
- chat
- microsoft
- nextcoder
- selekt
- code-generation
- program-synthesis
- evolutionary-algorithms
- arc
- arc-agi
- soar
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DavidAU/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.0 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q2_K.gguf) | i1-Q2_K | 4.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 5.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 6.4 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_0.gguf) | i1-Q4_0 | 6.4 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 6.4 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 6.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q4_1.gguf) | i1-Q4_1 | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B-i1-GGUF/resolve/main/Qwen2.5-Microsoft-NextCoder-Olympic-Instruct-FUSED-CODER-Fast-11B.i1-Q6_K.gguf) | i1-Q6_K | 9.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->