Mungert/NextCoder-7B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Mungert/NextCoder-7B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-16 22:06:13 +08:00
commit 4b2d70f829
30 changed files with 398 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

77
.gitattributes vendored Normal file
View File

@@ -0,0 +1,77 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-f16.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-f16_q8_0.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-bf16_q8_0.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-f16_q6_k.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-bf16_q6_k.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-f16_q4_k.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-bf16_q4_k.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q2_k_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_k_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_k_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q6_k_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q2_k_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q2_k_s.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q6_k_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_1.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_0_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q4_1_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_1.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_0_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-q5_1_l.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq2_xxs.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq2_s.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq2_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq3_xxs.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq3_s.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq4_xs.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text
NextCoder-7B.imatrix filter=lfs diff=lfs merge=lfs -text
NextCoder-7B-bf16.gguf filter=lfs diff=lfs merge=lfs -text

3
NextCoder-7B-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c9ef003576b01d2f2cf0d143b55b91a25a9976c1478ca387f1a5abc89ad9485
size 15237854624

3
NextCoder-7B-bf16_q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d07023263c25233c8cd4ae276e1ba88bc95d37ef013cf39df956c16fbd33b4e0
size 11287999904

3
NextCoder-7B-f16_q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e69c75439050eec157e03f2a99fcea1bb18edd9d176c555cc4ba88406e6a199
size 11287999904

3
NextCoder-7B-iq2_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:883d85a95e3bc0dfc751a15158d560a9c46296903490999fbc366ffdc609be42
size 3039123168

3
NextCoder-7B-iq2_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63749af3d211df08cf844b4fbfc2569cdd68b951561b0c9fed1207a473d7b8ea
size 2912966368

3
NextCoder-7B-iq2_xs.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:702567b4ade1789d1923c2c9db7217a9b16988959d321b6bc20fe0ab15787a86
size 2839336672

3
NextCoder-7B-iq2_xxs.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ea06eb09c0fb46441e3ef4f0c2f42017b074176f06225481deaaf81b65c9309
size 2650904288

3
NextCoder-7B-iq3_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a707d97287cb622f1baa9c8a7b4f95e5deb43dcf290490579b4572bcd1ddf4de
size 3779692256

3
NextCoder-7B-iq3_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64c64d371c452ed3b7a57c3617790d5cf973b60a1c2189290ba56f9d40ea3e5f
size 3779692256

3
NextCoder-7B-iq3_xs.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66311fff7a18d695ef643ae6889cbd9bf622e00cb3823f55484c0c1f488a64c0
size 3450050272

3
NextCoder-7B-iq3_xxs.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cf36d8316fc8809a6d8b3ea5b01f6f77994fbf35353953bf750f63db2839c15
size 3379803872

3
NextCoder-7B-iq4_nl.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c55be864b0adc09b41c7477bac0a7f255d69890a2f43ca4897df6a48a20c2411
size 4437815008

3
NextCoder-7B-iq4_xs.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e4dd18703488f8ee96571950bee2fba7a6843592e38bae10e6d3324da05e85b
size 4218474208

3
NextCoder-7B-q2_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57d6f48a01cc5eb20660c8cc9dcdd516fd383791234e2ba89cc814806a28d757
size 3264112352

3
NextCoder-7B-q2_k_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c7ce48da6bdc5fc1ecf645417268fcdd8144e67182983e3fcbd33d67a8705e9
size 3119347424

3
NextCoder-7B-q3_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c33e448184f79c8419679e9886b30d0a4a58d87cfee55afee3d5dd0591f36a81
size 4003505888

3
NextCoder-7B-q3_k_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46277cfac5bd0ffa789f85c013ae7ac83a31fccddb3b5718f68eac4c31df78a1
size 3858740960

3
NextCoder-7B-q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5879376ac07ca42dd6b539ba9afdb294389b6ee868f1453083786279bcc2bef1
size 4290885344

3
NextCoder-7B-q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e4a8c2b9870245883a725fc20719c7e15fef02643805219d0e3e0006f2a69b5
size 4766840544

3
NextCoder-7B-q4_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a969985470e7d5477233516a9133fab826e54052c131ef03248c6fb8b224209c
size 4777649888

3
NextCoder-7B-q4_k_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e2e04b315f151ebea254b1e28392d69b392a91e4ef64197760f2a4f143b425e
size 4634060512

3
NextCoder-7B-q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00be44a481ec12595f0a8a9cd25e53347eb0e0ce1c9bd57c23dc2fc04fe6e3c5
size 5242795744

3
NextCoder-7B-q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c106f3468b16f3bff2cb9e6efca0fdd73da43b1b906c022371a4524c681c07ec
size 5718750944

3
NextCoder-7B-q5_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97551f76b645aeea23676825e4b94fb40b2cf9ce72c4f8bf375f08d3cb7fc3fe
size 5527451360

3
NextCoder-7B-q5_k_s.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:984bcab0f9cfceee6cac69993adbc732c4707062a08b162c2b1d71a0f0492dde
size 5453362912

3
NextCoder-7B-q6_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92c9e40fb7efa53569d2a19fa32582a0007d7a65ac2312540e04c47a7dca070c
size 6254200544

3
NextCoder-7B-q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c70ebb789ca6a96514c5a48801f7678e64672adfc6d6ea41ae80cf2424e423bd
size 8098526624

3
NextCoder-7B.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b0f3308b27a35b3a6237f856398a6fd4c3caec47afa63320c01fe79b28072e6
size 4536712

237
README.md Normal file
View File

@@ -0,0 +1,237 @@
---
license: mit
language:
- en
base_model:
- Qwen/Qwen2.5-Coder-7B-Instruct
pipeline_tag: text-generation
library_name: transformers
tags:
- code
- chat
- microsoft
- nextcoder
- selekt
datasets:
- microsoft/NextCoderDataset
- microsoft/NextCoderDataset-Conversational
- bigcode/commitpackft
- bigcode/starcoderdata
---
# <span style="color: #7FFF7F;">NextCoder-7B GGUF Models</span>
## <span style="color: #7F7FFF;">Model Generation Details</span>
This model was generated using [llama.cpp](https://github.com/ggerganov/llama.cpp) at commit [`5dd942de`](https://github.com/ggerganov/llama.cpp/commit/5dd942de5922a22ec8446a4ad2203738dbcb9389).
---
## <span style="color: #7FFF7F;">Quantization Beyond the IMatrix</span>
I've been experimenting with a new quantization approach that selectively elevates the precision of key layers beyond what the default IMatrix configuration provides.
In my testing, standard IMatrix quantization underperforms at lower bit depths, especially with Mixture of Experts (MoE) models. To address this, I'm using the `--tensor-type` option in `llama.cpp` to manually "bump" important layers to higher precision. You can see the implementation here:
👉 [Layer bumping with llama.cpp](https://github.com/Mungert69/GGUFModelBuilder/blob/main/model-converter/tensor_list_builder.py)
While this does increase model file size, it significantly improves precision for a given quantization level.
### **I'd love your feedback—have you tried this? How does it perform for you?**
---
<a href="https://readyforquantum.com/huggingface_gguf_selection_guide.html" style="color: #7FFF7F;">
Click here to get info on choosing the right GGUF model format
</a>
---
<!--Begin Original Model Card-->
# NextCoder-7B
<p align="center">
<a href="https://github.com/microsoft/NextCoder">GitHub</a>&nbsp&nbsp | &nbsp&nbsp <a href="https://www.microsoft.com/en-us/research/publication/nextcoder-robust-adaptation-of-code-lms-to-diverse-code-edits/">Paper</a>
</p>
> NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits (ICML'2025)
## Introduction
NextCoder is the latest series of Code-Editing large language models developed using the Qwen2.5-Coder Instruct variants as base and trained with novel Selective Knowledge Transfer finetuning methodology as introduced in the paper. NextCoder family model comes in 3 different sizes 7, 14, 32 billion parameters, to meet the needs of different developers.
Following are the key improvements:
- Significantly improvements in **code editing**, NextCoder-32B has performing on par with GPT-4o on complex benchmarks like Aider-Polyglot with performance increment of 44% from their base model.
- No loss of generalizibility, due to our new finetuning method **SeleKT**
- **Long-context Support** up to 32K tokens.
**This repo contains the NextCoder-7B model**, which has the following features:
- Type: Causal Language Models
- Training Stage: Post-training with SeleKT
- Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
- Number of Parameters: 7.61B
- Number of Paramaters (Non-Embedding): 6.53B
- Number of Layers: 28
- Number of Attention Heads (GQA): 28 for Q and 4 for KV
For more details, please refer to our [blog](), [GitHub](https://github.com/microsoft/NextCoder), [Paper](https://www.microsoft.com/en-us/research/publication/nextcoder-robust-adaptation-of-code-lms-to-diverse-code-edits/).
## Requirements
The code of NextCoder is based on Qwen2.5 base models which has been in the latest Hugging face `transformers` and we advise you to use the latest version of `transformers`.
With `transformers<4.37.0`, you will encounter the following error:
```
KeyError: 'qwen2'
```
## Quickstart
Here provides a code snippet with `apply_chat_template` to show you how to load the tokenizer and model and how to generate contents.
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "microsoft/NextCoder-7B"
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto",
device_map="auto",
)
tokenizer = AutoTokenizer.from_pretrained(model_name)
prompt = """
Fix the following function that divides two numbers to handle all the edge cases:
def divide(a, b)
returm a/b
"""
messages = [
{"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
messages,
tokenize=False,
add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
generated_ids = model.generate(
**model_inputs,
max_new_tokens=1024
)
generated_ids = [
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
```
## Evaluation and Performance
| Models | HUMANEVALFIX | CANITEDIT | AIDER | POLYGLOT |
|--------|---------------|-----------|-------|----------|
| QwenCoder-2.5-3B | 73.2 | 37.1 | 36.8 | - |
| QwenCoder-2.5-3B-LoRA | 64.6 | 36.2 | 35.8 | - |
| QwenCoder-2.5-3B-SFT | 76.2 | 32.4 | 30.1 | - |
| **NextCoder-3B** | 75.6 | 42.4 | 37.6 | - |
| QwenCoder-2.5-7B | 73.8 | 48.1 | 59.4 | - |
| QwenCoder-2.5-7B-LoRA | 70.7 | 44.3 | 40.6 | - |
| QwenCoder-2.5-7B-SFT | 70.1 | 36.7 | 48.9 | - |
| **NextCoder-7B** | 81.1 | 50.5 | 65.7 | - |
| QwenCoder-2.5-14B | 87.8 | 58.1 | 66.9 | 9.3 |
| QwenCoder-2.5-14B-LoRA | 78.0 | 50.9 | 66.2 | 5.3 |
| QwenCoder-2.5-14B-SFT | 79.9 | 42.4 | 36.8 | 3.1 |
| **NextCoder-14B** | 89.8 | 60.2 | 72.2 | 12.2 |
| QwenCoder-2.5-32B | **90.2** | 61.0 | 72.9 | 16.4 |
| QwenCoder-2.5-32B-LoRA | 82.3 | 52.4 | 60.2 | 6.7 |
| QwenCoder-2.5-32B-SFT | 81.7 | 49.5 | 66.9 | 8.4 |
| **NextCoder-32B** | 88.9 | **62.4** | **74.7** | **23.6** |
*Comparison of base QwenCoder-2.5 models of different sizes and their SELEKT-enhanced versions across three code editing benchmarks.*
**Detailed evaluation results are reported in this [📑 paper](https://www.microsoft.com/en-us/research/publication/nextcoder-robust-adaptation-of-code-lms-to-diverse-code-edits/).**
## Responsible AI Use
The base models (from the QwenCoder-2.5 family) are suspectible to malicious prompts and may generate or execute harmful code. Our finetuning does not enhance or impede such behaviors. The users should use the models and their outputs responsibly and with caution. Model outputs should be subjected to additional analysis, including manual inspection, and sandboxing before execution.
## Citation
```bibtex
@inproceedings{aggarwal2025nextcoder,
author = {Aggarwal, Tushar and Singh, Swayam and Awasthi, Abhijeet and Kanade, Aditya and Natarajan, Nagarajan},
title = {NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits},
booktitle = {International Conference on Machine Learning},
year = {2025},
url = {https://www.microsoft.com/en-us/research/publication/nextcoder-robust-adaptation-of-code-lms-to-diverse-code-edits/},
}
```
<!--End Original Model Card-->
---
# <span id="testllm" style="color: #7F7FFF;">🚀 If you find these models useful</span>
Help me test my **AI-Powered Quantum Network Monitor Assistant** with **quantum-ready security checks**:
👉 [Quantum Network Monitor](https://readyforquantum.com/?assistant=open&utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme)
The full Open Source Code for the Quantum Network Monitor Service available at my github repos ( repos with NetworkMonitor in the name) : [Source Code Quantum Network Monitor](https://github.com/Mungert69). You will also find the code I use to quantize the models if you want to do it yourself [GGUFModelBuilder](https://github.com/Mungert69/GGUFModelBuilder)
💬 **How to test**:
Choose an **AI assistant type**:
- `TurboLLM` (GPT-4.1-mini)
- `HugLLM` (Hugginface Open-source models)
- `TestLLM` (Experimental CPU-only)
### **What I’m Testing**
I’m pushing the limits of **small open-source models for AI network monitoring**, specifically:
- **Function calling** against live network services
- **How small can a model go** while still handling:
- Automated **Nmap security scans**
- **Quantum-readiness checks**
- **Network Monitoring tasks**
🟡 **TestLLM** – Current experimental model (llama.cpp on 2 CPU threads on huggingface docker space):
- ✅ **Zero-configuration setup**
- ⏳ 30s load time (slow inference but **no API costs**) . No token limited as the cost is low.
- 🔧 **Help wanted!** If you’re into **edge-device AI**, let’s collaborate!
### **Other Assistants**
🟢 **TurboLLM** – Uses **gpt-4.1-mini** :
- **It performs very well but unfortunatly OpenAI charges per token. For this reason tokens usage is limited.
- **Create custom cmd processors to run .net code on Quantum Network Monitor Agents**
- **Real-time network diagnostics and monitoring**
- **Security Audits**
- **Penetration testing** (Nmap/Metasploit)
🔵 **HugLLM** – Latest Open-source models:
- 🌐 Runs on Hugging Face Inference API. Performs pretty well using the lastest models hosted on Novita.
### 💡 **Example commands you could test**:
1. `"Give me info on my websites SSL certificate"`
2. `"Check if my server is using quantum safe encyption for communication"`
3. `"Run a comprehensive security audit on my server"`
4. '"Create a cmd processor to .. (what ever you want)" Note you need to install a [Quantum Network Monitor Agent](https://readyforquantum.com/Download/?utm_source=huggingface&utm_medium=referral&utm_campaign=huggingface_repo_readme) to run the .net code on. This is a very flexible and powerful feature. Use with caution!
### Final Word
I fund the servers used to create these model files, run the Quantum Network Monitor service, and pay for inference from Novita and OpenAI—all out of my own pocket. All the code behind the model creation and the Quantum Network Monitor project is [open source](https://github.com/Mungert69). Feel free to use whatever you find helpful.
If you appreciate the work, please consider [buying me a coffee](https://www.buymeacoffee.com/mahadeva) ☕. Your support helps cover service costs and allows me to raise token limits for everyone.
I'm also open to job opportunities or sponsorship.
Thank you! 😊