duyntnet/Seed-Coder-8B-Instruct-imatrix-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: duyntnet/Seed-Coder-8B-Instruct-imatrix-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-18 16:16:19 +08:00
commit 5ed0f0c3e0
29 changed files with 247 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

62
.gitattributes vendored Normal file
View File

@@ -0,0 +1,62 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Seed-Coder-8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

104
README.md Normal file
View File

@@ -0,0 +1,104 @@
---
license: other
language:
- en
pipeline_tag: text-generation
inference: false
tags:
- transformers
- gguf
- imatrix
- Seed-Coder-8B-Instruct
---
Quantizations of https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Instruct
### Open source inference clients/UIs
* [llama.cpp](https://github.com/ggerganov/llama.cpp)
* [KoboldCPP](https://github.com/LostRuins/koboldcpp)
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui)
### Closed source inference clients/UIs
* [LM Studio](https://lmstudio.ai/)
* More will be added...
---
# From original readme
We are thrilled to introduce Seed-Coder, a powerful, transparent, and parameter-efficient family of open-source code models at the 8B scale, featuring base, instruct, and reasoning variants. Seed-Coder contributes to promote the evolution of open code models through the following highlights.
- **Model-centric:** Seed-Coder predominantly leverages LLMs instead of hand-crafted rules for code data filtering, minimizing manual effort in pretraining data construction.
- **Transparent:** We openly share detailed insights into our model-centric data pipeline, including methods for curating GitHub data, commits data, and code-related web data.
- **Powerful:** Seed-Coder achieves state-of-the-art performance among open-source models of comparable size across a diverse range of coding tasks.
This repo contains the **Seed-Coder-8B-Instruct** model, which has the following features:
- Type: Causal language models
- Training Stage: Pretraining & Post-training
- Data Source: Public datasets, synthetic data
- Context Length: 32,768
## Model Downloads
| Model Name | Length | Download | Notes |
|---------------------------------------------------------|--------|------------------------------------|-----------------------|
| Seed-Coder-8B-Base | 32K | 🤗 [Model](https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Base) | Pretrained on our model-centric code data. |
| 👉 **Seed-Coder-8B-Instruct** | 32K | 🤗 [Model](https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Instruct) | Instruction-tuned for alignment with user intent. |
| Seed-Coder-8B-Reasoning | 64K | 🤗 [Model](https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Reasoning) | RL trained to boost reasoning capabilities. |
| Seed-Coder-8B-Reasoning-bf16 | 64K | 🤗 [Model](https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Reasoning-bf16) | RL trained to boost reasoning capabilities. |
## Requirements
You will need to install the latest versions of `transformers` and `accelerate`:
```bash
pip install -U transformers accelerate
```
## Quickstart
Here is a simple example demonstrating how to load the model and generate code using the Hugging Face `pipeline` API:
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
model_id = "ByteDance-Seed/Seed-Coder-8B-Instruct"
tokenizer = AutoTokenizer.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True)
messages = [
{"role": "user", "content": "Write a quick sort algorithm."},
]
input_ids = tokenizer.apply_chat_template(
messages,
tokenize=True,
return_tensors="pt",
add_generation_prompt=True,
).to(model.device)
outputs = model.generate(input_ids, max_new_tokens=512)
response = tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True)
print(response)
```
## Evaluation
Seed-Coder-8B-Instruct has been evaluated on a wide range of coding tasks, including code generation, code reasoning, code editing, and software engineering, achieving state-of-the-art performance among ~8B open-source models.
| Model | HumanEval | MBPP | MHPP | BigCodeBench (Full) | BigCodeBench (Hard) | LiveCodeBench (2410 – 2502) |
|:-----------------------------:|:---------:|:----:|:----:|:-------------------:|:-------------------:|:-------------------------:|
| CodeLlama-7B-Instruct | 40.9 | 54.0 | 6.7 | 25.7 | 4.1 | 3.6 |
| DeepSeek-Coder-6.7B-Instruct | 74.4 | 74.9 | 20.0 | 43.8 | 15.5 | 9.6 |
| CodeQwen1.5-7B-Chat | 83.5 | 77.7 | 17.6 | 43.6 | 15.5 | 3.0 |
| Yi-Coder-9B-Chat | 82.3 | 82.0 | 26.7 | 49.0 | 17.6 | 17.5 |
| Llama-3.1-8B-Instruct | 68.3 | 70.1 | 17.1 | 40.5 | 13.5 | 11.5 |
| OpenCoder-8B-Instruct | 83.5 | 79.1 | 30.5 | 50.9 | 18.9 | 17.1 |
| Qwen2.5-Coder-7B-Instruct | **88.4** | 83.5 | 26.7 | 48.8 | 20.3 | 17.3 |
| Qwen3-8B | 84.8 | 77.0 | 32.8 | 51.7 | 23.0 | 23.5 |
| Seed-Coder-8B-Instruct | 84.8 | **85.2** | **36.2** | **53.3** | **26.4** | **24.7** |
For detailed benchmark performance, please refer to our [📑 Technical Report](https://github.com/ByteDance-Seed/Seed-Coder/blob/master/Seed-Coder.pdf).

3
Seed-Coder-8B-Instruct-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f1a280e0b07f1c8d8645b66e01935b51dd205084a73d5fa613ebb46953cd343
size 2272220960

3
Seed-Coder-8B-Instruct-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d134c9b98b90ed882a5c89917fa1966b442b669dd2212b76936db337f56e888c
size 2129876768

3
Seed-Coder-8B-Instruct-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c28e5b4ecc5b9a352626136b09695dcd8e4cc0707f53103fe7fd239d38e09da6
size 3069712160

3
Seed-Coder-8B-Instruct-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8641dcd73e26ba6a857bc0e633f5ede14bb25c60d7664b366606e5b7c4693369
size 2879919904

3
Seed-Coder-8B-Instruct-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fcad114be38b5cca248bdc5f337ba7568a746820ac49d5cd6f389c7be2678767
size 2716030752

3
Seed-Coder-8B-Instruct-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b79c0a0793d2da62b1ef6808aa504bdc8f5c34c19ba35c96141897da4696f93f
size 2509461280

3
Seed-Coder-8B-Instruct-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45e22168b6ffba5aba63b0189175eb52f31230301c6b62d8d8c0cfcc917ec33d
size 3920877344

3
Seed-Coder-8B-Instruct-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad3cc37e8b8ca13be8916d051709a00412398f765b9a9645571316bd2cc8ac58
size 3818379040

3
Seed-Coder-8B-Instruct-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1bd140bcc523498986a6706279402ad8a1e80f564b69545fd4747696f061f2f
size 3654801184

3
Seed-Coder-8B-Instruct-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d35b6f80da5fdb8aac77c9dfbd59501bf4fcddcf00c591a1750e5cae9acc6db6
size 3396343584

3
Seed-Coder-8B-Instruct-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a2f8b3fa9aadef6edfc5797de75c1df632b3d25a8259c8f84b3a82ff275909f
size 4828665632

3
Seed-Coder-8B-Instruct-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:302e0b32276b311e76047fb576b5b6e8bb506fcad050dbc1a046ca2c4f8fb464
size 4594898720

3
Seed-Coder-8B-Instruct-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d22a5438d634d2267974f01a58d0036439a6b759e97a5a9eb961358c1521bee3
size 3304003360

3
Seed-Coder-8B-Instruct-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da03684c4ec0e996c7d83f99b5e1209fc89ad391cd3336a684fd8da813edf9b0
size 3113686816

3
Seed-Coder-8B-Instruct-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c46b981ed128282c742c0535e211a180040952b0dea839e91c30bda737b4d7c
size 4458010400

3
Seed-Coder-8B-Instruct-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08c7cdd6305660959c30ff33b3da9af9759a6cf7551a9b8125a4bfd4db282268
size 4154971936

3
Seed-Coder-8B-Instruct-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4916473dba6203a0054b0895449eb0de0880053e5c287b139cabee877a1080de
size 3800553248

3
Seed-Coder-8B-Instruct-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51277d26aa9516669bc88fee31cb52593ad9cba3bd17591804c085fb25cb35c0
size 4826568480

3
Seed-Coder-8B-Instruct-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62f1e74740bef0894333192a265ce6c9aec37e1707f4230a487ddb832ae2f14c
size 5287810848

3
Seed-Coder-8B-Instruct-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57be1d99d273a0522abf08ca35ccfbf135dd2741a3753833124d8ea54ad93218
size 5071410976

3
Seed-Coder-8B-Instruct-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a239ad6e65c67fdaa130b29fdeacc468c23105bc902c53e043a2d0dac67a50a1
size 4843345696

3
Seed-Coder-8B-Instruct-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce79cbfc78341388844b16a7ec95fc62062f9fab4d6d84a0903decdd49044378
size 5778413344

3
Seed-Coder-8B-Instruct-Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aadee9804376b425c852ac622892bf53a3e580c76b818716a5f3b7aeca1f7b3c
size 6239655712

3
Seed-Coder-8B-Instruct-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f29cae340a32c85facf034debb94df6b5f223cdd223ba54684054cf4a0ae29e7
size 5897426720

3
Seed-Coder-8B-Instruct-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8eb47e5243e23d7251f1a1f129e6d544e1eaae00308db3a7b9c3f86ef5426be1
size 5763733280

3
Seed-Coder-8B-Instruct-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3adbc741b8b12832a0f4a56a5642d715d846ada92b641140e4177f301fa186ad
size 6775068448

3
Seed-Coder-8B-Instruct-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7985ea8fe9985fcf9c030f5270f6a3e829c8c86d09a690731560845b971f86fb
size 8773162784