prithivMLmods/II-Search-CIR-4B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: prithivMLmods/II-Search-CIR-4B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-10 23:20:12 +08:00
commit 95b8a89bcb
17 changed files with 132 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

3
II-Search-CIR-4B-GGUF.BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a820db5a189a9ae2fb88f0ffb31d92f983e91daedcc20ddfef4e4120ba76e32
size 8051280768

3
II-Search-CIR-4B-GGUF.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f98dd00732d085854dd1cdbadde1cf22eef6df8bc944cdfe83657643efcafe1
size 8051280768

3
II-Search-CIR-4B-GGUF.F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6821dedcc2e8c6097eeca7c68c95e3f592731a219e1cecdf46d7fbdbd06940a9
size 16095824768

3
II-Search-CIR-4B-GGUF.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f5271b0be7ccaa310061d2b9cddccc529b3d128c60aa531c8adffc0dec3f28a
size 1669495168

3
II-Search-CIR-4B-GGUF.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61bc6a104160d9847315e125bad3b992c6bb2b5069e45b12161968d0d9a58462
size 2239781248

3
II-Search-CIR-4B-GGUF.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a98753f7196bef11d6e515cb1461650c79365425d137498538b41a2f810ff5b
size 2075613568

3
II-Search-CIR-4B-GGUF.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee03f2e81c809846ddafe36a305701427549c877333e77dd035a9bb167e1b721
size 1886992768

3
II-Search-CIR-4B-GGUF.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ee1b133b12e4635dd336dd8a8de416b8182f0e836d277db79dc3dd81d6eaa53
size 2497276288

3
II-Search-CIR-4B-GGUF.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31c06135ba73bfef8331574fb332fb66012b229215fa88e45fc6b5c36f2f74d0
size 2383305088

3
II-Search-CIR-4B-GGUF.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c15943763957202d70607685a32f6bbe9034e9718c61758a3d45bc824bf06a3
size 2889509248

3
II-Search-CIR-4B-GGUF.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:876bc1c7813853c64dfda8204d2ac48263fcc7c13419e5cb150bc3f77a1d89f4
size 2823707008

3
II-Search-CIR-4B-GGUF.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f01ed038ce8c5929086f935f2aeff21d95e46139b1decf73f999ec71a316b26e
size 3306256768

3
II-Search-CIR-4B-GGUF.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a403585e7a0a202651bcebb6133ee73926fbd14e4150f02c6c5ef3d0b42a280
size 4280400768

42
README.md Normal file
View File

@@ -0,0 +1,42 @@
---
license: apache-2.0
base_model:
- Intelligent-Internet/II-Search-CIR-4B
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- text-generation-inference
---
# **II-Search-CIR-4B-GGUF**
> II-Search-CIR-4B is a 4-billion-parameter language model built on Qwen3-4B and enhanced with Code-Integrated Reasoning (CIR), enabling it not only to call external tools (such as web search and web visit) through code blocks during inference, but also to programmatically process, filter, and reason over results within those code blocks; optimized through supervised fine-tuning and reinforcement learning on challenging reasoning datasets, the model achieves state-of-the-art or leading results on major factual QA and information-seeking benchmarks (like OpenAI/SimpleQA, Google/Frames, and Seal_0), and it can be efficiently deployed using vLLM or SGLang with up to 128k-token contexts (with YaRN RoPE scaling), supporting advanced research, educational, and web-integrated applications, with datasets, code samples, and evaluation results provided in the official Hugging Face repository.
# Model Files
| File Name | Size | Quant Type |
|-----------|------|------------|
| II-Search-4B-GGUF.BF16.gguf | 8.05 GB | BF16 |
| II-Search-4B-GGUF.F16.gguf | 8.05 GB | F16 |
| II-Search-4B-GGUF.F32.gguf | 16.1 GB | F32 |
| II-Search-4B-GGUF.Q2_K.gguf | 1.67 GB | Q2_K |
| II-Search-4B-GGUF.Q3_K_L.gguf | 2.24 GB | Q3_K_L |
| II-Search-4B-GGUF.Q3_K_M.gguf | 2.08 GB | Q3_K_M |
| II-Search-4B-GGUF.Q3_K_S.gguf | 1.89 GB | Q3_K_S |
| II-Search-4B-GGUF.Q4_K_M.gguf | 2.5 GB | Q4_K_M |
| II-Search-4B-GGUF.Q4_K_S.gguf | 2.38 GB | Q4_K_S |
| II-Search-4B-GGUF.Q5_K_M.gguf | 2.89 GB | Q5_K_M |
| II-Search-4B-GGUF.Q5_K_S.gguf | 2.82 GB | Q5_K_S |
| II-Search-4B-GGUF.Q6_K.gguf | 3.31 GB | Q6_K |
| II-Search-4B-GGUF.Q8_0.gguf | 4.28 GB | Q8_0 |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

3
config.json Normal file
View File

@@ -0,0 +1,3 @@
{
"model_type": "qwen3"
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}