mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-11 03:16:58 +08:00
commit 80cd1a3c5f
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Phi4.React.Turn.V2.Full.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Phi4.React.Turn.V2.Full.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00f96bd4902a82ffe798a2669c44e64295f17b3b5428367c8b83e2fdbb9d02e3
size 3690189280

3
Phi4.React.Turn.V2.Full.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16bb886f52221c74b1db7b3b438a2b5758adc4b2173bd65ab8ce414712da6164
size 3412173280

3
Phi4.React.Turn.V2.Full.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b00537e86eaa999f773eb5a18d1d438585383367c09de861a4e11b80fc0e67e
size 5173924320

3
Phi4.React.Turn.V2.Full.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3671db2279b0e14680f304482c8cad4e27fa0afb75b1d00eec2807222e19c9cb
size 4803236320

3
Phi4.React.Turn.V2.Full.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffbdf09727196c3f230ee652d839689cdf5447ba18129fbafbf399d69dd60bc3
size 4557005280

3
Phi4.React.Turn.V2.Full.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2c0336f04ced624e70617aae36c41ef856fe807b2645fc180382d3dd499c92b
size 4153549280

3
Phi4.React.Turn.V2.Full.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a42543d3f6c18263af9f424243f4a1c6c238c9fe7902328e76c4f5e1b2654725
size 6739763680

3
Phi4.React.Turn.V2.Full.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cee6b688f655ba9c22c3feb7a65655ef68a5cca9813e78f3f83e6b6c0952fcc6
size 6539571680

3
Phi4.React.Turn.V2.Full.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dee5ed13b69a5d0f2cb4314c8350dd0d6a34081dba61a1b5caa7050a1c9e4a2f
size 6220083680

3
Phi4.React.Turn.V2.Full.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8da498172e5a3c209030b17f6b9c2494e447e37ffb89b688c3b88037d28791a
size 5811876320

3
Phi4.React.Turn.V2.Full.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:903715efd3aead4800483f3010c8b877b4be60594f1cdcd485acf073f4e29e36
size 8416195040

3
Phi4.React.Turn.V2.Full.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ad4689b959bba340a161f37050d79dba09505676a35925f53318d452bbda11c
size 7982346720

3
Phi4.React.Turn.V2.Full.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:506983bd7b2032b1f16f2f18ec6feb32eddba8a2279b28a79abdaae186d391ac
size 5608796640

3
Phi4.React.Turn.V2.Full.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:190a6d9a590899232a4c93faede7b160ab3fe310a59e5c68e1ec1498d5edcf5c
size 5237084640

3
Phi4.React.Turn.V2.Full.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70f541ee50982a7ba10fcdfcd3a91aef04d420e82d3b3db0ef3572078e27dd87
size 7788851680

3
Phi4.React.Turn.V2.Full.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fe1be4061c192528da50bb0fc3a19ed5e0f18c7a997c46782a579cba33d6b04
size 7190835680

3
Phi4.React.Turn.V2.Full.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f990262f9d0d42127f8cfbeb2cfb4e4458ed53d0d3386fe052e3b1aa5942b36d
size 6504755680

3
Phi4.React.Turn.V2.Full.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4a493ef35166588be506b743172ecbabaf471520ee2e9f6269f11af1a706a4d
size 8412099040

3
Phi4.React.Turn.V2.Full.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a7b292ea51875eea40a5699dcaf1a497bf60e3b3c57de1198dadad6f6d16c1e
size 9267507680

3
Phi4.React.Turn.V2.Full.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64126e0f48298248f07007a8d5145b6c19255d87cb0533dcc9afb71563d90475
size 8890307040

3
Phi4.React.Turn.V2.Full.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:391c2af93c8ec4630c607fd41e25cd6e9a06c3156556eac74de9b5bbeeab95ba
size 8444047840

3
Phi4.React.Turn.V2.Full.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7399e1d371b77eeaddb4ce71e3650965eba81dd71e19163d555777287ec1986f
size 10412708320

3
Phi4.React.Turn.V2.Full.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c79b02532f45cddad4893720ed4bee625ab76ba458178ff80bb8307d9fc6770
size 10151588320

3
Phi4.React.Turn.V2.Full.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:391580b4e8ba1c25626fd1d7f4151c3b7738a5ed45fa3dca717936f3ca13591c
size 12030259680

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Quazim0t0/Phi4.React.Turn.V2.Full
datasets:
- cfahlgren1/react-code-instructions
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- gguf
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Quazim0t0/Phi4.React.Turn.V2.Full
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ1_S.gguf) | i1-IQ1_S | 3.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ1_M.gguf) | i1-IQ1_M | 3.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ2_S.gguf) | i1-IQ2_S | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ2_M.gguf) | i1-IQ2_M | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q2_K.gguf) | i1-Q2_K | 5.7 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.3 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ3_S.gguf) | i1-IQ3_S | 6.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ3_M.gguf) | i1-IQ3_M | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.1 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q4_0.gguf) | i1-Q4_0 | 8.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q4_1.gguf) | i1-Q4_1 | 9.4 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.3 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.5 | |
| [GGUF](https://huggingface.co/mradermacher/Phi4.React.Turn.V2.Full-i1-GGUF/resolve/main/Phi4.React.Turn.V2.Full.i1-Q6_K.gguf) | i1-Q6_K | 12.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:077d2b899947b5be16c71974e853b39bb13c95b1e321c1e6787ee35192373506
size 7791685