sayhan/phi-2-super-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: sayhan/phi-2-super-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-17 22:13:10 +08:00
commit 8a3627b073
15 changed files with 151 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
phi-2-super.fp16.gguf filter=lfs diff=lfs merge=lfs -text

64
README.md Normal file
View File

@@ -0,0 +1,64 @@
---
license: mit
license_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE
language:
- en
widget:
- text: Hello who are you?
example_title: Identity
- text: What can you do?
example_title: Capabilities
- text: Create a fastapi endpoint to retrieve the weather given a zip code.
example_title: Coding
tags:
- convAI
- conversational
pipeline_tag: text-generation
inference: false
---
<!-- description start -->
# Phi-2 Super (SFT + cDPO)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62ceeb27e7f6014c0e9d9268/5-LQCMrXi8FN_ewcWL47v.png)
- **Model creator:** [Anton Bacaj](https://huggingface.co/abacaj)
- **Original model:** [Phi-2 Super](https://huggingface.co/abacaj/phi-2-super)
## Description
This repo contains GGUF format model files for [abacaj's Phi-2 Super](https://huggingface.co/abacaj/phi-2-super)
## Quantization types
Since the model is relatively very small, I recommend the larger quantizations.
| quantization method | bits |description | recommended |
|---------------------|------|-----------------------------------------------------|-------------|
| Q2_K | 2 |smallest, significant quality loss | ❌ |
| Q3_K_S | 3 |very small, high quality loss | ❌ |
| Q3_K_M | 3 | very small, high quality loss | ❌ |
| Q3_K_L | 3 |small, substantial quality loss | ❌ |
| Q4_0 | 4 | legacy; small, very high quality loss | ❌ |
| Q4_K_M | 4 | medium, balanced quality | ❌ |
| Q5_0 | 5 | legacy; medium, balanced quality | ❌ |
| Q5_K_S | 5 | large, low quality loss | ✅ |
| Q5_K_M | 5 | large, very low quality loss | ✅ |
| Q6_K | 6 | very large, extremely low quality loss | ❌ |
| Q8_0 | 8 | very large, extremely low quality loss | ❌ |
| FP16 | 16 | enormous, negligible quality loss | ❌ |
### Phi-2-super (SFT + cDPO)
Base Model: [microsoft/phi-2](https://huggingface.co/microsoft/phi-2)
### Chat template
The model uses the same chat template as found in Mistral instruct models:
```python
text = "<|endoftext|>[INST] What is your favourite condiment? [/INST]"
"Well, I'm quite partial to a good squeeze of fresh lemon juice. It adds just the right amount of zesty flavour to whatever I'm cooking up in the kitchen!<|endoftext|> "
"[INST] Do you have mayonnaise recipes? [/INST]"
```
### MT-bench / heval
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62ceeb27e7f6014c0e9d9268/lnFu3x1ufdpQVysIrX4-G.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/62ceeb27e7f6014c0e9d9268/mJfBpH8dIW7Ii2KAGI_A7.png)
<!-- description end -->

3
phi-2-super.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ea04f2f720165733bc68e5916165535e33e0742b20b9800ebe09db4b895d7b5
size 1109720160

3
phi-2-super.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb1d9c26f02ae6a7c68f9f4aa0a4b7e142d96b67d1099ca3eb00e5606c0d5016
size 1575230560

3
phi-2-super.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81d7e0ae03d9c7b3fb1c49165ab4e00d53f18ab55b0af97b04f0f27327a40326
size 1432689760

3
phi-2-super.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa655b9505a7a611a70ef77689ada5c94f97a56db3a6764fca98728c9141851d
size 1250827360

3
phi-2-super.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aae877554ec22cb6c195d17fb10f2977bc15e7ffa10da45feca6092fcd5cd987
size 1602468960

3
phi-2-super.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a691ba06743e39b90f599e3879726534505ae6112cb77790d0d74597f8f0aa9
size 1737636960

3
phi-2-super.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a1a02dd9daeadff34ddb77ad0b89857cdf23b54edb80cbc7e5597023a02de3a
size 1631960160

3
phi-2-super.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4bd216439bbc070a475c9fcc7e863e4c12f289d062b42bbdc1df79cf76739d0
size 1933425760

3
phi-2-super.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac6cc5d70a64868cf0bd2b720d0c20489da5bf2115905a9956d544e9f2e62a19
size 2003057760

3
phi-2-super.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f524f0fcba30a8c4b3c12887ca7d7303043ddbdec4e43d0fb6cc0b24a985aa2c
size 1933425760

3
phi-2-super.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ad453685505306cecb151fc673c67727733952f44de3451138ed799934cf834
size 2285067360

3
phi-2-super.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8afb1ec7140a9b38684cc0c4509cffe275977489405f36c74a656f607d09b030
size 2958040160

3
phi-2-super.fp16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b45094caadfd1447eb9e4cd0c54d5178b332e1d66872ec39fcdb0d293d4d866d
size 5563096128