ZeroWw/Phi3Unlocked-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: ZeroWw/Phi3Unlocked-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 18:39:17 +08:00
commit 5cb819b7f3
8 changed files with 76 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

41
.gitattributes vendored Normal file
View File

@@ -0,0 +1,41 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Phi3Unlocked.f16.gguf filter=lfs diff=lfs merge=lfs -text
Phi3Unlocked.q5_k.gguf filter=lfs diff=lfs merge=lfs -text
Phi3Unlocked.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
Phi3Unlocked.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Phi3Unlocked.q8_p.gguf filter=lfs diff=lfs merge=lfs -text
Phi3Unlocked.q8q4.gguf filter=lfs diff=lfs merge=lfs -text

3
Phi3Unlocked.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51e0d38e597b5af3a3ae3f21928509cdbc11ecd088d02113d13d07468bb3911e
size 7643296320

3
Phi3Unlocked.q5_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9c0ecfe10dc569d2df3cb796bdce3454bd8e8ea6fd8f9a63398d1db2b02ab78
size 3060757056

3
Phi3Unlocked.q6_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a55c95c7d155efedbb03dade1fe5bd7972825cfe77317c55035c12dcad4a45f3
size 3368251968

3
Phi3Unlocked.q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:648324136e551711f7486b522a9968f636702c58a4e65715a28b76dd1fce8568
size 4245910080

3
Phi3Unlocked.q8_p.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f34bb5c798502e7f80faeb328d941cb0233cf1d106fe840aafc6200ff27a54e4
size 4061221440

3
Phi3Unlocked.q8q4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3c433a0914107e008f34e45d81419f95567ce12ecef5df39ef50ad5e7e238b7
size 2466337344

17
README.md Normal file
View File

@@ -0,0 +1,17 @@
---
license: mit
language:
- en
pipeline_tag: text-generation
---
My own (ZeroWw) quantizations.
output and embed tensors quantized to f16.
all other tensors quantized to q5_k or q6_k.
Result:
both f16.q6 and f16.q5 are smaller than q8_0 standard quantization
and they perform as well as the pure f16.
Updated on: Fri Oct 25, 14:14:40