mradermacher/Liph.42-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Liph.42-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-15 05:14:17 +08:00
commit a3559e82d5
25 changed files with 206 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Liph.42.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Liph.42.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:666630176f36231a6639145c56c7256794421a3e0cb93dc67a64e7f8624fbb7a
size 731864608

3
Liph.42.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0bd5be410b1f4a3a570d2b35be2e8906ebf443840d72ff48037c5665f619e46e
size 685170208

3
Liph.42.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7bda8989f3ed4b02fb70224c2dd8a24aa60e28222d2708790a9b5b02cf87b3cf
size 1015512608

3
Liph.42.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5ee3b949e9d7fd68b003e4647053920ceb3eb51987e7950099f5e08e9b726463
size 953253408

3
Liph.42.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:faf81463d99c998b9787ca212b4f95618d21aefdf8776b503ce64735505a2455
size 878501408

3
Liph.42.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ad7dc15b569a65e576269342d6af528a62544ca63859f06ba7abd374006dc16
size 809688608

3
Liph.42.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf9b87af0fcafe1ae55cc078f0634fec6732b26887c27db4b862e4fb3ef4ab5b
size 1320459808

3
Liph.42.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a195926f93b2924a08acee9192e491777210f84760ca431c1a2b5f1fd4d8c4b
size 1250827808

3
Liph.42.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b4315a4f68a24b0090a30ed05f263353f276b4a4706374f3fa1a2217042f72a
size 1201675808

3
Liph.42.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a327b04ba89857c3c66d7d426db092e2535764d92bf07c542d725cd7b12ef3a
size 1099071008

3
Liph.42.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce074fb3f9bd873dc67db492eddcbd82c71c0aff047d2e074b9b5007bbb7066d
size 1519730208

3
Liph.42.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61f705e661f612c52ab576c059d658aa448cd6d211dc3805d1b235fe2a3dca36
size 1109720608

3
Liph.42.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:602e33002ae4e93d4f14acd98341d706e178c9b5559168b66d8b203f28952be5
size 1006501408

3
Liph.42.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:147308857ea0da6575eff181deb68bb2a4e11bcc5cc7c52584bec9de6fca82cd
size 1575231008

3
Liph.42.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ffb224638dd7c4052b2f012f905323f9dd624a7e1c4df026e8298cd28217de9
size 1426136608

3
Liph.42.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d4f8acaab8b0b66509e542354ea6fd185070fa607a84239cbfb82ea6092ee11
size 1250827808

3
Liph.42.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85feff9d6a6beb6972501bd81b9248690b5c93ec18bcee807cda97e8670b2040
size 1609023008

3
Liph.42.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0378109726978c32d00c0e89333920a406214a82de3c0406fadb8073750ba6c3
size 1737637408

3
Liph.42.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d4e4ee01f53195ba3c20cd1b75b83068252ef207ca607eb25f6f1bc82444679
size 1618853408

3
Liph.42.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e83a9ce40dffbee8924e76efd574d413d328266f585a4fa6d16443c0254ece74
size 2003058208

3
Liph.42.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2472980e5618fcae136441c5ecdf5ca0b8e6dd27e92922cd685c4fec22b0e1a3
size 1933426208

3
Liph.42.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad1e1933b38bc9a672225efc66707e8f3836463d58dbe60cc3859250af341c44
size 2285067808

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: liminerity/Liph.42
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- phi
- phi2
- transformers
- text-generation-inference
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/liminerity/Liph.42
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Liph.42-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Liph.42-i1-GGUF/resolve/main/Liph.42.i1-Q6_K.gguf) | i1-Q6_K | 2.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e370829e99b0c05d98c3e21f72502df2cb81d573d1f13bfa78657ebfb4d74f80
size 2955463