mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-10 18:08:16 +08:00
commit 4c5d715a99
27 changed files with 214 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Virtuoso-Lite-PreDistill.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: arcee-ai/Virtuoso-Lite-PreDistill
language:
- en
library_name: transformers
license: other
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/arcee-ai/Virtuoso-Lite-PreDistill
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ1_M.gguf) | i1-IQ1_M | 2.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ2_S.gguf) | i1-IQ2_S | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ2_M.gguf) | i1-IQ2_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q2_K.gguf) | i1-Q2_K | 4.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 4.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ3_S.gguf) | i1-IQ3_S | 4.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ3_M.gguf) | i1-IQ3_M | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q3_K_M.gguf) | i1-Q3_K_M | 5.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-IQ4_NL.gguf) | i1-IQ4_NL | 6.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q4_0.gguf) | i1-Q4_0 | 6.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q4_K_S.gguf) | i1-Q4_K_S | 6.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q4_K_M.gguf) | i1-Q4_K_M | 6.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q4_1.gguf) | i1-Q4_1 | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q5_K_S.gguf) | i1-Q5_K_S | 7.2 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q5_K_M.gguf) | i1-Q5_K_M | 7.4 | |
| [GGUF](https://huggingface.co/mradermacher/Virtuoso-Lite-PreDistill-i1-GGUF/resolve/main/Virtuoso-Lite-PreDistill.i1-Q6_K.gguf) | i1-Q6_K | 8.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Virtuoso-Lite-PreDistill.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12a0820e2aeb96eef2ce388229838c5a17de34428e62bd71fc8809207f2adbef
size 2560055392

3
Virtuoso-Lite-PreDistill.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fc747ce03edd575475114f207d7ce04bd48e629fcaeb4327952dd581e99e68d
size 2357487712

3
Virtuoso-Lite-PreDistill.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3abc4e6f9216989bef2a43ff66a8f19f03d6a26f49f3a8ad154a4a9426cb0a94
size 3592345696

3
Virtuoso-Lite-PreDistill.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffecc2c1c0af1461e4e854d2e62009ad42c3edb677b544b4f0f26265e408470d
size 3322255456

3
Virtuoso-Lite-PreDistill.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a6b2a2b63c796427368a0fb3026b67e953aaee79df497aaea10a5bf0ac5fd68
size 3179554912

3
Virtuoso-Lite-PreDistill.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ba3e35536432f6510d0a9a218f49d6609e7f418aaf9c27ea474eacb6490cb06
size 2897668192

3
Virtuoso-Lite-PreDistill.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cfb3cd87f5ab80f2df7033bf723b4ad5c84ebab9bd1ca452efc6b2d8bd7a924d
size 4704987232

3
Virtuoso-Lite-PreDistill.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f56c10067d713cb7e57e8792f4b4bc55136349b16ac2961a871f7fe779826ab
size 4591138912

3
Virtuoso-Lite-PreDistill.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b90dd3908ea9e1839dab3024b9fa6082f04f2000a3cded1f85358f017c15e583
size 4368480352

3
Virtuoso-Lite-PreDistill.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45a644fc22550f87cad349468eb8b0a21c90f3893d17d79b14b75bbdcc2ef12d
size 4078581856

3
Virtuoso-Lite-PreDistill.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02b590eecfdd0c2610cce3b741d2498dc611a3be0e817e96d7e176e2ed0bd38f
size 5906348128

3
Virtuoso-Lite-PreDistill.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:266638cd5fb2296ad190a4de3ceb04bc9f9cb3bbda90c43e710223c978c41c18
size 5596887136

3
Virtuoso-Lite-PreDistill.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d86bd3da16bcc3c50849517bb12f08ad29ccfd8d5dda9e162d8808d316badb6
size 3924047968

3
Virtuoso-Lite-PreDistill.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54e0b8a749cdae1365c4b1ab87ec89fb136e48b71a319e22846a4ec98d1a38c2
size 3668334688

3
Virtuoso-Lite-PreDistill.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:372a922375156a90c722231501102cc7fbd52225e0da870fc1eec453a1c656dc
size 5450807392

3
Virtuoso-Lite-PreDistill.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab537cc696e6ae68f7996d8c1f63c836337951f21da6f4b4cba17a638d7ab0ce
size 5052479584

3
Virtuoso-Lite-PreDistill.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ecae2c745ebb33363def80f9c7b35bc14e9ffecbe4c8bc55cd0b02b904e3d38d
size 4591138912

3
Virtuoso-Lite-PreDistill.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c1dca822d4bc6acb4e9b0a0e9bbad5ca2f64fd70979eb085c69d57edb4ae7372
size 5928466528

3
Virtuoso-Lite-PreDistill.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55666ab8c77fac50947fef6ee81966460b891bece71b228a81e863cc30543a01
size 6525270112

3
Virtuoso-Lite-PreDistill.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3ed5735007b98e760442195ec8e6925b6ee6d9eee50fd2480163996e8e2ef45
size 6287521888

3
Virtuoso-Lite-PreDistill.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a15938f438c4047b09325cd69e726f468aca1749ce66973e9af257028ccd0d13
size 5952157792

3
Virtuoso-Lite-PreDistill.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eaedcaec2bb5005c325b2d228aebfc9a894a537100a40712569de357d92c18a3
size 7340554336

3
Virtuoso-Lite-PreDistill.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66b10c7378dd67162745d14568d21e29b17aeec12becc234ea3f427fec25d06c
size 7144192096

3
Virtuoso-Lite-PreDistill.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b54f9a23284a5652835d8686e2e03cd6047897c62dd20be7830c9dfd07cbd20d
size 8459401312

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce8eca0a98a3031a17a52ffead6d7e966e335b9a1fc89480ffcf3e10ccd07670
size 6644805