mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-14 06:08:16 +08:00
commit b874c92978
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dse-qwen2-2b-mrl-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: MrLight/dse-qwen2-2b-mrl-v1
datasets:
- Tevatron/docmatix-ir
- HuggingFaceM4/Docmatix
- Tevatron/msmarco-passage-aug
- vidore/colpali_train_set
- Tevatron/wiki-ss-nq
language:
- en
- fr
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- vidore
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/MrLight/dse-qwen2-2b-mrl-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#dse-qwen2-2b-mrl-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/dse-qwen2-2b-mrl-v1-i1-GGUF/resolve/main/dse-qwen2-2b-mrl-v1.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
dse-qwen2-2b-mrl-v1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26fc39ecb04a5fc57449090726fa6923c4d3d4af511a0878028d944453c5656e
size 541037312

3
dse-qwen2-2b-mrl-v1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd7a9ba20e7ddb5bc4a6b1aa2f58a4147a0b53cfeb1c78437264b2d11f21ada8
size 513103616

3
dse-qwen2-2b-mrl-v1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31de4b0eebed3620032e90ae96172c0f92633cfbe25df0c3b3f51c5ed84d0131
size 701332736

3
dse-qwen2-2b-mrl-v1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3df3759602ffeafe859903b0d1008f99860b6310b1cd3a1f5b162c8fe973bca2
size 664087808

3
dse-qwen2-2b-mrl-v1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e530582aeff955f7bb052064be5c362ffe7b86e050b3790c5381a2a3c4f51ba7
size 626902784

3
dse-qwen2-2b-mrl-v1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00767663bff940faf4b80d427a92932bc369b6cc4bb1b1f242eb583dd0af55e1
size 587593472

3
dse-qwen2-2b-mrl-v1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ed8b07a2b3bb64aacc509759cae604e12e257b0069ab187f32ccb2cde0512af
size 876942080

3
dse-qwen2-2b-mrl-v1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdbf955edea31cc056add74e81df858d62e604cd83e6f75680afc2c07c087578
size 862684928

3
dse-qwen2-2b-mrl-v1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd8b75616ae120c0a64f2eaa36c87502029981923969f294d1a065b49bf126bc
size 831977216

3
dse-qwen2-2b-mrl-v1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bc64fb086642798d5be10f52c97d96a6d4927aff95f8bdd50b07de80ff760a50
size 769070336

3
dse-qwen2-2b-mrl-v1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f75b3f2d4c9256bb011d987549fb1b3edbb2cef72dc0062d5f8affcf0eb69456
size 1067604224

3
dse-qwen2-2b-mrl-v1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26df98cbc7cddc0725888d7cf006e423d9d8e93cc06c39d620ba2684e9f0f0d9
size 1019711744

3
dse-qwen2-2b-mrl-v1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6903bf8eeb40525e5f9196813cfc9579b3e44aaa021d7283e236d0c0f93ba5fd
size 752880896

3
dse-qwen2-2b-mrl-v1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1544e92521a204424a4650963dd9e1dd4cdd9480dfb6895efdb6ed171ee57051
size 716711168

3
dse-qwen2-2b-mrl-v1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4f7c6e62a0675f533b2bc4ba61751f7cb3163d58c814734f91728e1f77285f7
size 980440832

3
dse-qwen2-2b-mrl-v1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3c5689514650b4f7960123ea77d36db05b520fb6c636a4182e7a87ba7dcaa69
size 924456704

3
dse-qwen2-2b-mrl-v1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d355c775cea6014be4b2f3c89ca9a2596f4a23e5a9a6d22218d2f79740afd615
size 861222656

3
dse-qwen2-2b-mrl-v1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b151d513b7552113f387b48dba80974c217b10c808f8d778002364a63e57f428
size 1068808448

3
dse-qwen2-2b-mrl-v1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8ab8c28cbadfdb1da3ae33a8214157408bc65cb9eee99264839cbb79ea8091d
size 1162701056

3
dse-qwen2-2b-mrl-v1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ff50c5e5b11b15d1e379a74dc1a75c2b73152126e4752d1dbe9bdbd79b5173e
size 1117321472

3
dse-qwen2-2b-mrl-v1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69ebe6c7c028d551ef87cc80dcd084aff48f6b34da62aa5c95c961e0ec169176
size 1071585536

3
dse-qwen2-2b-mrl-v1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39552023d45c74a091565b0570c7c17552affc4d5759e08f473fcceb815f945b
size 1285495040

3
dse-qwen2-2b-mrl-v1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8bb162601cfb0ccb624220abd264e05313e5f44c23a1a163750949ba4f90a80
size 1259174144

3
dse-qwen2-2b-mrl-v1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2e04f83aa8af3ed5a2e614d64e52fd511d5b10ec59679e3af1bc1bf9bf4e4ab
size 1464179456

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a637e4efb05fa630e33cbaa7026777d76f3891afa2e60454ea770a02042bc31
size 2042201