mradermacher/Meteor_4B_V.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Meteor_4B_V.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-06 15:10:49 +08:00
commit dbff84d52b
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Meteor_4B_V.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Meteor_4B_V.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8dee05ee2c8b1ded610edc04c56ead7e50862dceb44fad0a65830927f46326a
size 1199571904

3
Meteor_4B_V.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cdf57525e974a763a605ada37877dd95df7d895ea7ed43677e58cea11384fe8b
size 1133093824

3
Meteor_4B_V.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a56422b6cba208ee17c1ce520c58d36e40a734273f7b59371aecec293fdb6a93
size 1537983424

3
Meteor_4B_V.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a502b22b00389d08df5ac7f733ee10c861acefa1c13dd6b0951e7cdb24f2078
size 1449345984

3
Meteor_4B_V.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9980c3adf14775535f5bd2004105779f95560742ad22ec27d523398685734f82
size 1404576704

3
Meteor_4B_V.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0810700afd8bed3d9671a41d3222d0a29ff84de1c5169224719fc7e9dac9d1a6
size 1310368704

3
Meteor_4B_V.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:271b02abd29b9bc4e71737498c0e09048f415c7354ef143232be4ceeed20107b
size 1986803904

3
Meteor_4B_V.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd5d72d741e5e0c6558b306b11d6132b644d7bcb1f70af6471fad0c170fa8602
size 1937365184

3
Meteor_4B_V.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3097e8e152c493ed22a1b24e2d6a7a9105cbf957f7a4f987cc9705d96350cfc8
size 1863391424

3
Meteor_4B_V.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48f40415e53dbf5e0c189a6b970e44e59e316cdefb170c211ee1cda374f18b72
size 1689453504

3
Meteor_4B_V.1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:526e95399d15224d4f4303e5b83a6d45ce2839e80ff698d443eb794730fc0bfe
size 2363513024

3
Meteor_4B_V.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f033a89abe2dc92ffd084de512e9c82c23f17b08884b44852f976338a5665bee
size 2263242944

3
Meteor_4B_V.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2221a4c3b17c1a253fbb2753f5f62efe60568bece0a17af0c8c9a2f3e33e5093
size 1729165504

3
Meteor_4B_V.1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2186903458bef723d759ccf41d1f47aa4d199a2e457c67da963088d740eedbe2
size 1636063424

3
Meteor_4B_V.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1b0c130aabdc0ceb95cb33185f5623ca3c294410f73d3ed30ab220f7de70f57
size 2236086464

3
Meteor_4B_V.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59528596dc4f3d70f76eb6fd65847c156c0a07a56508c01289e56bacc6814fef
size 2098460864

3
Meteor_4B_V.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edd9766465bf61ab4ece4367d969257526d6235a9e78891ef86e35c605bb6fa5
size 1937365184

3
Meteor_4B_V.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:378287cf786b1ededc04e7f3ad939c925a11b777ce39683e5a6425a10d759372
size 2370066624

3
Meteor_4B_V.1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b14a5b465fcb05fbfc5133dd820aed2cdd57edf622fd135b0c2c87ffa878059f
size 2564053184

3
Meteor_4B_V.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6acd1d44f44beee6504ee9103c7b45fedfb9970e42c0fe6f3dc189c272302c8
size 2489895104

3
Meteor_4B_V.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cada1070dd89951fe2d6b15a6d17fbd99311ae913e72041d7888c77ac69fee5d
size 2377930944

3
Meteor_4B_V.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2171ca2bd7b6447a63b11b5c6492cc389cf9f5b723d11ffbae65627bb63a4af1
size 2829699264

3
Meteor_4B_V.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9128f69d7afe4c6b0fd0253777f05d80a8617fe7371e9a111607ca0dd43314fd
size 2764593344

3
Meteor_4B_V.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee327955616ebeb53e1a6697b58edd975caa1c11125852f07a623905668bb4b1
size 3190741184

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: OddTheGreat/Meteor_4B_V.1
language:
- en
- ru
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- roleplay
- creative
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/OddTheGreat/Meteor_4B_V.1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Meteor_4B_V.1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Meteor_4B_V.1-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/Meteor_4B_V.1-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Meteor_4B_V.1-i1-GGUF/resolve/main/Meteor_4B_V.1.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7473345040a013ed1509e227822886bb641335108a4c693f610a2b3a3b8eba81
size 3419855