初始化项目,由ModelHub XC社区提供模型

Model: prithivMLmods/MegaScience-Qwen-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-20 07:50:13 +08:00
commit ce2e825ea3
61 changed files with 353 additions and 0 deletions

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5643c98d9460af7aabdb7a4838d088ae4afcd4bd22531bbbf6b0454b91dbd2f8
size 3093668768

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3a2692eacb617b6a727e6d514b11f849d4208b5526053e7f054122aacd4bd51
size 3093668768

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cbe692f210fb8cc9ad9022c936ecf95d20d52cd427bc7eb276b1894a70a0d422
size 6180807584

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b186a7d87173a3b83b685b485506443bff4ce742fd13fff6771c9acb90b5115d
size 676304288

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4ed5d8aac22a0b4744d0728828ec53fd03a9be2c776a4772912aada3aad2f1a
size 880162208

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3deeda7278a2117314b3fca182cf0fd614d6971ecfd7753c6ec9c6d765799d6f
size 824178080

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19cd511bc3e213b98707f6d2c140fafaf99c7db25ebd2b2a4d04975eb8ef81aa
size 760944032

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95afdc911d8878720c30d77d27ccd5c475e2d02f73a9edc578eedcc8cd58adc7
size 986047904

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:145e07ea8fce15cf3ebd957adb77d3e6517fbfdf30739cd23926dc057b1a139d
size 940311968

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da82289d5a2c666f6dc16154e6355faa04120d92679175ffbfb97049124f39dd
size 1125049760

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a3783e403c962b134fdc7710402aebe8b392a67e12fd7bb0317bfdcb6e31945
size 1098728864

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:031d098d4e45d8af416535ad2c59344ef56e75277d3e13db3b1b39b11ee8bfc3
size 1272739232

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9008542ae1d93ac8a359b185e1a427e983acca6856570cd1c11feeb144b7260f
size 1646572448

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:232a7bb5cdf49b03313bbb7298042d3a870f42f8cd11882193cc369634d779f6
size 6178316576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2953e2d543f51564c7e1099f4a7ebee42d621fa2b825f094489da1b4244dbe6
size 6178316576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a49df7605f0be6b8a9cac2181571fce0e75159ae1566dafa4d87a6f7a69e9e97
size 12349710624

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc21b08e201f8c654ba44a0f3a7284d14d38846f43c6d0506d401a3068c5246d
size 1274755360

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2acdcef13751ab186ceabc8215bb261000e632624d8cd5a42d7e76d80b804465
size 1707391264

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9abf3b488483132d84ed0c06913d7fd67afbb6220127212af2f98ebe258613d3
size 1590475040

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec8da660cb5b7c869c0d42472044e5be1c3e527939f72cff1238574fc879802f
size 1454356768

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bab7651f33278f7d4ae1b9cd8bfb740c0a9a13b71aeef932b665d0b54914fa85
size 1929902368

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9eeb2fa74924efc4c94b85716d558c0d296fe4c28004405c0720bd4adb481bcd
size 1834383648

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10de65da113deb14e0a48ec7a52c683b98b03d60a355a697c34fb971ca6b7469
size 2224814368

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a57531650acdc7fa1fee8cc280c4bbd5e8d679ce3452093c2b256f60da77ba91
size 2169665824

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee9f60e6fa284b78a1859969a25b76d2f62da0e167f1909cc6de88ea5c311542
size 2538158368

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0318337b968ca2a493fbbd12d98e27393342367ff71c4fcc70c04d8cd415594c
size 3285475616

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b7e4ff28153424d9ff3a4c6485b7d0f0d3a80693c487eb895fa2f84cfabcbd8
size 15237853024

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f19fb52521b1c28eabeb9e69d83293732f1fa7070830f4b467eeb88a52645a1b
size 15237853024

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50cec5d3cbc23778225c30c5d1653f86999cdfde2aca0314019114f6cd509feb
size 30468419424

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f161cea4699ddd67f4993c6a9472a91e1f3b5ade4de3404015e9e10d031a1869
size 3447348896

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f9047a03feecd276febe40fdf4025f4fd31f06a49f4095c8aa09a60f8e5c107
size 3447348896

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eee500970d8bba0356f617eff3a0455f2b24a05e272be53c636f3e6d9fa04d92
size 6888251040

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c9d69cd71b16038f895555b3f06ad24c6fd5189c921d3f4b97944efb8840cf2
size 777795232

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23d835ae7e77e008a1e35355e73a67e81b169e6dddf014c94e52e60c92b7438a
size 1003501216

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:baa240f750994b2ccada0c94108f53b15e5f9eaa45c9458c027744b17826f31d
size 939538080

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ac4546d5730af574ff5f6bc8254b42f6c9338d9be3d0e5ec1e3fa1346c8a4fe
size 867251872

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c7edef072c3580099f9aded6809caf3162332d0812bdaecdc2d4e8ef3b700db
size 1107408544

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab2f9b6fa75f10c66bdce1268e003ad3a6817052b213aed98cff04e055aaf175
size 1060189856

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f53aed6546237e93d2867ac5c41be1fb48b340c3341c590b9a2b5818ebd6e73
size 1257879200

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5abe5ac390a6d9e1a64ba03847ddf2d55b41506ff0c873fcfa9339516d8d0b94
size 1230583456

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9a142df51a5088631e3af1c0557435cd369b61bd642e68037c071d6ab853ded
size 1417754272

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3602d835cd5783aa4f045d8b2dd5cb258b4c4d88c16bc9177544f7f1b5b92bb
size 1834426016

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d3591d288daa57d3ed59d0c38b5b1121de7ffdb0a1275fe1aec093bf09c82089
size 8051284736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4215979728d9d7ebf8a347a51cc09ab3d4ea8b6b6ff875c35b5a8c3ce00a964
size 8051284736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae8f0b7dd4361f37720e77ade435065bc57b3e7abc77dd8d01935996e346fda2
size 16095828736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ddb86015eb5287b2b46c8dbe31370b5fc3433221361c63157567fe3fe93b0234
size 1669499136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:797c32d07451f00ad6549f36584b9f295eef7b4032654b677c8e443db7447a3d
size 2239785216

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e223d1c57bf5260b494df10a72955cb63d645a6fc0c3d4426ddea0571f3d066
size 2075617536

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5102d6f99038ba4da455cf38ef727b2cfa523d9c2baee878af96b1b05227a344
size 1886996736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef8331d7d62150927fd063e7d987cc4e8f6c5fb124bb3012c6ec129e4819e589
size 2497280256

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01470f251327023c94c4ebcb4ba85db74454ec035a2cb0c7c7dcfaa6a2e58ae0
size 2383309056

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8aa68f0b2ac580bbd46ae6a9fca88b083480c0668bb94ebd1eb9764201f70c18
size 2889513216

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c8079a6cc8d5f30f1e5afb89e1aff9817bf2879e5dd6833994086079af748baa
size 2823710976

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7b57bd4b444f1987690f534405d28d340c08a232e5b558eb5783fafa90b8517
size 3306260736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dccb97b384a795035069f2734273b79ace516d092f45331d76899f968c28484b
size 4280404736

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c12617e35de05badd20cfcd70d63036167544c286c512ada5015d886f767d92
size 16388043584

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f32983a5691631aa375ed193865c3272ce72d2fec5a5aa6d04146e4d1b272d10
size 16388043584

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d34d0eb728b0c3b81dc00402f9fbb80506faa4c1272bc692b51f28a331f6df20
size 8709518144

131
README.md Normal file
View File

@@ -0,0 +1,131 @@
---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- text-generation-inference
base_model:
- MegaScience/Qwen3-4B-MegaScience
- MegaScience/Qwen3-1.7B-MegaScience
- MegaScience/Qwen2.5-3B-MegaScience
- MegaScience/Qwen2.5-1.5B-MegaScience
datasets:
- MegaScience/MegaScience
---
# **MegaScience-Qwen-GGUF**
> MegaScience-Qwen models are a series of large language models based on the Qwen3 and Qwen2.5 architectures, meticulously fine-tuned on the MegaScience dataset to advance scientific reasoning in AI. This dataset blends over 1.25 million high-quality, university-level scientific questions and answers sourced from open textbooks and diverse scientific benchmarks, covering seven scientific disciplines. The MegaScience-Qwen lineup includes variants from smaller Qwen2.5-1.5B up to Qwen3-30B, with models such as Qwen3-4B-MegaScience, Qwen3-8B-MegaScience, and Qwen3-14B-MegaScience, each showing pronounced gains over their official instruction-tuned counterparts—especially as model scale increases. These models demonstrate state-of-the-art or leading performance on scientific reasoning, general knowledge, and mathematical benchmarks, achieving not only higher accuracy but also more concise and efficient responses. The MegaScience project also provides a rigorous evaluation system, an open-source curation pipeline, and all model checkpoints, empowering further research and application in scientific AI reasoning and education.
## MegaScience Qwen Models (GGUF Format)
| Model Name | GGUF Repository Link |
|--------------------------------|----------------------------------------------------------------------------------------|
| Qwen3-8B-MegaScience-GGUF | [Hugging Face ↗](https://huggingface.co/prithivMLmods/MegaScience-Qwen-GGUF/tree/main/Qwen3-8B-MegaScience-GGUF)|
| Qwen3-4B-MegaScience-GGUF | [Hugging Face ↗](https://huggingface.co/prithivMLmods/MegaScience-Qwen-GGUF/tree/main/Qwen3-4B-MegaScience) |
| Qwen3-1.7B-MegaScience-GGUF | [Hugging Face ↗](https://huggingface.co/prithivMLmods/MegaScience-Qwen-GGUF/tree/main/Qwen3-1.7B-MegaScience) |
| Qwen2.5-3B-MegaScience-GGUF | [Hugging Face ↗](https://huggingface.co/prithivMLmods/MegaScience-Qwen-GGUF/tree/main/Qwen2.5-3B-MegaScience) |
| Qwen2.5-1.5B-MegaScience-GGUF | [Hugging Face ↗](https://huggingface.co/prithivMLmods/MegaScience-Qwen-GGUF/tree/main/Qwen2.5-1.5B-MegaScience) |
| Qwen2.5-7B-MegaScience-GGUF | [Hugging Face ↗](https://huggingface.co/prithivMLmods/MegaScience-Qwen-GGUF/tree/main/Qwen2.5-7B-MegaScience-GGUF) |
# **Model Files**
## Qwen3-8B-MegaScience
| File Name | Quant Type | File Size |
| - | - | - |
| Qwen3-8B-MegaScience.BF16.gguf | BF16 | 16.4 GB |
| Qwen3-8B-MegaScience.F16.gguf | F16 | 16.4 GB |
| Qwen3-8B-MegaScience.Q8_0.gguf | Q8_0 | 8.71 GB |
## Qwen3-4B-MegaScience
| File Name | Size | Quant Type |
|-----------|------|------------|
| Qwen3-4B-MegaScience.BF16.gguf | 8.05 GB | BF16 |
| Qwen3-4B-MegaScience.F16.gguf | 8.05 GB | F16 |
| Qwen3-4B-MegaScience.F32.gguf | 16.1 GB | F32 |
| Qwen3-4B-MegaScience.Q2_K.gguf | 1.67 GB | Q2_K |
| Qwen3-4B-MegaScience.Q3_K_L.gguf | 2.24 GB | Q3_K_L |
| Qwen3-4B-MegaScience.Q3_K_M.gguf | 2.08 GB | Q3_K_M |
| Qwen3-4B-MegaScience.Q3_K_S.gguf | 1.89 GB | Q3_K_S |
| Qwen3-4B-MegaScience.Q4_K_M.gguf | 2.5 GB | Q4_K_M |
| Qwen3-4B-MegaScience.Q4_K_S.gguf | 2.38 GB | Q4_K_S |
| Qwen3-4B-MegaScience.Q5_K_M.gguf | 2.89 GB | Q5_K_M |
| Qwen3-4B-MegaScience.Q5_K_S.gguf | 2.82 GB | Q5_K_S |
| Qwen3-4B-MegaScience.Q6_K.gguf | 3.31 GB | Q6_K |
| Qwen3-4B-MegaScience.Q8_0.gguf | 4.28 GB | Q8_0 |
## Qwen3-1.7B-MegaScience
| File Name | Size | Quant Type |
|-----------|------|------------|
| Qwen3-1.7B-MegaScience.BF16.gguf | 3.45 GB | BF16 |
| Qwen3-1.7B-MegaScience.F16.gguf | 3.45 GB | F16 |
| Qwen3-1.7B-MegaScience.F32.gguf | 6.89 GB | F32 |
| Qwen3-1.7B-MegaScience.Q2_K.gguf | 778 MB | Q2_K |
| Qwen3-1.7B-MegaScience.Q3_K_L.gguf | 1 GB | Q3_K_L |
| Qwen3-1.7B-MegaScience.Q3_K_M.gguf | 940 MB | Q3_K_M |
| Qwen3-1.7B-MegaScience.Q3_K_S.gguf | 867 MB | Q3_K_S |
| Qwen3-1.7B-MegaScience.Q4_K_M.gguf | 1.11 GB | Q4_K_M |
| Qwen3-1.7B-MegaScience.Q4_K_S.gguf | 1.06 GB | Q4_K_S |
| Qwen3-1.7B-MegaScience.Q5_K_M.gguf | 1.26 GB | Q5_K_M |
| Qwen3-1.7B-MegaScience.Q5_K_S.gguf | 1.23 GB | Q5_K_S |
| Qwen3-1.7B-MegaScience.Q6_K.gguf | 1.42 GB | Q6_K |
| Qwen3-1.7B-MegaScience.Q8_0.gguf | 1.83 GB | Q8_0 |
## Qwen2.5-3B-MegaScience
| File Name | Size | Quant Type |
|-----------|------|------------|
| Qwen2.5-3B-MegaScience.BF16.gguf | 6.18 GB | BF16 |
| Qwen2.5-3B-MegaScience.F16.gguf | 6.18 GB | F16 |
| Qwen2.5-3B-MegaScience.F32.gguf | 12.3 GB | F32 |
| Qwen2.5-3B-MegaScience.Q2_K.gguf | 1.27 GB | Q2_K |
| Qwen2.5-3B-MegaScience.Q3_K_L.gguf | 1.71 GB | Q3_K_L |
| Qwen2.5-3B-MegaScience.Q3_K_M.gguf | 1.59 GB | Q3_K_M |
| Qwen2.5-3B-MegaScience.Q3_K_S.gguf | 1.45 GB | Q3_K_S |
| Qwen2.5-3B-MegaScience.Q4_K_M.gguf | 1.93 GB | Q4_K_M |
| Qwen2.5-3B-MegaScience.Q4_K_S.gguf | 1.83 GB | Q4_K_S |
| Qwen2.5-3B-MegaScience.Q5_K_M.gguf | 2.22 GB | Q5_K_M |
| Qwen2.5-3B-MegaScience.Q5_K_S.gguf | 2.17 GB | Q5_K_S |
| Qwen2.5-3B-MegaScience.Q6_K.gguf | 2.54 GB | Q6_K |
| Qwen2.5-3B-MegaScience.Q8_0.gguf | 3.29 GB | Q8_0 |
## Qwen2.5-1.5B-MegaScience
| File Name | Size | Quant Type |
|-----------|------|------------|
| Qwen2.5-1.5B-MegaScience.BF16.gguf | 3.09 GB | BF16 |
| Qwen2.5-1.5B-MegaScience.F16.gguf | 3.09 GB | F16 |
| Qwen2.5-1.5B-MegaScience.F32.gguf | 6.18 GB | F32 |
| Qwen2.5-1.5B-MegaScience.Q2_K.gguf | 676 MB | Q2_K |
| Qwen2.5-1.5B-MegaScience.Q3_K_L.gguf | 880 MB | Q3_K_L |
| Qwen2.5-1.5B-MegaScience.Q3_K_M.gguf | 824 MB | Q3_K_M |
| Qwen2.5-1.5B-MegaScience.Q3_K_S.gguf | 761 MB | Q3_K_S |
| Qwen2.5-1.5B-MegaScience.Q4_K_M.gguf | 986 MB | Q4_K_M |
| Qwen2.5-1.5B-MegaScience.Q4_K_S.gguf | 940 MB | Q4_K_S |
| Qwen2.5-1.5B-MegaScience.Q5_K_M.gguf | 1.13 GB | Q5_K_M |
| Qwen2.5-1.5B-MegaScience.Q5_K_S.gguf | 1.1 GB | Q5_K_S |
| Qwen2.5-1.5B-MegaScience.Q6_K.gguf | 1.27 GB | Q6_K |
| Qwen2.5-1.5B-MegaScience.Q8_0.gguf | 1.65 GB | Q8_0 |
## Qwen2.5-7B-MegaScience
| File Name | Quant Type | File Size |
| - | - | - |
| Qwen2.5-7B-MegaScience.BF16.gguf | BF16 | 15.2 GB |
| Qwen2.5-7B-MegaScience.F16.gguf | F16 | 15.2 GB |
| Qwen2.5-7B-MegaScience.F32.gguf | F32 | 30.5 GB |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}