初始化项目，由ModelHub XC社区提供模型
Model: mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:892a868c8cbe6e83599e9e5787c1a4b121809d02b7958988265cf3e9dbb36d05
|
||||
size 327146624
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:260476ecf51bd4bd3071bdaf6dbee93e201de73f0ed6603f1e71a8a1011d5ce4
|
||||
size 304389248
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9660f944450a7e4db891b203e603ac9e842eef8dadbae18212c69001570aaec9
|
||||
size 434134144
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8794eb4b70670a6089df5db5d58f6fb2a18271666ef7bba9d97b9b55ffb9c007
|
||||
size 403790976
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:20654d403c4037b3ebe99c89214497634bcf19c334931b8323cf06a812aa8429
|
||||
size 396205184
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1e35eb2459cdf0467e389793ba3cc4bd95d0cfc288354718d5702732d51bb3e0
|
||||
size 365075584
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b1d8b09c338088c6b988188c90fed4fe2000f9f35a0c85a58752db276cb8d432
|
||||
size 566795392
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:20fc8e64e1639c05368f31ac33159652ed94f8049f3ffab3610135ece78c3daf
|
||||
size 558161024
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:69519bf85120dde8f406ef85863945fbb9ad0784ee09720032b66ba9d9c2a6a3
|
||||
size 537812096
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:73ecc149c36c1cee0a89ebd79907aa514f9a130c7c0c78875799c3993177310d
|
||||
size 490986624
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:67658344075eea6be4a5992a53090a06edbf76e663a9607d97a8f5b58b9770aa
|
||||
size 695753856
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0146c4804db380b4ea34fd1c09a57479034a3ed8f24a62c098138c5dc001fe47
|
||||
size 663379072
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0459513304f3194e675cbd4ea2cf1c9fa7b59d812695d08f111d114b9019ea70
|
||||
size 483400832
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:666381b2a9f61dd6f586b428b18eda2fe9b3955d751aff842a80bef39f033504
|
||||
size 460807296
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9935cf31824e6494836d227ff5bf6e62afd25eb868ecb85a034e8d7880b5b45a
|
||||
size 635477120
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:28ebe723020ad672e95a1b7f5f7feff675e7f1c893800fb38eda896a44b7c2f8
|
||||
size 600349824
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6b0b02ae93ef960488d0c3cf307340307c30a9749c0129959340f265014680f9
|
||||
size 558161024
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:abf26b7d644a35cee884fc3071c4e18c5686a4b2fa4e5cba36345d173dece8cd
|
||||
size 697851008
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d3020ede7c523703d08eb812161e10b68c6794248185eb5738068b6062e07a04
|
||||
size 760503424
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6871cd3894ba1497a668b0d3342f0aa9cebf2294ea220036a9a933d1e280fcde
|
||||
size 730897536
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3cace75d67db41baa597103c9fb11e87b2839a8828471f262261b9afdd5142a6
|
||||
size 700472448
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2bbfc030d0734e1532be92f91fd0fab1030f5b1bc5bb2769a4b33d205d3ab4b4
|
||||
size 843357312
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a14300f87c2966a2418ea2b1e9c994d16a461745f7a73ed4fcc4f380764fb476
|
||||
size 825252992
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:477a624a8c20b09829bc2e3f86c0c40483d556036294624ecbf6ec3e8b2bd891
|
||||
size 962845824
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8bca9df6ecbcbcafe402d1ca6fd66f2a66f68f0d985efb215e6553cbd7190e8b
|
||||
size 1161536
|
||||
113
README.md
Normal file
113
README.md
Normal file
@@ -0,0 +1,113 @@
|
||||
---
|
||||
base_model: DavidAU/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM
|
||||
datasets:
|
||||
- TeichAI/claude-4.5-opus-high-reasoning-250x
|
||||
- TeichAI/glm-4.7-2000x
|
||||
- TeichAI/polaris-alpha-1000x
|
||||
- TeichAI/deepseek-v3.2-speciale-1000x
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- unsloth
|
||||
- finetune
|
||||
- All use cases
|
||||
- bfloat16
|
||||
- creative
|
||||
- creative writing
|
||||
- fiction writing
|
||||
- plot generation
|
||||
- sub-plot generation
|
||||
- fiction writing
|
||||
- story generation
|
||||
- scene continue
|
||||
- storytelling
|
||||
- fiction story
|
||||
- science fiction
|
||||
- romance
|
||||
- all genres
|
||||
- story
|
||||
- writing
|
||||
- vivid prosing
|
||||
- vivid writing
|
||||
- fiction
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
weighted/imatrix quants of https://huggingface.co/DavidAU/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ1_S.gguf) | i1-IQ1_S | 0.4 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ1_M.gguf) | i1-IQ1_M | 0.4 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_S.gguf) | i1-IQ2_S | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ2_M.gguf) | i1-IQ2_M | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.6 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q2_K.gguf) | i1-Q2_K | 0.6 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.6 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ3_M.gguf) | i1-IQ3_M | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.7 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.7 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.8 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.8 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM-i1-GGUF/resolve/main/LFM2.5-1.2B-MEGABRAIN-Thinking-Claude-Polaris-Deepseek-GLM.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||
|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user