mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-12 08:37:57 +08:00
commit aed310807c
27 changed files with 235 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

100
README.md Normal file
View File

@@ -0,0 +1,100 @@
---
base_model: kshitijthakkar/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060
datasets:
- kshitijthakkar/loggenix-mc-oraca-agentinstruct-1m-v1
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- qwen3
- qwen3moe
- mixture-of-experts
- llm
- text-generation
- instruction-following
- agentic-ai
- tool-use
- low-resource
- edge-ai
- from-scratch
- causal-lm
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/kshitijthakkar/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ1_S.gguf) | i1-IQ1_S | 0.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_1.gguf) | i1-Q4_1 | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060-i1-GGUF/resolve/main/loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q6_K.gguf) | i1-Q6_K | 0.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2393e22135f7af79f621460d0b121f81c415fc6df0ce71993bed3b4c13aded8f
size 73321952

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17f600065b21b4976844ecca6d9d3141b6e346e4178f5444bad355e8261e7383
size 72142304

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7912af359588e9b5d3e34433dca8edf507900428916687f36fe59bd8812e7f0
size 78646752

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8179e0300b51ab1bf60e93421bc839af3820ed8ad453b35096ae5e7b3bbffad
size 77073888

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:241ef0bf75608b5f8c2703106a890813d454292f3e3364a8bcd4e1d933ae06b1
size 76860896

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d313d4040ee94fadc08fd2e4fa96d87541d71bd316e5afd09f4cc04217f58d56
size 75288032

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:992121b71906f1af31f51f498e2edff2193e3fd7d73b17382a36ed16beb9c686
size 96121824

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1df55432b250d6db50e703a680dcf20b2b5204683360d05adfc489e2fadda6ee
size 95007712

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39d7e9197dc9cc37e30841f17403f3c2ea64df946b09915f25b169678181ec64
size 93729760

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2b797360f4442e27d93b5c5c52329faf2550fc149f89f883cc73e6021d67126
size 82087392

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fbfc9397aa5e0f7029653e8a2f393816dc3f3235be14f8d62761b469143db2d
size 101970912

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a3e57305262c29ae4282173c21520a5f6f7635ffe40b0241398080c1f880e5c
size 100332512

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc61c44a124745d20fbc447401256a0658e29ed4ab4b25869abb6d5057fa6ae1
size 91386848

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30d24be4ff89fac1db390397448f07535d793a295afd0a081e11e8dd0128836b
size 89420768

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8cbbde1c392db7e93fad5416391148dc19c8aa4f89b7128a25656580f8e09280
size 98792416

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4198d655242eee39dd651db13287a7e6c4148cdcedc6241ae68449cea713083
size 97235936

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d530d1b63fc0d3d7229def1a84514140bc59580a4fc5abd08159e28b0e2bc23
size 95007712

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d891c3bfed750b0d73b83b2490a0ea4c5f6372f1eb478b32ba2e834a1dda2a04
size 101839840

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de6e27b29b5348b73bd78a948f64908b029e9ff34e97c3e23dbeda9167103194
size 105116640

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bcfddb3cb7bfffa02acf935e272347f165dc1c8bf2001102668d7faf333a416
size 104133600

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3447e32c1cead8e35282170855d05887d9bcac786feceb02977bb617bc6fde82
size 102233056

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07387f84b9ab5269db7499862bfd3191a55162dac256234d0ab14a3da6e2eef2
size 109638624

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8273f00a33315e3990a479108f495fb957f0bf8d4c6d38d847ad42f9fc83155
size 108524512

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99910c54fc23cd31b0506bccefc881cd2bac83979312f05c5f0c41bf23a7de68
size 115766240

3
loggenix-moe-0.12B-A0.08B-e5-lr5e4-b4-3060.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:51e89616b652edc6a3355ff06c89c4ba5aade3e76c11bdfa2d0db5567882f681
size 485760