bartowski/soob3123_amoral-gemma3-12B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/soob3123_amoral-gemma3-12B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-22 10:21:05 +08:00
commit 17b58f353d
29 changed files with 312 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
soob3123_amoral-gemma3-12B.imatrix filter=lfs diff=lfs merge=lfs -text

184
README.md Normal file
View File

@@ -0,0 +1,184 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
language:
- en
tags:
- text-generation-inference
- transformers
- gemma3
- roleplaying
- creative-writing
- uncensored
license: apache-2.0
base_model: soob3123/amoral-gemma3-12B
---
## Llamacpp imatrix Quantizations of amoral-gemma3-12B by soob3123
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4896">b4896</a> for quantization.
Original model: https://huggingface.co/soob3123/amoral-gemma3-12B
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
Run them in [LM Studio](https://lmstudio.ai/)
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
## Prompt format
```
<bos><start_of_turn>user
{system_prompt}
{prompt}<end_of_turn>
<start_of_turn>model
<end_of_turn>
<start_of_turn>model
```
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [amoral-gemma3-12B-bf16.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-bf16.gguf) | bf16 | 23.54GB | false | Full BF16 weights. |
| [amoral-gemma3-12B-Q8_0.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q8_0.gguf) | Q8_0 | 12.51GB | false | Extremely high quality, generally unneeded but max available quant. |
| [amoral-gemma3-12B-Q6_K_L.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q6_K_L.gguf) | Q6_K_L | 9.90GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [amoral-gemma3-12B-Q6_K.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q6_K.gguf) | Q6_K | 9.66GB | false | Very high quality, near perfect, *recommended*. |
| [amoral-gemma3-12B-Q5_K_L.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q5_K_L.gguf) | Q5_K_L | 8.69GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [amoral-gemma3-12B-Q5_K_M.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q5_K_M.gguf) | Q5_K_M | 8.45GB | false | High quality, *recommended*. |
| [amoral-gemma3-12B-Q5_K_S.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q5_K_S.gguf) | Q5_K_S | 8.23GB | false | High quality, *recommended*. |
| [amoral-gemma3-12B-Q4_1.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q4_1.gguf) | Q4_1 | 7.56GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [amoral-gemma3-12B-Q4_K_L.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q4_K_L.gguf) | Q4_K_L | 7.54GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [amoral-gemma3-12B-Q4_K_M.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q4_K_M.gguf) | Q4_K_M | 7.30GB | false | Good quality, default size for most use cases, *recommended*. |
| [amoral-gemma3-12B-Q4_K_S.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q4_K_S.gguf) | Q4_K_S | 6.94GB | false | Slightly lower quality with more space savings, *recommended*. |
| [amoral-gemma3-12B-Q4_0.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q4_0.gguf) | Q4_0 | 6.91GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [amoral-gemma3-12B-IQ4_NL.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ4_NL.gguf) | IQ4_NL | 6.89GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [amoral-gemma3-12B-Q3_K_XL.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q3_K_XL.gguf) | Q3_K_XL | 6.72GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [amoral-gemma3-12B-IQ4_XS.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ4_XS.gguf) | IQ4_XS | 6.55GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [amoral-gemma3-12B-Q3_K_L.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q3_K_L.gguf) | Q3_K_L | 6.48GB | false | Lower quality but usable, good for low RAM availability. |
| [amoral-gemma3-12B-Q3_K_M.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q3_K_M.gguf) | Q3_K_M | 6.01GB | false | Low quality. |
| [amoral-gemma3-12B-IQ3_M.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ3_M.gguf) | IQ3_M | 5.66GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [amoral-gemma3-12B-Q3_K_S.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q3_K_S.gguf) | Q3_K_S | 5.46GB | false | Low quality, not recommended. |
| [amoral-gemma3-12B-IQ3_XS.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ3_XS.gguf) | IQ3_XS | 5.21GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [amoral-gemma3-12B-Q2_K_L.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q2_K_L.gguf) | Q2_K_L | 5.01GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [amoral-gemma3-12B-IQ3_XXS.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ3_XXS.gguf) | IQ3_XXS | 4.78GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [amoral-gemma3-12B-Q2_K.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-Q2_K.gguf) | Q2_K | 4.77GB | false | Very low quality but surprisingly usable. |
| [amoral-gemma3-12B-IQ2_M.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ2_M.gguf) | IQ2_M | 4.31GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
| [amoral-gemma3-12B-IQ2_S.gguf](https://huggingface.co/bartowski/soob3123_amoral-gemma3-12B-GGUF/blob/main/soob3123_amoral-gemma3-12B-IQ2_S.gguf) | IQ2_S | 4.02GB | false | Low quality, uses SOTA techniques to be usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/soob3123_amoral-gemma3-12B-GGUF --include "soob3123_amoral-gemma3-12B-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/soob3123_amoral-gemma3-12B-GGUF --include "soob3123_amoral-gemma3-12B-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (soob3123_amoral-gemma3-12B-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
The I-quants are *not* compatible with Vulcan, which is also AMD, so if you have an AMD card double check if you're using the rocBLAS build or the Vulcan build. At the time of writing this, LM Studio has a preview with ROCm support, and other inference engines have specific builds for ROCm.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
soob3123_amoral-gemma3-12B-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3853241884f57451eabe75a3a04fbe0c1b997644e07872d12a914404e8073a9e
size 4310461312

3
soob3123_amoral-gemma3-12B-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fdb0531721bcd0a9b50d38c000bdd45717d5fa7f58b0f3571e0b30fb4896cc6
size 4020710272

3
soob3123_amoral-gemma3-12B-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fd3499183620f4a94d4efa2a7911def52c2a951064d11aaef72c6434efb58a5
size 5655722752

3
soob3123_amoral-gemma3-12B-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e35c003ec7a487b748ea05f6f05fe9df6aad6a697a95fcd97c81cfda4a9d52b4
size 5206166272

3
soob3123_amoral-gemma3-12B-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7aabc74ba026e89246ab8a84c1f1d77d259d684cb68a6796d187fcf49b5c682
size 4784900992

3
soob3123_amoral-gemma3-12B-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d539dfc52617cee681ac7a24f431515f14d8a3b30e30afb3072e3cb9953efad
size 6887164672

3
soob3123_amoral-gemma3-12B-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:82a9c2b78286089596ba361ad45e19858b49b85da195ce9403c6952714de6580
size 6550964992

3
soob3123_amoral-gemma3-12B-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a3a00c529d95de49b800cabe9bf3e0c6cc046c54b64bf4d8eb3d662590edfa2
size 4768221952

3
soob3123_amoral-gemma3-12B-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e606177f65f09da59198b2bc1e01ce8b0a0b74b33789885504d8c7865e96a382
size 5012075392

3
soob3123_amoral-gemma3-12B-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b9764487da3e364db86c6106bc014e0d760f6c75d62d07212dc7035164ae3a37
size 6480186112

3
soob3123_amoral-gemma3-12B-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c714394775d4f510af2a2e5a00c2ce3223df2660a8a84551d45148ad9f275d0
size 6008818432

3
soob3123_amoral-gemma3-12B-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e0623201929fe97d668831eacb9ab458a273d2bf4224001d7b3fa5035d478c3
size 5458316032

3
soob3123_amoral-gemma3-12B-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f706d91e43d1568b669dfa5420923616c0b22e6b8954a7f97421671b5b18a602
size 6724039552

3
soob3123_amoral-gemma3-12B-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ded932728e7e9b649e62b185483bc001f57eb2a57974f614d0fb635fd6484630
size 6909283072

3
soob3123_amoral-gemma3-12B-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:669989224f80cf073e74ec2ed6070d07e6822a32415ab36a58a12967d8655ca9
size 7559564032

3
soob3123_amoral-gemma3-12B-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30494e6169e48cd7287b62d99001160963a924935a6c7d9d0c0cc9ef57cdabeb
size 7544632192

3
soob3123_amoral-gemma3-12B-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f78824e6d9f24822078ebde4c0fe04f4a336f2004a32de0a82cbb92a3879ea35
size 7300778752

3
soob3123_amoral-gemma3-12B-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:533149ba13c34353343d34fda2f94be3e70d437d991a9ac375d3effb0c1a99b8
size 6935333632

3
soob3123_amoral-gemma3-12B-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f068fdf8c6fe6168b4a2d9433a1076e3d9b60a6a780e67c5238e341184401bf5
size 8688890752

3
soob3123_amoral-gemma3-12B-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e45b2623666b32737d501c4ee5232cbdd362bc0d931b2ee42b7eaf578dd584c
size 8445037312

3
soob3123_amoral-gemma3-12B-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2bb5cfe674dfedc1c0cef85942e5e463fa53cf3bb9fe92522b7fc749f3701896
size 8231963392

3
soob3123_amoral-gemma3-12B-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:474dcb2355e1dfb0f0fec34263a585471ae498d4cb68d012380b7c500b9afe44
size 9660812032

3
soob3123_amoral-gemma3-12B-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2d34207b0b45a081a5b481c5ecacee7a3584ecfde7fb8b241705c346cb730d2
size 9904665472

3
soob3123_amoral-gemma3-12B-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bf93630e2c2f49070b5a2e9b791044facac3eab164340fba2a5781615043e0f
size 12510212992

3
soob3123_amoral-gemma3-12B-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a29f82be9f3acc9c47982aabbba7e46bff1f51e75b6d0ee8ea9a509495728fa
size 23540151904

3
soob3123_amoral-gemma3-12B.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb03477818ca39690b91223fba63fe660cb44e9cc7f55b7a622c8668116ace39
size 7433114