bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-02 19:20:12 +08:00
commit 04114c57da
29 changed files with 312 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

61
.gitattributes vendored Normal file
View File

@@ -0,0 +1,61 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q6_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q5_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q4_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q2_K_L.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2-bf16.gguf filter=lfs diff=lfs merge=lfs -text
TheDrummer_Snowpiercer-15B-v2.imatrix filter=lfs diff=lfs merge=lfs -text

172
README.md Normal file
View File

@@ -0,0 +1,172 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
base_model: TheDrummer/Snowpiercer-15B-v2
base_model_relation: quantized
license: mit
---
## Llamacpp imatrix Quantizations of Snowpiercer-15B-v2 by TheDrummer
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5868">b5868</a> for quantization.
Original model: https://huggingface.co/TheDrummer/Snowpiercer-15B-v2
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
Run them in [LM Studio](https://lmstudio.ai/)
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
## Prompt format
```
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [Snowpiercer-15B-v2-bf16.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-bf16.gguf) | bf16 | 29.96GB | false | Full BF16 weights. |
| [Snowpiercer-15B-v2-Q8_0.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q8_0.gguf) | Q8_0 | 15.92GB | false | Extremely high quality, generally unneeded but max available quant. |
| [Snowpiercer-15B-v2-Q6_K_L.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q6_K_L.gguf) | Q6_K_L | 12.62GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [Snowpiercer-15B-v2-Q6_K.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q6_K.gguf) | Q6_K | 12.29GB | false | Very high quality, near perfect, *recommended*. |
| [Snowpiercer-15B-v2-Q5_K_L.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q5_K_L.gguf) | Q5_K_L | 11.07GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [Snowpiercer-15B-v2-Q5_K_M.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q5_K_M.gguf) | Q5_K_M | 10.65GB | false | High quality, *recommended*. |
| [Snowpiercer-15B-v2-Q5_K_S.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q5_K_S.gguf) | Q5_K_S | 10.39GB | false | High quality, *recommended*. |
| [Snowpiercer-15B-v2-Q4_K_L.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q4_K_L.gguf) | Q4_K_L | 9.61GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [Snowpiercer-15B-v2-Q4_1.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q4_1.gguf) | Q4_1 | 9.50GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [Snowpiercer-15B-v2-Q4_K_M.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q4_K_M.gguf) | Q4_K_M | 9.11GB | false | Good quality, default size for most use cases, *recommended*. |
| [Snowpiercer-15B-v2-Q4_K_S.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q4_K_S.gguf) | Q4_K_S | 8.66GB | false | Slightly lower quality with more space savings, *recommended*. |
| [Snowpiercer-15B-v2-IQ4_NL.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ4_NL.gguf) | IQ4_NL | 8.64GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [Snowpiercer-15B-v2-Q4_0.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q4_0.gguf) | Q4_0 | 8.63GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [Snowpiercer-15B-v2-Q3_K_XL.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q3_K_XL.gguf) | Q3_K_XL | 8.58GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [Snowpiercer-15B-v2-IQ4_XS.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ4_XS.gguf) | IQ4_XS | 8.20GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [Snowpiercer-15B-v2-Q3_K_L.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q3_K_L.gguf) | Q3_K_L | 7.99GB | false | Lower quality but usable, good for low RAM availability. |
| [Snowpiercer-15B-v2-Q3_K_M.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q3_K_M.gguf) | Q3_K_M | 7.40GB | false | Low quality. |
| [Snowpiercer-15B-v2-IQ3_M.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ3_M.gguf) | IQ3_M | 6.94GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [Snowpiercer-15B-v2-Q3_K_S.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q3_K_S.gguf) | Q3_K_S | 6.71GB | false | Low quality, not recommended. |
| [Snowpiercer-15B-v2-Q2_K_L.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q2_K_L.gguf) | Q2_K_L | 6.45GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [Snowpiercer-15B-v2-IQ3_XS.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ3_XS.gguf) | IQ3_XS | 6.42GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [Snowpiercer-15B-v2-IQ3_XXS.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ3_XXS.gguf) | IQ3_XXS | 5.99GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [Snowpiercer-15B-v2-Q2_K.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-Q2_K.gguf) | Q2_K | 5.79GB | false | Very low quality but surprisingly usable. |
| [Snowpiercer-15B-v2-IQ2_M.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ2_M.gguf) | IQ2_M | 5.35GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
| [Snowpiercer-15B-v2-IQ2_S.gguf](https://huggingface.co/bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF/blob/main/TheDrummer_Snowpiercer-15B-v2-IQ2_S.gguf) | IQ2_S | 4.98GB | false | Low quality, uses SOTA techniques to be usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF --include "TheDrummer_Snowpiercer-15B-v2-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/TheDrummer_Snowpiercer-15B-v2-GGUF --include "TheDrummer_Snowpiercer-15B-v2-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (TheDrummer_Snowpiercer-15B-v2-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

3
TheDrummer_Snowpiercer-15B-v2-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cfe48fe751b01056d72153fe5cf0c158fd5f9a20be18a6953122e54964bd177
size 5352369312

3
TheDrummer_Snowpiercer-15B-v2-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:415061248b5071941eae2c56fc5235eabedaf2223da667638934e9f67df7c8d7
size 4981107872

3
TheDrummer_Snowpiercer-15B-v2-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f04edd4f180ba564eb2ae49ac54ca81cb1ad6b97a98ba1831843af7504be7e94
size 6938668192

3
TheDrummer_Snowpiercer-15B-v2-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a77710b519d8d4409eae741cf083ddfc69378af759ebedfb5904dbdc9e38b36
size 6424865952

3
TheDrummer_Snowpiercer-15B-v2-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53fb39656adc49d332e44b72f890bd428de3b9175bd66d689f67a9a20c891d9e
size 5992328352

3
TheDrummer_Snowpiercer-15B-v2-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92306a10909a88c12759e5f85653cb7746ab2a3ca59ff542a2f2e23be14039ea
size 8638426272

3
TheDrummer_Snowpiercer-15B-v2-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16441dc4307d1884cafb8e4e26ee230a0a68e6c1ce55124b4b48cba1b1c0a5ee
size 8199662752

3
TheDrummer_Snowpiercer-15B-v2-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f14d5c47be0794c580b8e609cf1ba080ca6f7e48cfc562bfecada2565661e602
size 5794163872

3
TheDrummer_Snowpiercer-15B-v2-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90e3fd1fbc9a6f7b83676e437dd4f5b6acdc40374650ac11a0f7d9d06bfacdbd
size 6449523872

3
TheDrummer_Snowpiercer-15B-v2-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc02c3fd6014e28db17621658a8f06cf98060174d3d47817d799459c8d1baa66
size 7990193312

3
TheDrummer_Snowpiercer-15B-v2-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b9088010cf497913a9ed1a3dabc58ded53a8b60de275968c81784c33bf9f002
size 7396437152

3
TheDrummer_Snowpiercer-15B-v2-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f781ec6d80b15ce0faa0d719c72cb3ade412369f8d00cb0a66f99769fcbae00e
size 6706097312

3
TheDrummer_Snowpiercer-15B-v2-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48d847a9ba2374ea1c99295ed1aa33d90105374ba1997b57df1c2623c81eb08b
size 8577395872

3
TheDrummer_Snowpiercer-15B-v2-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9a04149c871861b84eb21e336122e66f975c02b8c25a6c66ec4338f6adfb5ac
size 8633183392

3
TheDrummer_Snowpiercer-15B-v2-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c469b2567984630908c400f12a6c7d6d748f42b8e7f444cb77c56a640bc4803
size 9499569312

3
TheDrummer_Snowpiercer-15B-v2-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8409eaed87a3e986948872256bf383b6a2fc32f824d69ac8f29ed925d1adf219
size 9610611872

3
TheDrummer_Snowpiercer-15B-v2-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d02f44dae14799634b3f64b2e28894d16d648dc0f45f64a3a46e74fda3391bc
size 9112538272

3
TheDrummer_Snowpiercer-15B-v2-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58c0d9238c7d3247953685c38be58999d49f0799358de30e3278c66bb2fece4b
size 8663329952

3
TheDrummer_Snowpiercer-15B-v2-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:894740461c5213d4168225d32297176400c9035b338885a74ee3796bc914c3a3
size 11068787872

3
TheDrummer_Snowpiercer-15B-v2-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:535f2598f4ccaac67ead642ba32cfb21975ae66d1040924b4215443d05c4310e
size 10654600352

3
TheDrummer_Snowpiercer-15B-v2-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e73439b15bdcc2407ef0ca227ec4c1f51d20c4ffe2c3a84e4d2dfef0e6b88b57
size 10393480352

3
TheDrummer_Snowpiercer-15B-v2-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66f672b5734a2c86599db2800c08fbbe0dd5a7239897af683f2e49c897ba1edd
size 12293041312

3
TheDrummer_Snowpiercer-15B-v2-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61a447f68139099b5300179fe79887a4186a4729cb70b766fffeed0166be3120
size 12618099872

3
TheDrummer_Snowpiercer-15B-v2-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:817b502bbbe8cd5c1d02d3ee6857cee14edef7e565218edc3a4c87375a7b4055
size 15919475872

3
TheDrummer_Snowpiercer-15B-v2-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a75c6dd68165f3a4dbac6d21647b0da50950645b3aae30104141aa219636617b
size 29957286784

3
TheDrummer_Snowpiercer-15B-v2.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c3df70ad3e5e69765fdcacb1738a92a5c48ad74c5dcfdb606b7b670218cc044
size 8818028

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}