初始化项目，由ModelHub XC社区提供模型

Model: mradermacher/Savage-Sands-12B-i1-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,60 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+Savage-Sands-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,116 @@
+---
+base_model: DarkArtsForge/Savage-Sands-12B
+datasets:
+- OccultAI/illuminati_imatrix_v1
+language:
+- en
+library_name: transformers
+license: apache-2.0
+mradermacher:
+  readme_rev: 1
+quantized_by: mradermacher
+tags:
+- creative
+- creative writing
+- fiction writing
+- plot generation
+- sub-plot generation
+- fiction writing
+- story generation
+- scene continue
+- storytelling
+- fiction story
+- science fiction
+- romance
+- all genres
+- story
+- writing
+- vivid prosing
+- vivid writing
+- fiction
+- roleplaying
+- float32
+- swearing
+- rp
+- horror
+- della
+- mistral
+- nemo
+- merge
+- mergekit
+---
+## About
+
+<!-- ### quantize_version: 2 -->
+<!-- ### output_tensor_quantised: 1 -->
+<!-- ### convert_type: hf -->
+<!-- ### vocab_type:  -->
+<!-- ### tags: nicoboss -->
+<!-- ### quants:  Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
+<!-- ### quants_skip:  -->
+<!-- ### skip_mmproj:  -->
+weighted/imatrix quants of https://huggingface.co/DarkArtsForge/Savage-Sands-12B
+
+<!-- provided-files -->
+
+***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Savage-Sands-12B-i1-GGUF).***
+
+static quants are available at https://huggingface.co/mradermacher/Savage-Sands-12B-GGUF
+## Usage
+
+If you are unsure how to use GGUF files, refer to one of [TheBloke's
+READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
+more details, including on how to concatenate multi-part files.
+
+## Provided Quants
+
+(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
+
+| Link | Type | Size/GB | Notes |
+|:-----|:-----|--------:|:------|
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 |  |
+| [GGUF](https://huggingface.co/mradermacher/Savage-Sands-12B-i1-GGUF/resolve/main/Savage-Sands-12B.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
+
+Here is a handy graph by ikawrakow comparing some lower-quality quant
+types (lower is better):
+
+![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
+
+And here are Artefact2's thoughts on the matter:
+https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
+
+## FAQ / Model Request
+
+See https://huggingface.co/mradermacher/model_requests for some answers to
+questions you might have and/or if you want some other model quantized.
+
+## Thanks
+
+I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
+me use its servers and providing upgrades to my workstation to enable
+this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
+
+<!-- end -->

Savage-Sands-12B.i1-IQ1_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:021f2c6edd5c197c9ee04d5c75e1f67ecf334c9a9aba3015293ebb5758b894f6
+size 3221626656

Savage-Sands-12B.i1-IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a54511dfa37e7e924156e6ce1a27cd655c3223378540a1bbb383fe62b205c28
+size 2999213856

Savage-Sands-12B.i1-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f9108b5ae10d359eee10f59d4ef229770713b3c644d2344f593dac4986f95338
+size 4435025696

Savage-Sands-12B.i1-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dabf398278ff26bf8d494ab7b09babe3201760d13d3b1dc18a2223bed1b629b2
+size 4138475296

Savage-Sands-12B.i1-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c55492725bce2dac1763631ce90a9efec6a63289bd2e3b53d0123fcfa8a28255
+size 3915079456

Savage-Sands-12B.i1-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a03fa332d60e839b575b5e1f14745c469ef5aed8204574eb602184de4ed1af00
+size 3592314656

Savage-Sands-12B.i1-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:401e795d37b611bb86c3c2fd5300c7dbe5b743631ae4455cd637eac27865269d
+size 5722234656

Savage-Sands-12B.i1-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23bfccf539ba76ea623de49754a8e9c759a94492b634dd5daa22226a644467ff
+size 5562081056

Savage-Sands-12B.i1-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e56919a4fce8f2edebd6e49bc689c88b37ccef8e68ceb8fe35f567de008700f
+size 5306490656

Savage-Sands-12B.i1-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7c1616e0b724208380445774c023538de07929b29887019e1869f881032f5cd
+size 4945387296

Savage-Sands-12B.i1-IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61b9ef30a03ac249a249503f912ba802a7c6cbae0d0141c49cd20eca620e1ef4
+size 7097917216

Savage-Sands-12B.i1-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd591b30c61e9da817b8542efb7c6171d2867fd6cfd8dda05fd047bad4f0e6ce
+size 6742712096

Savage-Sands-12B.i1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3acaa9aad9281158a48dad64a3ccad708c494e5b27a5ceabdf1e8153f14695a0
+size 4791050016

Savage-Sands-12B.i1-Q2_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da5113dbab582a286fbf3d72a0de52fefea65447c305f9d4d9e03d194dbcf963
+size 4493680416

Savage-Sands-12B.i1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:726c1a9dde5738823706cdcb30b62cb0c5fdb1200099e6235dc2999fcf74c0fa
+size 6561505056

Savage-Sands-12B.i1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d91690d45c9ea6ca24134359412161feb5c2fc6027ecf6f7577eec2bdb971795
+size 6083092256

Savage-Sands-12B.i1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5591647d38df65610880a43693d15a3cec4fc2baf46a84855a7bb63e7006c2e2
+size 5534228256

Savage-Sands-12B.i1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5982e3beef652e6baf9931c0dade82d8ec2e5f7f3161e2d3cbcd87e9fd92d5f8
+size 7094640416

Savage-Sands-12B.i1-Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83a218b0a42c1c0e437fd0d1a2be3701b12e7f5b2efd23fd278d0c5617150c83
+size 7795220256

Savage-Sands-12B.i1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:753cdfbb8971c49fc29fbfbe0676c0cfc5082d10b103f02b21af5a53f1f81d9b
+size 7477206816

Savage-Sands-12B.i1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a36eeab1f228a779bd6bd004b9ea552b7bb2376b65ad174c75db9e226b4e0f46
+size 7120199456

Savage-Sands-12B.i1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:edc75291d500abb5f0dc8de08a9b97e816d17556e1b1365dfa941fd29f7629dc
+size 8727633696

Savage-Sands-12B.i1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cd3ab9796772a09630c01dd881476a463b02b76553d9438277e1a230c7d7ee0c
+size 8518737696

Savage-Sands-12B.i1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:170ce52037405834cc236dbcc2c3437274fcf9bb4bbe819fb1ff29d56784dded
+size 10056212256

Savage-Sands-12B.imatrix.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9d2ea2e461efff59ef3de98cb66e86ae65b5106a490af810754181a30d26103f
+size 7088192