初始化项目，由ModelHub XC社区提供模型

Model: mradermacher/WeirdCompound-v1.5-24b-i1-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,59 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+imatrix.dat filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+WeirdCompound-v1.5-24b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,82 @@
+---
+base_model: FlareRebellion/WeirdCompound-v1.5-24b
+language:
+- en
+library_name: transformers
+mradermacher:
+  readme_rev: 1
+quantized_by: mradermacher
+tags:
+- mergekit
+- merge
+---
+## About
+
+<!-- ### quantize_version: 2 -->
+<!-- ### output_tensor_quantised: 1 -->
+<!-- ### convert_type: hf -->
+<!-- ### vocab_type:  -->
+<!-- ### tags: nicoboss -->
+weighted/imatrix quants of https://huggingface.co/FlareRebellion/WeirdCompound-v1.5-24b
+
+<!-- provided-files -->
+
+***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#WeirdCompound-v1.5-24b-i1-GGUF).***
+
+static quants are available at https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-GGUF
+## Usage
+
+If you are unsure how to use GGUF files, refer to one of [TheBloke's
+READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
+more details, including on how to concatenate multi-part files.
+
+## Provided Quants
+
+(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
+
+| Link | Type | Size/GB | Notes |
+|:-----|:-----|--------:|:------|
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/WeirdCompound-v1.5-24b-i1-GGUF/resolve/main/WeirdCompound-v1.5-24b.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
+
+Here is a handy graph by ikawrakow comparing some lower-quality quant
+types (lower is better):
+
+![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
+
+And here are Artefact2's thoughts on the matter:
+https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
+
+## FAQ / Model Request
+
+See https://huggingface.co/mradermacher/model_requests for some answers to
+questions you might have and/or if you want some other model quantized.
+
+## Thanks
+
+I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
+me use its servers and providing upgrades to my workstation to enable
+this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
+
+<!-- end -->

WeirdCompound-v1.5-24b.i1-IQ1_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0715130627f8d2e3c03150ba108e9f793b824cd129a6814e54e310e9cb71485
+size 5750497184

WeirdCompound-v1.5-24b.i1-IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3dd23410c8c7f0a2dd3ac22d6377b028b36693a491504498d84201fa23b22a32
+size 5273722784

WeirdCompound-v1.5-24b.i1-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ce892b626885b024f12f25e4c841e9d0341bbce1642860f551db4f9a93d0c837
+size 8114053024

WeirdCompound-v1.5-24b.i1-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:987726d32ce216129c9dafe563f744b24933c937ed456ae321d8b23653f5470b
+size 7478353824

WeirdCompound-v1.5-24b.i1-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6e5d1b3e824de170be0a78b306830868304fb0491c60cceb2bf91115b988d7c7
+size 7207034784

WeirdCompound-v1.5-24b.i1-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d8d60519ebc91658dcbb3c99a56782b7bab8b5b5f3aab60c8b0e79349be30d28
+size 6545121184

WeirdCompound-v1.5-24b.i1-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01513217a6e1cd1ee877937f86ea2217449b191c686d09f306d7780f33e18b39
+size 10650951584

WeirdCompound-v1.5-24b.i1-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a0304649a5e2c021721bf67869caea315959dd44bfcffe77aea4de9bc40e6465
+size 10428129184

WeirdCompound-v1.5-24b.i1-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e181c9d31b38362590c8b5edd8f2f2a6e18356f8f251f3cca8784993f759371
+size 9907117984

WeirdCompound-v1.5-24b.i1-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cce4b536586a536139d6bebe2631a6c389f09ba0ad33605ff7f352c39d61503d
+size 9280593824

WeirdCompound-v1.5-24b.i1-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b88beab8ee9711ae0c570f0e7afbfefdc97165cdef2ac38d4f7338b500be890d
+size 12758917024

WeirdCompound-v1.5-24b.i1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9bb57d212f539a4fabf36b9c9a2de5ea6457f0cbe20f72a691cb742726066220
+size 8890326944

WeirdCompound-v1.5-24b.i1-Q2_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c075a951b5c520d4ee515a1f63798a4bbce29937b108f59d7a2edfe7b6ffce6c
+size 8320163744

WeirdCompound-v1.5-24b.i1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aebf5b3b30418bd2889cf8a6a387505935c8cbbb9698974ca23a7ae785bd4191
+size 12400762784

WeirdCompound-v1.5-24b.i1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4bd9dcd271df574715813a345cd5a523e265c3200d9439c1abc1049abc8e90a
+size 11474083744

WeirdCompound-v1.5-24b.i1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a13f41f7b9e1aa2b918c8fcc08598037cd7a08a13695925559a7f70f7c6fc7c
+size 10400276384

WeirdCompound-v1.5-24b.i1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fe61114a98b615d08365ee349723cd5700c09a17ffee03d70e34691c85592eb8
+size 13494230944

WeirdCompound-v1.5-24b.i1-Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:631e0c75a58394f559af0681deda5f09655a77ce038132094dac62791979e28b
+size 14873108384

WeirdCompound-v1.5-24b.i1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4bb4e2c5b05d606852b8415b67371d879dd0ca57e34e166f8190e3380a5c0505
+size 14333910944

WeirdCompound-v1.5-24b.i1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1665e3c4835f28c13b4cd6adaf1ab0b379d14d4fa6304ff2355d7f4f9daaad40
+size 13549281184

WeirdCompound-v1.5-24b.i1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d0c315d9f0150c046145de0eee643951b74bf0218137985d1d0a1a1f9945b03d
+size 16763985824

WeirdCompound-v1.5-24b.i1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d878decfb672796919f80a98e11e538ea5364e00af82ef9ba49be924a7851fd
+size 16304414624

WeirdCompound-v1.5-24b.i1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2aa6715cbef2a89c0f2b8c4b6401bf1801f4367ca17dee0c64e97a43b1e4ef4
+size 19345940384

imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3112aa94520956739e04897357de5e262c610e8158d7e470863a1d181b21a42b
+size 10003525