初始化项目，由ModelHub XC社区提供模型

Model: mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,60 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+imatrix.dat filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Zurich-1.5B-GCv2-1m.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,88 @@
+---
+base_model: rubenroy/Zurich-1.5B-GCv2-1m
+datasets:
+- rubenroy/GammaCorpus-v2-1m
+language:
+- en
+library_name: transformers
+license: apache-2.0
+quantized_by: mradermacher
+tags:
+- text-generation-inference
+- transformers
+- unsloth
+- qwen2
+- trl
+- gammacorpus
+- zurich
+- chat
+- conversational
+---
+## About
+
+<!-- ### quantize_version: 2 -->
+<!-- ### output_tensor_quantised: 1 -->
+<!-- ### convert_type: hf -->
+<!-- ### vocab_type:  -->
+<!-- ### tags: nicoboss -->
+weighted/imatrix quants of https://huggingface.co/rubenroy/Zurich-1.5B-GCv2-1m
+
+<!-- provided-files -->
+static quants are available at https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-GGUF
+## Usage
+
+If you are unsure how to use GGUF files, refer to one of [TheBloke's
+READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
+more details, including on how to concatenate multi-part files.
+
+## Provided Quants
+
+(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
+
+| Link | Type | Size/GB | Notes |
+|:-----|:-----|--------:|:------|
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 |  |
+| [GGUF](https://huggingface.co/mradermacher/Zurich-1.5B-GCv2-1m-i1-GGUF/resolve/main/Zurich-1.5B-GCv2-1m.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
+
+Here is a handy graph by ikawrakow comparing some lower-quality quant
+types (lower is better):
+
+![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
+
+And here are Artefact2's thoughts on the matter:
+https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
+
+## FAQ / Model Request
+
+See https://huggingface.co/mradermacher/model_requests for some answers to
+questions you might have and/or if you want some other model quantized.
+
+## Thanks
+
+I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
+me use its servers and providing upgrades to my workstation to enable
+this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
+
+<!-- end -->

Zurich-1.5B-GCv2-1m.i1-IQ1_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:83a29aa1f5ae1731088ed984519dc21148ecc9dd2f0b37853dc2ef9e3de35328
+size 464462784

Zurich-1.5B-GCv2-1m.i1-IQ1_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:88490dd0ec826169088e11f95537f68d8b419aee406478fecb2caa3cf98a982a
+size 436529088

Zurich-1.5B-GCv2-1m.i1-IQ2_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:058aca25efaa336750ab7e91ef9903ef83023d4822453797b345abaaefda1398
+size 601056192

Zurich-1.5B-GCv2-1m.i1-IQ2_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c25d7f1c207a78ac19413258173011f839d438c5bc2197f4032fa3afd1efbd1f
+size 563811264

Zurich-1.5B-GCv2-1m.i1-IQ2_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e556f69a5bbec528b4a5494b156ef8ea7beb46964194d71a1400057a47b78eb6
+size 550328256

Zurich-1.5B-GCv2-1m.i1-IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2be01991ca737e1b9d7c53b52a6453bf1ed1b2b481e54267901c102d6f1b1c0
+size 511018944

Zurich-1.5B-GCv2-1m.i1-IQ3_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e15c3bf67057fccd51b013ead52e102d95669a015733d69d920d42bbc6799ad
+size 776665536

Zurich-1.5B-GCv2-1m.i1-IQ3_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:11d5cea91ace37897827048112ff67175d3fa8cbdba6c94d7d97afa9b8cb68dc
+size 762408384

Zurich-1.5B-GCv2-1m.i1-IQ3_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc2952c81a92e03b14c0e37b870f87805ddf2bf02a93b6dec93285afad5a87a9
+size 731700672

Zurich-1.5B-GCv2-1m.i1-IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2df38be469b9801af0026d328f17245d5c83420d87e4dfadef33846490c4a3db
+size 668793792

Zurich-1.5B-GCv2-1m.i1-IQ4_NL.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99fa751b76f394f9d72b1a0b996e179fae14d571a93344890938fc15ac1bb10a
+size 936332736

Zurich-1.5B-GCv2-1m.i1-IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a77927f0a9fb01fa089349818fdad10e464133f2c66b22421fe443c3ff2c1004
+size 895733184

Zurich-1.5B-GCv2-1m.i1-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:584838a12024f6cb9ee70bcbfbe7a471abbd1925f29cb92f7a20a21181260f63
+size 676306368

Zurich-1.5B-GCv2-1m.i1-Q2_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a605f0af8e77f6ffb19b64536173c1228e87e66cbdb28b9ba72653c8f755e33e
+size 640136640

Zurich-1.5B-GCv2-1m.i1-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:64223aba504a688835b1c9a3a5f4114ebaa1f5f805006afb2a629001e1b3a5ff
+size 880164288

Zurich-1.5B-GCv2-1m.i1-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b14db1dd9c0d6f0ea640ae96f024d26cdb41f80682e27d6d763d43dc13b7bca4
+size 824180160

Zurich-1.5B-GCv2-1m.i1-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0896b2fbdac3d642e1cdcdd30433c72a18d0e14935062d8ca446703e0a7787bf
+size 760946112

Zurich-1.5B-GCv2-1m.i1-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93c24ae9789c569b228024047f7a4cee5bb72860ad64f31155f75654fff78d15
+size 937536960

Zurich-1.5B-GCv2-1m.i1-Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:efd858a74b2df4c43f7943856741c532109333b9fdb4d25a952c82ded807eb6e
+size 1016843712

Zurich-1.5B-GCv2-1m.i1-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:623cb05c6ea31cac8b9a55c3262762a64208b5b98b0e4d8d20aedc7c79b9e95b
+size 986049984

Zurich-1.5B-GCv2-1m.i1-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2a45229b273bdb1da1bca028e2ab58af13033c236fcc3cda708fe5fd17f36d0f
+size 940314048

Zurich-1.5B-GCv2-1m.i1-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e02e21d47e86625adff2eb46662bb468999d016436d5675e53238aa7c445e17d
+size 1125051840

Zurich-1.5B-GCv2-1m.i1-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1cb8ca2021ecc1f1cd0a5a51deb24697caa3359bcadb80bafb218048133e56f3
+size 1098730944

Zurich-1.5B-GCv2-1m.i1-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:89376b73a6b11fd7753caf9eef0bf63007ab541624262aac89053a6de2ef1330
+size 1272741312

imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84237a34a280bf39e5be2eaf48c26b624e1636f95793d359ba7956d03a07df51
+size 2042201