commit 85a5ed8bdb748ee4bfa25ffde15dccc9a53918af Author: ModelHub XC Date: Sun May 31 02:45:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Orvex-Alpha-v1-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..5dc6d09 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Orvex-Alpha-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Orvex-Alpha-v1.i1-IQ1_M.gguf b/Orvex-Alpha-v1.i1-IQ1_M.gguf new file mode 100644 index 0000000..f04a731 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b7fc3d0d2b9a7d288b5d4fd4ccfad66ada64745950f3ce6fb398c762c50e83f +size 4273654464 diff --git a/Orvex-Alpha-v1.i1-IQ1_S.gguf b/Orvex-Alpha-v1.i1-IQ1_S.gguf new file mode 100644 index 0000000..f39d48a --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0069f5614b212753af3c5f0f06b833f68aaacc1569c33cfdd3fc7c8b8b9665aa +size 3878079168 diff --git a/Orvex-Alpha-v1.i1-IQ2_M.gguf b/Orvex-Alpha-v1.i1-IQ2_M.gguf new file mode 100644 index 0000000..fcb9c05 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6d5f4b8411640ca506c23c3cbea1dee2708e6b2ac97e82cf69ee790662e43bf1 +size 6164966080 diff --git a/Orvex-Alpha-v1.i1-IQ2_S.gguf b/Orvex-Alpha-v1.i1-IQ2_S.gguf new file mode 100644 index 0000000..ce66e46 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:804933e91e5bc4b8f7550d1f0ce66e945d59b168f8d1f4768be0ba2e05d07a89 +size 5637532352 diff --git a/Orvex-Alpha-v1.i1-IQ2_XS.gguf b/Orvex-Alpha-v1.i1-IQ2_XS.gguf new file mode 100644 index 0000000..e50dcbf --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ca95767f403a3d9d06fac26d119553bd1394455f8a2277c17d57c6100bfae22 +size 5477157568 diff --git a/Orvex-Alpha-v1.i1-IQ2_XXS.gguf b/Orvex-Alpha-v1.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..1ea933e --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2155b1faa8baec71de74c9bf98519d54350f070590c62273564a2e0774edc208 +size 4932946624 diff --git a/Orvex-Alpha-v1.i1-IQ3_M.gguf b/Orvex-Alpha-v1.i1-IQ3_M.gguf new file mode 100644 index 0000000..4b9f8dc --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd868fac61da6e1f3b141674490977bcb81743ae4ba7581ab362bf49ecded4d9 +size 8193280704 diff --git a/Orvex-Alpha-v1.i1-IQ3_S.gguf b/Orvex-Alpha-v1.i1-IQ3_S.gguf new file mode 100644 index 0000000..00f8dd0 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e90e966df24abea9f979645477cd27e56d2bdfc4a8cb3d485a39cb66b06aac7a +size 8028392128 diff --git a/Orvex-Alpha-v1.i1-IQ3_XS.gguf b/Orvex-Alpha-v1.i1-IQ3_XS.gguf new file mode 100644 index 0000000..5c387c9 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d5db92c4b7182b3a1ec60d56ca18f2bbf289d41e590bcc8e896b6e58a3dca514 +size 7600573120 diff --git a/Orvex-Alpha-v1.i1-IQ3_XXS.gguf b/Orvex-Alpha-v1.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..5ef36a2 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3593134b94780e83703dd9d330705a7ebab3a3b1f9e794c63c6450799f8b70e8 +size 7144860352 diff --git a/Orvex-Alpha-v1.i1-IQ4_NL.gguf b/Orvex-Alpha-v1.i1-IQ4_NL.gguf new file mode 100644 index 0000000..fe7ff30 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:64690979f5bd83c1f35cdc382377a917bfc4abc36d20f114b5ecc75d4c4519fd +size 10469059264 diff --git a/Orvex-Alpha-v1.i1-IQ4_XS.gguf b/Orvex-Alpha-v1.i1-IQ4_XS.gguf new file mode 100644 index 0000000..5699ad9 --- /dev/null +++ b/Orvex-Alpha-v1.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8cb7c22885a38c0d61f976ccccde659825eaf2bca8255c4477fe0c735c92d566 +size 9898732224 diff --git a/Orvex-Alpha-v1.i1-Q2_K.gguf b/Orvex-Alpha-v1.i1-Q2_K.gguf new file mode 100644 index 0000000..f3e44fd --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2eb33615794c88e8913bb50a05a11439897efcde159c603f08d4670e813ddee4 +size 6801877696 diff --git a/Orvex-Alpha-v1.i1-Q2_K_S.gguf b/Orvex-Alpha-v1.i1-Q2_K_S.gguf new file mode 100644 index 0000000..c36cff8 --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:297896db85908ce48166a15b8bdb4cff2fc463c5ad3e6096c650d1eb0f8228e4 +size 6339979968 diff --git a/Orvex-Alpha-v1.i1-Q3_K_L.gguf b/Orvex-Alpha-v1.i1-Q3_K_L.gguf new file mode 100644 index 0000000..2ece18d --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb11ba0e39cc9f72fd0e250b960f3ee64f70dc682979e37fb3266466795c3ac2 +size 9636907712 diff --git a/Orvex-Alpha-v1.i1-Q3_K_M.gguf b/Orvex-Alpha-v1.i1-Q3_K_M.gguf new file mode 100644 index 0000000..07168ee --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ae8331b377aebb23110238d2960d0c337b8757888987ee1a049e2403e5f8c52d +size 8893467328 diff --git a/Orvex-Alpha-v1.i1-Q3_K_S.gguf b/Orvex-Alpha-v1.i1-Q3_K_S.gguf new file mode 100644 index 0000000..bd16663 --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1addb14af617a437a43293f489e6b3dbb30d3483085fde374ed3f367df6faccc +size 8010566336 diff --git a/Orvex-Alpha-v1.i1-Q4_0.gguf b/Orvex-Alpha-v1.i1-Q4_0.gguf new file mode 100644 index 0000000..fd9651b --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95b82652587070af0f91e1e8cc0e1075eff259a14d7e0907c7caea2eb53d8756 +size 10496322240 diff --git a/Orvex-Alpha-v1.i1-Q4_1.gguf b/Orvex-Alpha-v1.i1-Q4_1.gguf new file mode 100644 index 0000000..cbd51fb --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a433b3f79b5e4a39833b9203c2812e4eb3c6ddcf723b9feb18be5f9599765094 +size 11601324736 diff --git a/Orvex-Alpha-v1.i1-Q4_K_M.gguf b/Orvex-Alpha-v1.i1-Q4_K_M.gguf new file mode 100644 index 0000000..fdd78b6 --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:304a68599b194247195894a5c57a8e05d99e5433fc11ae41be4b0dc9e213b937 +size 11196246720 diff --git a/Orvex-Alpha-v1.i1-Q4_K_S.gguf b/Orvex-Alpha-v1.i1-Q4_K_S.gguf new file mode 100644 index 0000000..b04033d --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9eba02878ecde808e2d0cccaeb85439ac7e28d2985673430f4378e8f1e6b0f0d +size 10542459584 diff --git a/Orvex-Alpha-v1.i1-Q5_K_M.gguf b/Orvex-Alpha-v1.i1-Q5_K_M.gguf new file mode 100644 index 0000000..2692386 --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:679fc434fcb1de38e7d1907514408256c6fb1b77446b56c64e2ee08488deaa95 +size 13133621952 diff --git a/Orvex-Alpha-v1.i1-Q5_K_S.gguf b/Orvex-Alpha-v1.i1-Q5_K_S.gguf new file mode 100644 index 0000000..3d23872 --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ab2c24277e9fad191689aaf09cd7c2e2da41da374642c6b12b2ca8ddb0a7afb3 +size 12750367424 diff --git a/Orvex-Alpha-v1.i1-Q6_K.gguf b/Orvex-Alpha-v1.i1-Q6_K.gguf new file mode 100644 index 0000000..c9041c1 --- /dev/null +++ b/Orvex-Alpha-v1.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:30b0ef404486a2333f82cb504c28dec9c969554e92a6fe8008948c30c4c5a703 +size 15192083136 diff --git a/Orvex-Alpha-v1.imatrix.gguf b/Orvex-Alpha-v1.imatrix.gguf new file mode 100644 index 0000000..ceeb9c6 --- /dev/null +++ b/Orvex-Alpha-v1.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e45509d26accd0a629870b1a2a927214a14eaafa27db5bd402cba7f6162c9f6e +size 11314368 diff --git a/README.md b/README.md new file mode 100644 index 0000000..2bf4fc0 --- /dev/null +++ b/README.md @@ -0,0 +1,93 @@ +--- +base_model: Orvex/Orvex-Alpha-v1 +language: +- si +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- si-en +- merge +- mixtral +- moe +- orvex +- sinhala +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/Orvex/Orvex-Alpha-v1 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Orvex-Alpha-v1-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Orvex-Alpha-v1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 4.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 4.4 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 5.0 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 5.6 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 6.3 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 6.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q2_K.gguf) | i1-Q2_K | 6.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 7.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 7.7 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 8.1 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 8.1 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 8.3 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 9.0 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 9.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 10.0 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 10.6 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q4_0.gguf) | i1-Q4_0 | 10.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 10.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 11.3 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q4_1.gguf) | i1-Q4_1 | 11.7 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 12.9 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 13.2 | | +| [GGUF](https://huggingface.co/mradermacher/Orvex-Alpha-v1-i1-GGUF/resolve/main/Orvex-Alpha-v1.i1-Q6_K.gguf) | i1-Q6_K | 15.3 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +