commit c91d6d32193ef16ab43f8984d26a7e39ec3e1fb8 Author: ModelHub XC Date: Fri May 8 23:58:47 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Accord-8B-Model_Stock-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..feb3467 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Accord-8B-Model_Stock.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Accord-8B-Model_Stock.i1-IQ1_M.gguf b/Accord-8B-Model_Stock.i1-IQ1_M.gguf new file mode 100644 index 0000000..170ead9 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:245e414669c2f16d1e0e048823d592fc57a8433d5f1ceb8b7864c50ac0dc739d +size 2161974592 diff --git a/Accord-8B-Model_Stock.i1-IQ1_S.gguf b/Accord-8B-Model_Stock.i1-IQ1_S.gguf new file mode 100644 index 0000000..f59e94d --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1cda0fe7e53cadb2523db6b35d017d0bdd64fbb99e780b755f74b88db4f1e812 +size 2019630400 diff --git a/Accord-8B-Model_Stock.i1-IQ2_M.gguf b/Accord-8B-Model_Stock.i1-IQ2_M.gguf new file mode 100644 index 0000000..5c06aca --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:40049f8e14e2ec0f33618a1ef5dae611ede1e715419a1586ec23840aa200958d +size 2948283712 diff --git a/Accord-8B-Model_Stock.i1-IQ2_S.gguf b/Accord-8B-Model_Stock.i1-IQ2_S.gguf new file mode 100644 index 0000000..3518dc6 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:99ff584bb785c604b967ae9a68186193095a1fc321b7db5204d0df82e99f7c88 +size 2758491456 diff --git a/Accord-8B-Model_Stock.i1-IQ2_XS.gguf b/Accord-8B-Model_Stock.i1-IQ2_XS.gguf new file mode 100644 index 0000000..32ffbaf --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1257b574a0ab89df54c153dc98fa27c8c4bb542e89618f1e5ef19b4366deb69d +size 2605784384 diff --git a/Accord-8B-Model_Stock.i1-IQ2_XXS.gguf b/Accord-8B-Model_Stock.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..408fa3d --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dc71ca029264fe2d7625f0c9d637ee9a63b6e85dfda02e9ac72986f321479f1e +size 2399214912 diff --git a/Accord-8B-Model_Stock.i1-IQ3_M.gguf b/Accord-8B-Model_Stock.i1-IQ3_M.gguf new file mode 100644 index 0000000..0bc2341 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:615c59ec5fb92440f7fd865e2a1a7e5847faf376a4e6698de461b9eb244d22e9 +size 3784826176 diff --git a/Accord-8B-Model_Stock.i1-IQ3_S.gguf b/Accord-8B-Model_Stock.i1-IQ3_S.gguf new file mode 100644 index 0000000..233c254 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dc3a4273f5782bceb4607fe0912a569011a2158fec91db3c26e6114ea969ed9d +size 3682327872 diff --git a/Accord-8B-Model_Stock.i1-IQ3_XS.gguf b/Accord-8B-Model_Stock.i1-IQ3_XS.gguf new file mode 100644 index 0000000..06211ab --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3c433d44a5165e72723368ab49024ce0cf69ac455c7bad5c2e43aa296de9e2f8 +size 3518750016 diff --git a/Accord-8B-Model_Stock.i1-IQ3_XXS.gguf b/Accord-8B-Model_Stock.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..3751dfc --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:303ba0943866e6b91bd107a59d6ab9c026e57f00d9c6a12a8180eb54c3068bbc +size 3274915136 diff --git a/Accord-8B-Model_Stock.i1-IQ4_NL.gguf b/Accord-8B-Model_Stock.i1-IQ4_NL.gguf new file mode 100644 index 0000000..548175d --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fcb658ed1c8e59dc4cbfb28b1e85d8f1e46fdb2f3dcc2c919d4e2cf48ce178de +size 4677991744 diff --git a/Accord-8B-Model_Stock.i1-IQ4_XS.gguf b/Accord-8B-Model_Stock.i1-IQ4_XS.gguf new file mode 100644 index 0000000..e0c385d --- /dev/null +++ b/Accord-8B-Model_Stock.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4aaee3357ddffff67122f1f1b3b310cbbf44a008ca6a007485e6ee3c7dfa21a0 +size 4447665472 diff --git a/Accord-8B-Model_Stock.i1-Q2_K.gguf b/Accord-8B-Model_Stock.i1-Q2_K.gguf new file mode 100644 index 0000000..0b5d29d --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95affd810426e0dfd11e577360bf28100418550188b3d727e3a175885f5c02d6 +size 3179134272 diff --git a/Accord-8B-Model_Stock.i1-Q2_K_S.gguf b/Accord-8B-Model_Stock.i1-Q2_K_S.gguf new file mode 100644 index 0000000..d4c76c6 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b50112fc6911a094e74344c8df74a483fefe69782ada304dd7bf994bf95f850a +size 2988817728 diff --git a/Accord-8B-Model_Stock.i1-Q3_K_L.gguf b/Accord-8B-Model_Stock.i1-Q3_K_L.gguf new file mode 100644 index 0000000..958f4f5 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f8e03df057af441712b7f52dc8a4a6c92d3c664caf97f9ed65b593ed8bf83fb2 +size 4321959232 diff --git a/Accord-8B-Model_Stock.i1-Q3_K_M.gguf b/Accord-8B-Model_Stock.i1-Q3_K_M.gguf new file mode 100644 index 0000000..5eea053 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d7da8969ed4082c53119a5aed554d22fd60c51e1d6ba63199431e8debc3c1c08 +size 4018920768 diff --git a/Accord-8B-Model_Stock.i1-Q3_K_S.gguf b/Accord-8B-Model_Stock.i1-Q3_K_S.gguf new file mode 100644 index 0000000..86a1334 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eca2676c999cf4ea97ffa60dc9cee4c859f73338add8532e91faafbd888d0446 +size 3664502080 diff --git a/Accord-8B-Model_Stock.i1-Q4_0.gguf b/Accord-8B-Model_Stock.i1-Q4_0.gguf new file mode 100644 index 0000000..0301e85 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e69d27d94b6ffdbfbcfe0f5bcde1cd2568c0029f9b182450d3cd1682fde53fdb +size 4675894592 diff --git a/Accord-8B-Model_Stock.i1-Q4_1.gguf b/Accord-8B-Model_Stock.i1-Q4_1.gguf new file mode 100644 index 0000000..297ec77 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4881a9410eec4d83793e7d921df8d0bdadd7667841fbd7ff3674332e64276a2 +size 5130255680 diff --git a/Accord-8B-Model_Stock.i1-Q4_K_M.gguf b/Accord-8B-Model_Stock.i1-Q4_K_M.gguf new file mode 100644 index 0000000..7699710 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5891672321642806a791c9faf6b7a4029ccdf87fb60748d98f739a860b72e879 +size 4920737088 diff --git a/Accord-8B-Model_Stock.i1-Q4_K_S.gguf b/Accord-8B-Model_Stock.i1-Q4_K_S.gguf new file mode 100644 index 0000000..0ef8c1d --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b47f11f9d8d695ccb239e2f4ee6000b6e85c74bc5b9485f28c2670b170944e80 +size 4692671808 diff --git a/Accord-8B-Model_Stock.i1-Q5_K_M.gguf b/Accord-8B-Model_Stock.i1-Q5_K_M.gguf new file mode 100644 index 0000000..6409d83 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17bca32937dfa811b6232f555c2ef4bbcb6a3d377b8b912da3a84e432665e7f1 +size 5732990272 diff --git a/Accord-8B-Model_Stock.i1-Q5_K_S.gguf b/Accord-8B-Model_Stock.i1-Q5_K_S.gguf new file mode 100644 index 0000000..b7afc12 --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b177a83814f0c7c93ed248320470c060404f2233653bdf6438f42fa73a3796b8 +size 5599296832 diff --git a/Accord-8B-Model_Stock.i1-Q6_K.gguf b/Accord-8B-Model_Stock.i1-Q6_K.gguf new file mode 100644 index 0000000..7b8c30e --- /dev/null +++ b/Accord-8B-Model_Stock.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0882b28f0b59653febeb4a06bb3d451d09ab688de5e91ae7d1b73860d9ffb91b +size 6596009280 diff --git a/README.md b/README.md new file mode 100644 index 0000000..e7d1efd --- /dev/null +++ b/README.md @@ -0,0 +1,79 @@ +--- +base_model: DreadPoor/Accord-8B-Model_Stock +language: +- en +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +tags: +- mergekit +- merge +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/DreadPoor/Accord-8B-Model_Stock + + +static quants are available at https://huggingface.co/mradermacher/Accord-8B-Model_Stock-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Accord-8B-Model_Stock-i1-GGUF/resolve/main/Accord-8B-Model_Stock.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..1d4afbb --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:96ffe2be12549260150cf431001783b7d78808d086ab87d8c902ea5cbda25c8e +size 4988157