commit 8bd30639f8e2301804692c1a5ed3643923a9963f Author: ModelHub XC Date: Sun Jun 21 01:06:23 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Fathom-R1-14B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..d900208 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Fathom-R1-14B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Fathom-R1-14B.i1-IQ1_M.gguf b/Fathom-R1-14B.i1-IQ1_M.gguf new file mode 100644 index 0000000..4f4bb08 --- /dev/null +++ b/Fathom-R1-14B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e9d031d2ad6bb960f5e2e1c5b193007d4c53dad6fa634151071750548f48cd9f +size 3872309056 diff --git a/Fathom-R1-14B.i1-IQ1_S.gguf b/Fathom-R1-14B.i1-IQ1_S.gguf new file mode 100644 index 0000000..e6c046d --- /dev/null +++ b/Fathom-R1-14B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e613c4c3ab9da87f93a4338ad4f298f6a90231a6d25fdecda7928dbad2a1f3b +size 3607994176 diff --git a/Fathom-R1-14B.i1-IQ2_M.gguf b/Fathom-R1-14B.i1-IQ2_M.gguf new file mode 100644 index 0000000..e5363bb --- /dev/null +++ b/Fathom-R1-14B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17e2f9dbc9b830df0ad2ce7200db5c439909f053547444b0160d54a3e48b56f3 +size 5356146496 diff --git a/Fathom-R1-14B.i1-IQ2_S.gguf b/Fathom-R1-14B.i1-IQ2_S.gguf new file mode 100644 index 0000000..74470ac --- /dev/null +++ b/Fathom-R1-14B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:001b80cc977b7be9a6d5f72675088154a89a239d8ba9251f71de3e5059251897 +size 5003726656 diff --git a/Fathom-R1-14B.i1-IQ2_XS.gguf b/Fathom-R1-14B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..bdbff87 --- /dev/null +++ b/Fathom-R1-14B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:19b27bceb027e192893a36923f6598f6aa5769f3f5ddb4e4703799002e50345b +size 4704575296 diff --git a/Fathom-R1-14B.i1-IQ2_XXS.gguf b/Fathom-R1-14B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..6ca9b70 --- /dev/null +++ b/Fathom-R1-14B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d73eca234949596cd9cd39efd76cf9654e81ee65df4d5266f6d88815b361e49 +size 4312833856 diff --git a/Fathom-R1-14B.i1-IQ3_M.gguf b/Fathom-R1-14B.i1-IQ3_M.gguf new file mode 100644 index 0000000..e9456aa --- /dev/null +++ b/Fathom-R1-14B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4925228535189f86c89809d7556f5f5df278cbe810ae457da6ba977bed47b79 +size 6916538176 diff --git a/Fathom-R1-14B.i1-IQ3_S.gguf b/Fathom-R1-14B.i1-IQ3_S.gguf new file mode 100644 index 0000000..6347b67 --- /dev/null +++ b/Fathom-R1-14B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:430b46382a2ce1b32d5e3d45cab76f05ffbd0c4554b35c169ed4929742580a85 +size 6693019456 diff --git a/Fathom-R1-14B.i1-IQ3_XS.gguf b/Fathom-R1-14B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..6946763 --- /dev/null +++ b/Fathom-R1-14B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1dbf62d874e4c7dc0d061b98ee37de5f4f48cd608bd37a32567bfe78ffd1b1e5 +size 6383361856 diff --git a/Fathom-R1-14B.i1-IQ3_XXS.gguf b/Fathom-R1-14B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..a08a7ee --- /dev/null +++ b/Fathom-R1-14B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:34754e36f704370939b17b0f6b54ffecf866742eb59cbcfaa75ad958a2bff12e +size 5946707776 diff --git a/Fathom-R1-14B.i1-IQ4_NL.gguf b/Fathom-R1-14B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..eaddd4a --- /dev/null +++ b/Fathom-R1-14B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dabbadb37363315328f2c11176c5b9ae4d054367fa6480dac69ef9acdddc0739 +size 8549183296 diff --git a/Fathom-R1-14B.i1-IQ4_XS.gguf b/Fathom-R1-14B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..1f93dc0 --- /dev/null +++ b/Fathom-R1-14B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:01b190748c60c2888a5fbe16b1346b8d9e37c723d5c18329e769220589e556af +size 8119840576 diff --git a/Fathom-R1-14B.i1-Q2_K.gguf b/Fathom-R1-14B.i1-Q2_K.gguf new file mode 100644 index 0000000..41afc17 --- /dev/null +++ b/Fathom-R1-14B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:63f22806e8d637cfeb05286a2d0a53aef6e59844b550d861876adab18d450165 +size 5770497856 diff --git a/Fathom-R1-14B.i1-Q2_K_S.gguf b/Fathom-R1-14B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..2aef127 --- /dev/null +++ b/Fathom-R1-14B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4b030daf139a2d77cb861375d4763192188957a33d2b43c62928f4e44322aeb3 +size 5397188416 diff --git a/Fathom-R1-14B.i1-Q3_K_L.gguf b/Fathom-R1-14B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..6dd3a6c --- /dev/null +++ b/Fathom-R1-14B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ac5658debd346e64205ac1ed4cb593df91dbfbc8cfc826192eac70838e88b6a3 +size 7924768576 diff --git a/Fathom-R1-14B.i1-Q3_K_M.gguf b/Fathom-R1-14B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..a285bae --- /dev/null +++ b/Fathom-R1-14B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e3e2b9c239ec0af9099797c59038988c0c3400bcf40f3c1e175c8225f62abf59 +size 7339204416 diff --git a/Fathom-R1-14B.i1-Q3_K_S.gguf b/Fathom-R1-14B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..b70f0f8 --- /dev/null +++ b/Fathom-R1-14B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:366928917f797aa9b14b895e60e3c89d054a097b868802f042438bb2349ab682 +size 6659596096 diff --git a/Fathom-R1-14B.i1-Q4_0.gguf b/Fathom-R1-14B.i1-Q4_0.gguf new file mode 100644 index 0000000..e0b7c3d --- /dev/null +++ b/Fathom-R1-14B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4aa9d55d79a11c8b84652aca2c7b714bec72f228dfb4384b7e9d33d57e74eab7 +size 8544268096 diff --git a/Fathom-R1-14B.i1-Q4_1.gguf b/Fathom-R1-14B.i1-Q4_1.gguf new file mode 100644 index 0000000..ccb39fc --- /dev/null +++ b/Fathom-R1-14B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d71336af836fd1fc519ca3075419724db898428852c7c4e621c2192b25c76887 +size 9392140096 diff --git a/Fathom-R1-14B.i1-Q4_K_M.gguf b/Fathom-R1-14B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..16a03a7 --- /dev/null +++ b/Fathom-R1-14B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3e6f0e0c0a2d88a9971845a66a12e1b19cd278623e4f6149519b4e3745e383c0 +size 8988110656 diff --git a/Fathom-R1-14B.i1-Q4_K_S.gguf b/Fathom-R1-14B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..c2b1061 --- /dev/null +++ b/Fathom-R1-14B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:092ebb49de992fb0e579491770960ff50137f92d0f327b3bd93623c1828ce298 +size 8573431616 diff --git a/Fathom-R1-14B.i1-Q5_K_M.gguf b/Fathom-R1-14B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..872b1c1 --- /dev/null +++ b/Fathom-R1-14B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc8934563f9bd2e46840e05e8755fa9456081271c91371d36bcd8f9d85caeb7f +size 10508873536 diff --git a/Fathom-R1-14B.i1-Q5_K_S.gguf b/Fathom-R1-14B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..2fa8715 --- /dev/null +++ b/Fathom-R1-14B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c8267bd8adee6d007d305c41220a962e3cbd263a2b70decb4a876f1537d52fb6 +size 10266554176 diff --git a/Fathom-R1-14B.i1-Q6_K.gguf b/Fathom-R1-14B.i1-Q6_K.gguf new file mode 100644 index 0000000..6e7602f --- /dev/null +++ b/Fathom-R1-14B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b68147c0e2f0d0f2e77bd706fa646f9533283e5a7a2192904d42391786e4d12b +size 12124684096 diff --git a/README.md b/README.md new file mode 100644 index 0000000..cae9287 --- /dev/null +++ b/README.md @@ -0,0 +1,79 @@ +--- +base_model: FractalAIResearch/Fathom-R1-14B +datasets: +- FractalAIResearch/Fathom-V0.4-SFT-Shortest-Chains +- FractalAIResearch/Fathom-V0.6-Iterative-Curriculum-Learning +language: +- en +library_name: transformers +license: mit +quantized_by: mradermacher +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/FractalAIResearch/Fathom-R1-14B + + +static quants are available at https://huggingface.co/mradermacher/Fathom-R1-14B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | | +| [GGUF](https://huggingface.co/mradermacher/Fathom-R1-14B-i1-GGUF/resolve/main/Fathom-R1-14B.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..8aa664a --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:27b8e5d3ba7a96d56bffa3548eed31f3eee52380f4e5c70f629bc8936deea6c6 +size 8563597