初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
ArcherCodeR-1.5B-DAPO.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ1_M.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:01cab312879246de25bdb791e65af7d8fe731812bb5edac82c481ab75f3f77dc
|
||||
size 541037824
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ1_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:80e1bb6a2b79c0039db81425d3acba8c59e2dd67afd49d80af3f3d3c9da5c1af
|
||||
size 513104128
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_M.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b8659ecf7b717863c1adde6f939304b8cc0e082d82023d78bf9fdaa0ed2b0708
|
||||
size 701333248
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7294f6ef2a8f3fb4d8c1b0329673cec8be3dff689cf3fcf4a9d0b17ffbafd736
|
||||
size 664088320
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_XS.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:049ddafd45dd2641b021490bd095c4f8a4451693dfb6581d25aa0fa29f179be1
|
||||
size 626903296
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_XXS.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:66196f75dd1f0d428425741b12e1f3cec502e6cf7ffd049e350c689eeef5ab2a
|
||||
size 587593984
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_M.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6f506348121b82ba0c726a36bab7eb3a3d054f0a19acf081516305f65e07eb10
|
||||
size 876942592
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:828d0199cef2f7028025d4b46ff23de3341666875191056179d5b3696186bb79
|
||||
size 862685440
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_XS.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7c2390c9c4f3bbc50c2ec51848955f2980be1692cad61c77675db073389e2cc2
|
||||
size 831977728
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_XXS.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7932f263d476b2602963b7b9379217c221dcc049f5022a26b7675e4ccd0a8b28
|
||||
size 769070848
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ4_NL.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e52f281a679f38cb04a7ae8b473b1ea746b8e373082e4b29b2e3427043a54352
|
||||
size 1067604736
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-IQ4_XS.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d73dc418db7795fb947dc256b7ff35c34a38def9a4e9498c489e047af74d9c97
|
||||
size 1019712256
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q2_K.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:47a64f25ef50a114b74dddc317d8b9a00d29cb991114a2eb1e2450fbae2a6869
|
||||
size 752881408
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q2_K_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d185262d057bfc723bb7d53e7a2c4c4df6aa0161ced8f80d3150e3f1241f61c0
|
||||
size 716711680
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q3_K_L.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f80fd5374e8f283ed24649f094eb088c1a6f47f99c6689bb6629db276fad888a
|
||||
size 980441344
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q3_K_M.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:eedb81a809858f854d75aad57b2fa0867a18708b37dc80792f7135ad54ec9f2a
|
||||
size 924457216
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q3_K_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e4c9e4da9205e3c4a94bc08019fcea72c70bbcca36ba7194dd2bdda08f19ed2a
|
||||
size 861223168
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q4_0.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fe7d8ac43fbed1ed1ec79b8436ca30f3604a28c518fe8ce76ee94eca62ecd323
|
||||
size 1068808960
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q4_1.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:76df31736e939f6a168deb23ab03cbc6aeef7654bf1e10198871867be690b18f
|
||||
size 1162701568
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q4_K_M.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:31c74298db6329c593f07fa62ae27e66272e4c53c02edbc34332be330b2ca9b6
|
||||
size 1117321984
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q4_K_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1f067bc98ceabd9dcd7519fd3041e5f52f1d5ac8d791886d7c510691e5245339
|
||||
size 1071586048
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q5_K_M.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bb9df9175ffadf9b2f49e9c925c8b4b434f666ceb6fd614287e1e78f56ad6a75
|
||||
size 1285495552
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q5_K_S.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8181456e9ccf4ead52f0b4d3d19c77e31897400b5919d26b3b32c7ea3af52c8e
|
||||
size 1259174656
|
||||
3
ArcherCodeR-1.5B-DAPO.i1-Q6_K.gguf
Normal file
3
ArcherCodeR-1.5B-DAPO.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:25747ed6a0d9b1d6796d4b7e750803bda4a9588f5b306132942fbc9199a2c4ce
|
||||
size 1464179968
|
||||
85
README.md
Normal file
85
README.md
Normal file
@@ -0,0 +1,85 @@
|
||||
---
|
||||
base_model: wizardII/ArcherCodeR-1.5B-DAPO
|
||||
datasets:
|
||||
- wizardII/ArcherCodeR-Dataset
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: mit
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- code
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/wizardII/ArcherCodeR-1.5B-DAPO
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#ArcherCodeR-1.5B-DAPO-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/ArcherCodeR-1.5B-DAPO-i1-GGUF/resolve/main/ArcherCodeR-1.5B-DAPO.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:11b6ee1f52669d161a7ab3b7e0c25c334fe3562bce8c1c82e0f8a3b4430eabd3
|
||||
size 2042201
|
||||
Reference in New Issue
Block a user