初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Standard-1.7B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Standard-1.7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
91
README.md
Normal file
91
README.md
Normal file
@@ -0,0 +1,91 @@
|
|||||||
|
---
|
||||||
|
arxiv: 2511.08577
|
||||||
|
base_model: nics-efc/Standard-1.7B
|
||||||
|
datasets:
|
||||||
|
- open-r1/Mixture-of-Thoughts
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: apache-2.0
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- reasoning
|
||||||
|
- looped transformer
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/nics-efc/Standard-1.7B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Standard-1.7B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/Standard-1.7B-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Standard-1.7B-i1-GGUF/resolve/main/Standard-1.7B.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
3
Standard-1.7B.i1-IQ1_M.gguf
Normal file
3
Standard-1.7B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a1c98deda1ec087492ffd16cca1d80919077efb1036f5a4e375281f5b6de07b8
|
||||||
|
size 543794144
|
||||||
3
Standard-1.7B.i1-IQ1_S.gguf
Normal file
3
Standard-1.7B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a17f9ea2689a788017132248a29722db8f6bd5f7295f5d764ca7e56f10ed6200
|
||||||
|
size 515777504
|
||||||
3
Standard-1.7B.i1-IQ2_M.gguf
Normal file
3
Standard-1.7B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:64ca0388b594c80666e9ae1a8ccd85830878d59de2a117db31da7409142e5d31
|
||||||
|
size 695182304
|
||||||
3
Standard-1.7B.i1-IQ2_S.gguf
Normal file
3
Standard-1.7B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e239b182e31d85b2c840955477c3193ddf2fe434ec407dc13db775dbeae41475
|
||||||
|
size 657826784
|
||||||
3
Standard-1.7B.i1-IQ2_XS.gguf
Normal file
3
Standard-1.7B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:688ce55c1e70c7263e509d486fcd99af9ed16d6a0805549b115b0539bd93a031
|
||||||
|
size 631514080
|
||||||
3
Standard-1.7B.i1-IQ2_XXS.gguf
Normal file
3
Standard-1.7B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:da142844a35454e7d712ed7d6edb73c9f46f50e5455972040403a7960ddc0f89
|
||||||
|
size 590488544
|
||||||
3
Standard-1.7B.i1-IQ3_M.gguf
Normal file
3
Standard-1.7B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cc0f53532118ebfdfc22854514f9160389431da7237bdd27a4576f0d46da2a53
|
||||||
|
size 895663072
|
||||||
3
Standard-1.7B.i1-IQ3_S.gguf
Normal file
3
Standard-1.7B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:787e9fc3c9f508c5ce6ea90997ceffbe48b17b5699b7d4c1d693732fc0cbd247
|
||||||
|
size 867253216
|
||||||
3
Standard-1.7B.i1-IQ3_XS.gguf
Normal file
3
Standard-1.7B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ca87f65b494e51a0ba4ba929b49c91508e2ecb78b40bd284d3025054263f1ac3
|
||||||
|
size 834223072
|
||||||
3
Standard-1.7B.i1-IQ3_XXS.gguf
Normal file
3
Standard-1.7B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ad7e26641590cd411522ca45230b35755e0200d462cd3107e90e1b8533958379
|
||||||
|
size 754361312
|
||||||
3
Standard-1.7B.i1-IQ4_NL.gguf
Normal file
3
Standard-1.7B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f8319911cc99a050afce7d17a0d448ca024ff0817a4e54b64fc2bba7e4a3cc6b
|
||||||
|
size 1054424032
|
||||||
3
Standard-1.7B.i1-IQ4_XS.gguf
Normal file
3
Standard-1.7B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a0fc88fedac4d576ca26511a61062354ff5aa834e334f186ad22485613f15d01
|
||||||
|
size 1010383840
|
||||||
3
Standard-1.7B.i1-Q2_K.gguf
Normal file
3
Standard-1.7B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e91b7836b43bdf3d8cd58913c4eacb19b161a868806ec6d4e81719d98343d759
|
||||||
|
size 777796576
|
||||||
3
Standard-1.7B.i1-Q2_K_S.gguf
Normal file
3
Standard-1.7B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8dc0cc4bf1b1a7d5fe1b765885c7168fe77015ddca3024feba93dfd3eca0a964
|
||||||
|
size 732969952
|
||||||
3
Standard-1.7B.i1-Q3_K_L.gguf
Normal file
3
Standard-1.7B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0f69cd96350cd8d87b449728488d86ca13e2fde0a23d39fc8011724ddae5e38e
|
||||||
|
size 1003502560
|
||||||
3
Standard-1.7B.i1-Q3_K_M.gguf
Normal file
3
Standard-1.7B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1ebcb12631b33c82af1586367f7d7302143955ddc6bb921ffa68ed25e5c6479a
|
||||||
|
size 939539424
|
||||||
3
Standard-1.7B.i1-Q3_K_S.gguf
Normal file
3
Standard-1.7B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b4c411282d78be99c851bf3f50069ff5c907d8f6679bd762903a57a549ff47fd
|
||||||
|
size 867253216
|
||||||
3
Standard-1.7B.i1-Q4_0.gguf
Normal file
3
Standard-1.7B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:61a4093b6d1a9a63799a85546c9cdce3f51c8cde64f14976b66fe896c76692ca
|
||||||
|
size 1056783328
|
||||||
3
Standard-1.7B.i1-Q4_1.gguf
Normal file
3
Standard-1.7B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:59bd9d24014c3081479ea0347f27e392cf62b0b9099ca0733907c68ad22a178d
|
||||||
|
size 1142504416
|
||||||
3
Standard-1.7B.i1-Q4_K_M.gguf
Normal file
3
Standard-1.7B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:41a6b8c149686a67e55c961aff6320d9938ae573cb5bed0edb058bd9b710c0e4
|
||||||
|
size 1107409888
|
||||||
3
Standard-1.7B.i1-Q4_K_S.gguf
Normal file
3
Standard-1.7B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e702c42df1a4532255c4e1be57b2981e0d2413eaa8fba7600e2761e80b1f92b2
|
||||||
|
size 1060191200
|
||||||
3
Standard-1.7B.i1-Q5_K_M.gguf
Normal file
3
Standard-1.7B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:61659ed78778ae0414d1722b12d082fab16982aaf25e74b73bf19a493323694a
|
||||||
|
size 1257880544
|
||||||
3
Standard-1.7B.i1-Q5_K_S.gguf
Normal file
3
Standard-1.7B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:43281550e7c569f3d423391748e20aac9dda16cc487abd23cb55abcd2bc26e8f
|
||||||
|
size 1230584800
|
||||||
3
Standard-1.7B.i1-Q6_K.gguf
Normal file
3
Standard-1.7B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6954a0a28c59fd9e8fb310b52a2ce0ded61002ad3162e7659a0feb11790b4203
|
||||||
|
size 1417755616
|
||||||
3
Standard-1.7B.imatrix.gguf
Normal file
3
Standard-1.7B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:06bf603fe8d53a9eb96eaae048b67b2e60004ec78655d143a444e0bc6e5eb903
|
||||||
|
size 2094560
|
||||||
Reference in New Issue
Block a user