初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF Source: Original Platform
This commit is contained in:
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen2.5-0.5B-Portuguese-v2.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.IQ4_XS.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:af794ed119d9adb9ad2802797fe0f064c0c71e5ca534cbd335778464f4df99a6
|
||||||
|
size 351446464
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q2_K.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d036ff3ee79b5b97c5e724fb8b1d005efff3c194b74b1f2d0c9b54526c315226
|
||||||
|
size 338608576
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q3_K_L.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:305c43b31a44496e1ad5083eb94efab84761ab4f780b6ca1dca328536881e938
|
||||||
|
size 369359296
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q3_K_M.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6618d1a5d6b469ce5c0818641ecdfef4cf4b15b2ccf94a65a9d6a97f1ca0abae
|
||||||
|
size 355467712
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q3_K_S.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9ebd913d53638ad31320591c84d9830488049d1eb093ae48c76e35890918d4bb
|
||||||
|
size 338264512
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q4_K_M.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:427a1aec2308e2f6776d7702c987e44ff52579b63a38f3f926605ef4645c288a
|
||||||
|
size 397809088
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q4_K_S.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ed0f19e1aa077fbd21ecbf90e3ecc3a89685139bf8bd364536090d25dcc13e5c
|
||||||
|
size 385472960
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q5_K_M.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0b458acb5568c35eaf2bd9dc6d739fd8ee4c080dc15d99a336ebc577c0b9058e
|
||||||
|
size 420087232
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q5_K_S.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b7ec22c598a2ce399caae202e4c6139495fed9d8de64b2d36d90968b771de559
|
||||||
|
size 412711360
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q6_K.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e1e18f1c6e8bcf1102709769196994c97b21c4fc068483719d81aecbd8669d75
|
||||||
|
size 505737664
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.Q8_0.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ab9abeda22485c6fc86f86e1a0be89fab404e4a5b7d5d030766d2e0f6f99d7c8
|
||||||
|
size 531069376
|
||||||
3
Qwen2.5-0.5B-Portuguese-v2.f16.gguf
Normal file
3
Qwen2.5-0.5B-Portuguese-v2.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ba99d3d8c0b287f5a8b53a902257d297a61baa871bb83f080ccaf2b3f6da203e
|
||||||
|
size 994158016
|
||||||
69
README.md
Normal file
69
README.md
Normal file
@@ -0,0 +1,69 @@
|
|||||||
|
---
|
||||||
|
base_model: cnmoro/Qwen2.5-0.5B-Portuguese-v2
|
||||||
|
datasets:
|
||||||
|
- adalbertojunior/openHermes_portuguese
|
||||||
|
- cnmoro/smoltalk-555k-ptbr
|
||||||
|
- cnmoro/RagMixPTBR-Legal-Alpaca-2M
|
||||||
|
- adalbertojunior/dolphin-2.9-portuguese
|
||||||
|
language:
|
||||||
|
- pt
|
||||||
|
library_name: transformers
|
||||||
|
license: mit
|
||||||
|
quantized_by: mradermacher
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: -->
|
||||||
|
static quants of https://huggingface.co/cnmoro/Qwen2.5-0.5B-Portuguese-v2
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q3_K_S.gguf) | Q3_K_S | 0.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q2_K.gguf) | Q2_K | 0.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.IQ4_XS.gguf) | IQ4_XS | 0.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q3_K_M.gguf) | Q3_K_M | 0.5 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q3_K_L.gguf) | Q3_K_L | 0.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q4_K_S.gguf) | Q4_K_S | 0.5 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q4_K_M.gguf) | Q4_K_M | 0.5 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q5_K_S.gguf) | Q5_K_S | 0.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q5_K_M.gguf) | Q5_K_M | 0.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q6_K.gguf) | Q6_K | 0.6 | very good quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.Q8_0.gguf) | Q8_0 | 0.6 | fast, best quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen2.5-0.5B-Portuguese-v2-GGUF/resolve/main/Qwen2.5-0.5B-Portuguese-v2.f16.gguf) | f16 | 1.1 | 16 bpw, overkill |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user