初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/OmniTranslate-1.1-GGUF Source: Original Platform
This commit is contained in:
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OmniTranslate-1.1.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
OmniTranslate-1.1.IQ4_XS.gguf
Normal file
3
OmniTranslate-1.1.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ff7ee367338e1e3fc490a0a31a7d58fc59905f9a87bc9eed2bc6472e30054150
|
||||
size 369285120
|
||||
3
OmniTranslate-1.1.Q2_K.gguf
Normal file
3
OmniTranslate-1.1.Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2466ed54bdff39bc47207f1dbfb1a0d176dfa4eb5f1aea22f6f031896cc1a2f9
|
||||
size 296245248
|
||||
3
OmniTranslate-1.1.Q3_K_L.gguf
Normal file
3
OmniTranslate-1.1.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3f96cfdeb5a0c2c73c986cc3fd2513a382eb18a13a225105ec5b76cddd2f618d
|
||||
size 368498688
|
||||
3
OmniTranslate-1.1.Q3_K_M.gguf
Normal file
3
OmniTranslate-1.1.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b9f620ec5b0377aa4e9e457c807c048daa898bdae947b05ef0d4b8a7b869e521
|
||||
size 347133952
|
||||
3
OmniTranslate-1.1.Q3_K_S.gguf
Normal file
3
OmniTranslate-1.1.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fe2955f95cb38937936512fa00401295bed047d0b630ae0f0af2701278d052cd
|
||||
size 323082240
|
||||
3
OmniTranslate-1.1.Q4_K_M.gguf
Normal file
3
OmniTranslate-1.1.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9c6d3a4a737162e39aabb34b06362f1e5346d19ca7af65c4be3269549d15ea20
|
||||
size 396711936
|
||||
3
OmniTranslate-1.1.Q4_K_S.gguf
Normal file
3
OmniTranslate-1.1.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:286775e21ec3ec337f457c465d165f10554c7ebebd71afaef268f856bbc713f2
|
||||
size 383277056
|
||||
3
OmniTranslate-1.1.Q5_K_M.gguf
Normal file
3
OmniTranslate-1.1.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a33ba217b9af500b4f314a3d7c71f5cec7def3d1734aca8ed43f109a68655d42
|
||||
size 444422144
|
||||
3
OmniTranslate-1.1.Q5_K_S.gguf
Normal file
3
OmniTranslate-1.1.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7f1b0e0e61592be21b22b4923b211bdbc80367fcd24755132a9c2ffaf51d546a
|
||||
size 436623360
|
||||
3
OmniTranslate-1.1.Q6_K.gguf
Normal file
3
OmniTranslate-1.1.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:33b10314417ee796c0ff566163525da27208a542218a02a20242bf55d1656754
|
||||
size 495114240
|
||||
3
OmniTranslate-1.1.Q8_0.gguf
Normal file
3
OmniTranslate-1.1.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f01eca22cffac334b7e944084a10ca9add0a643ae5e67be3ba76cc38e56ff10c
|
||||
size 639454208
|
||||
3
OmniTranslate-1.1.f16.gguf
Normal file
3
OmniTranslate-1.1.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3e4cdd744357d19aab221d8ed31e22b299bf7eab0f3c7b1a9473e83786c02ce8
|
||||
size 1198189568
|
||||
579
README.md
Normal file
579
README.md
Normal file
@@ -0,0 +1,579 @@
|
||||
---
|
||||
base_model: MihaiPopa-1/OmniTranslate-1.1
|
||||
datasets:
|
||||
- MihaiPopa-1/OmniSurgical-1.1
|
||||
language:
|
||||
- abk
|
||||
- abq
|
||||
- abs
|
||||
- acm
|
||||
- adh
|
||||
- adi
|
||||
- ady
|
||||
- aeb
|
||||
- afr
|
||||
- agx
|
||||
- aii
|
||||
- aim
|
||||
- ain
|
||||
- ajz
|
||||
- akb
|
||||
- aln
|
||||
- als
|
||||
- alt
|
||||
- amh
|
||||
- anp
|
||||
- aoz
|
||||
- apc
|
||||
- apt
|
||||
- arb
|
||||
- arg
|
||||
- arq
|
||||
- ars
|
||||
- ary
|
||||
- arz
|
||||
- asm
|
||||
- ast
|
||||
- atb
|
||||
- ava
|
||||
- awa
|
||||
- ayp
|
||||
- ayr
|
||||
- azb
|
||||
- azj
|
||||
- bak
|
||||
- bam
|
||||
- ban
|
||||
- bar
|
||||
- bas
|
||||
- bbc
|
||||
- bbk
|
||||
- bcl
|
||||
- bdq
|
||||
- bel
|
||||
- ben
|
||||
- bew
|
||||
- bho
|
||||
- bhp
|
||||
- bis
|
||||
- biu
|
||||
- bjn
|
||||
- bod
|
||||
- bos
|
||||
- brh
|
||||
- brx
|
||||
- bts
|
||||
- btx
|
||||
- bug
|
||||
- bul
|
||||
- bwi
|
||||
- bxr
|
||||
- cat
|
||||
- cbk
|
||||
- ccp
|
||||
- ceb
|
||||
- ces
|
||||
- cfm
|
||||
- cha
|
||||
- che
|
||||
- chr
|
||||
- chu
|
||||
- chv
|
||||
- cjs
|
||||
- ckb
|
||||
- ckt
|
||||
- cmn
|
||||
- cnh
|
||||
- cnw
|
||||
- cos
|
||||
- crh
|
||||
- crj
|
||||
- crk
|
||||
- crl
|
||||
- crs
|
||||
- csb
|
||||
- csw
|
||||
- csy
|
||||
- ctd
|
||||
- cym
|
||||
- czt
|
||||
- dak
|
||||
- dan
|
||||
- dar
|
||||
- deu
|
||||
- dik
|
||||
- diu
|
||||
- div
|
||||
- dje
|
||||
- dks
|
||||
- dln
|
||||
- dng
|
||||
- dnw
|
||||
- doi
|
||||
- dru
|
||||
- dsb
|
||||
- dtp
|
||||
- dty
|
||||
- dzo
|
||||
- ekk
|
||||
- ell
|
||||
- emj
|
||||
- enl
|
||||
- enm
|
||||
- epo
|
||||
- ess
|
||||
- eus
|
||||
- eve
|
||||
- ewo
|
||||
- ext
|
||||
- fao
|
||||
- fas
|
||||
- ffm
|
||||
- fij
|
||||
- fil
|
||||
- fin
|
||||
- fit
|
||||
- fkv
|
||||
- fmu
|
||||
- fra
|
||||
- fro
|
||||
- frp
|
||||
- fry
|
||||
- fuf
|
||||
- fur
|
||||
- fuv
|
||||
- gag
|
||||
- gaz
|
||||
- gcf
|
||||
- gla
|
||||
- gle
|
||||
- glg
|
||||
- glk
|
||||
- glv
|
||||
- gmh
|
||||
- gnb
|
||||
- goh
|
||||
- gom
|
||||
- gos
|
||||
- grc
|
||||
- gsw
|
||||
- gug
|
||||
- guj
|
||||
- guz
|
||||
- hac
|
||||
- hae
|
||||
- hak
|
||||
- hat
|
||||
- hau
|
||||
- haw
|
||||
- hbo
|
||||
- heb
|
||||
- her
|
||||
- hif
|
||||
- hil
|
||||
- hin
|
||||
- hmr
|
||||
- hne
|
||||
- hns
|
||||
- hrv
|
||||
- hrx
|
||||
- hsb
|
||||
- hun
|
||||
- hwc
|
||||
- hye
|
||||
- hyw
|
||||
- iba
|
||||
- ibg
|
||||
- ibo
|
||||
- ife
|
||||
- ike
|
||||
- ikt
|
||||
- ilo
|
||||
- ina
|
||||
- ind
|
||||
- inh
|
||||
- isl
|
||||
- ita
|
||||
- ivv
|
||||
- jav
|
||||
- jpn
|
||||
- jun
|
||||
- kaa
|
||||
- kab
|
||||
- kac
|
||||
- kak
|
||||
- kal
|
||||
- kam
|
||||
- kan
|
||||
- kas
|
||||
- kat
|
||||
- kaz
|
||||
- kbd
|
||||
- kca
|
||||
- kdh
|
||||
- kdr
|
||||
- kea
|
||||
- kei
|
||||
- kgp
|
||||
- kha
|
||||
- khk
|
||||
- khm
|
||||
- kik
|
||||
- kin
|
||||
- kir
|
||||
- kiu
|
||||
- kjb
|
||||
- kjh
|
||||
- kmr
|
||||
- knc
|
||||
- koi
|
||||
- kor
|
||||
- kos
|
||||
- kpv
|
||||
- krj
|
||||
- krl
|
||||
- kru
|
||||
- ksh
|
||||
- ksw
|
||||
- ktj
|
||||
- ktz
|
||||
- kua
|
||||
- kum
|
||||
- kwn
|
||||
- kyu
|
||||
- kzj
|
||||
- lad
|
||||
- lao
|
||||
- lat
|
||||
- lbe
|
||||
- ldn
|
||||
- lew
|
||||
- lez
|
||||
- lfn
|
||||
- lim
|
||||
- lin
|
||||
- lis
|
||||
- lit
|
||||
- lki
|
||||
- lld
|
||||
- lmk
|
||||
- lnd
|
||||
- lrc
|
||||
- ltg
|
||||
- ltz
|
||||
- lud
|
||||
- lug
|
||||
- luo
|
||||
- lus
|
||||
- lvs
|
||||
- lwg
|
||||
- lzh
|
||||
- mag
|
||||
- mah
|
||||
- mai
|
||||
- mak
|
||||
- mal
|
||||
- mar
|
||||
- mas
|
||||
- mbf
|
||||
- mdf
|
||||
- mer
|
||||
- mfe
|
||||
- mfg
|
||||
- mfy
|
||||
- mhi
|
||||
- mhr
|
||||
- mhy
|
||||
- min
|
||||
- mip
|
||||
- mjw
|
||||
- mkd
|
||||
- mlt
|
||||
- mni
|
||||
- mnk
|
||||
- mns
|
||||
- mnw
|
||||
- moh
|
||||
- mph
|
||||
- mqy
|
||||
- mri
|
||||
- mrj
|
||||
- mrw
|
||||
- mtg
|
||||
- mui
|
||||
- mup
|
||||
- mus
|
||||
- mvp
|
||||
- mwf
|
||||
- mwl
|
||||
- mww
|
||||
- mya
|
||||
- myv
|
||||
- myx
|
||||
- mzh
|
||||
- nah
|
||||
- nan
|
||||
- nap
|
||||
- naq
|
||||
- nbu
|
||||
- nde
|
||||
- ndo
|
||||
- nds
|
||||
- new
|
||||
- nio
|
||||
- njn
|
||||
- njo
|
||||
- nld
|
||||
- nmf
|
||||
- nmz
|
||||
- nno
|
||||
- nob
|
||||
- nog
|
||||
- non
|
||||
- npi
|
||||
- npo
|
||||
- nrf
|
||||
- nri
|
||||
- nrm
|
||||
- nse
|
||||
- nus
|
||||
- nya
|
||||
- nyn
|
||||
- nzm
|
||||
- obo
|
||||
- oci
|
||||
- ojb
|
||||
- olo
|
||||
- orv
|
||||
- ory
|
||||
- oss
|
||||
- ota
|
||||
- oto
|
||||
- otw
|
||||
- pam
|
||||
- pan
|
||||
- pap
|
||||
- pbt
|
||||
- pcd
|
||||
- pck
|
||||
- pcm
|
||||
- pfl
|
||||
- plt
|
||||
- pmq
|
||||
- pmx
|
||||
- pnb
|
||||
- pnt
|
||||
- pol
|
||||
- por
|
||||
- pov
|
||||
- ppk
|
||||
- pps
|
||||
- prg
|
||||
- pui
|
||||
- pxm
|
||||
- quc
|
||||
- qul
|
||||
- qup
|
||||
- qus
|
||||
- quz
|
||||
- raw
|
||||
- rcf
|
||||
- rel
|
||||
- rhg
|
||||
- ria
|
||||
- rjs
|
||||
- rmc
|
||||
- rml
|
||||
- rmn
|
||||
- rmy
|
||||
- rnl
|
||||
- roh
|
||||
- ron
|
||||
- rtm
|
||||
- rue
|
||||
- run
|
||||
- rus
|
||||
- sah
|
||||
- san
|
||||
- sat
|
||||
- sck
|
||||
- scn
|
||||
- sda
|
||||
- sdc
|
||||
- sdh
|
||||
- ses
|
||||
- sgc
|
||||
- sgh
|
||||
- sid
|
||||
- sin
|
||||
- sju
|
||||
- skr
|
||||
- slk
|
||||
- slv
|
||||
- sma
|
||||
- sme
|
||||
- smj
|
||||
- smn
|
||||
- smo
|
||||
- sms
|
||||
- smt
|
||||
- sna
|
||||
- snd
|
||||
- som
|
||||
- sot
|
||||
- spa
|
||||
- srd
|
||||
- srp
|
||||
- ssw
|
||||
- sul
|
||||
- sun
|
||||
- swe
|
||||
- swg
|
||||
- swh
|
||||
- syc
|
||||
- syl
|
||||
- szl
|
||||
- tab
|
||||
- tam
|
||||
- taq
|
||||
- tat
|
||||
- tcy
|
||||
- tcz
|
||||
- tel
|
||||
- tet
|
||||
- tgk
|
||||
- tha
|
||||
- thl
|
||||
- tig
|
||||
- tir
|
||||
- tkl
|
||||
- tkr
|
||||
- tlh
|
||||
- tly
|
||||
- tok
|
||||
- ton
|
||||
- tpi
|
||||
- tpw
|
||||
- trc
|
||||
- trp
|
||||
- trs
|
||||
- ttj
|
||||
- tuk
|
||||
- tur
|
||||
- tuv
|
||||
- twx
|
||||
- tyv
|
||||
- tzl
|
||||
- tzm
|
||||
- udm
|
||||
- uig
|
||||
- ukr
|
||||
- urd
|
||||
- uzn
|
||||
- uzs
|
||||
- vap
|
||||
- vie
|
||||
- vot
|
||||
- vro
|
||||
- war
|
||||
- way
|
||||
- wba
|
||||
- wbm
|
||||
- wes
|
||||
- whk
|
||||
- wlx
|
||||
- wol
|
||||
- wsg
|
||||
- wwa
|
||||
- xal
|
||||
- xho
|
||||
- xmm
|
||||
- xmv
|
||||
- xog
|
||||
- yaz
|
||||
- ydd
|
||||
- yor
|
||||
- yrk
|
||||
- yrl
|
||||
- yua
|
||||
- yue
|
||||
- zea
|
||||
- zgh
|
||||
- zom
|
||||
- zsm
|
||||
- zul
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- text-generation-inference
|
||||
- translation
|
||||
- transformers
|
||||
- unsloth
|
||||
- qwen3
|
||||
- omnitranslate
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: -->
|
||||
<!-- ### quants: x-f16 Q4_K_S Q2_K Q8_0 Q6_K Q3_K_M Q3_K_S Q3_K_L Q4_K_M Q5_K_S Q5_K_M IQ4_XS -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
static quants of https://huggingface.co/MihaiPopa-1/OmniTranslate-1.1
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#OmniTranslate-1.1-GGUF).***
|
||||
|
||||
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q2_K.gguf) | Q2_K | 0.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q3_K_S.gguf) | Q3_K_S | 0.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q3_K_M.gguf) | Q3_K_M | 0.4 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q3_K_L.gguf) | Q3_K_L | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.IQ4_XS.gguf) | IQ4_XS | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q4_K_S.gguf) | Q4_K_S | 0.5 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q4_K_M.gguf) | Q4_K_M | 0.5 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q5_K_S.gguf) | Q5_K_S | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q5_K_M.gguf) | Q5_K_M | 0.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q6_K.gguf) | Q6_K | 0.6 | very good quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.Q8_0.gguf) | Q8_0 | 0.7 | fast, best quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OmniTranslate-1.1-GGUF/resolve/main/OmniTranslate-1.1.f16.gguf) | f16 | 1.3 | 16 bpw, overkill |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user