OmniTranslate-1.0-GGUF/README.md

base_model, datasets, language, library_name, license, mradermacher, quantized_by, tags

base_model	datasets	language	library_name	license	mradermacher	quantized_by	tags
MihaiPopa-1/OmniTranslate-1.0	MihaiPopa-1/OmniSurgical-1.0	abk abq abs acm adh adi ady aeb afr agx aii aim ain ajz akb aln als alt amh anp aoz apc apt arb arg arq ars ary arz asm ast atb ava awa ayp ayr azb azj bak bam ban bar bas bbc bbk bcl bdq bel ben bew bho bhp bis biu bjn bod bos brh brx bts btx bug bul bwi bxr cat cbk ccp ceb ces cfm cha che chr chu chv cjs ckb ckt cmn cnh cnw cos crh crj crk crl crs csb csw csy ctd cym czt dak dan dar deu dik diu div dje dks dln dng dnw doi dru dsb dtp dty dzo ekk ell enl enm epo ess eus eve ewo ext fao fas ffm fij fil fin fit fkv fmu fra fro frp fry fuf fur fuv gag gaz gcf gla gle glg glk glv gmh gnb goh gom gos grc gsw gug guj guz hac hae hak hat hau haw hbo heb her hif hil hin hmr hne hns hrv hrx hsb hun hwc hye hyw iba ibg ibo ife ike ikt ilo ina ind inh isl ita ivv jav jpn jun kaa kab kac kak kal kam kan kas kat kaz kbd kca kdh kdr kea kei kgp kha khk khm kik kin kir kiu kjb kjh kmr knc koi kor kos kpv krj krl kru ksh ksw ktj ktz kua kum kwn kyu kzj lad lao lat lbe ldn lew lez lfn lim lin lis lit lki lld lmk lnd lrc ltg ltz lud lug luo lus lvs lwg lzh mag mah mai mak mal mar mas mbf mdf mer mfe mfg mfy mhi mhr mhy min mip mjw mkd mlt mni mnk mns mnw moh mph mqy mri mrj mrw mtg mui mup mus mvp mwf mwl mww mya myv myx mzh nah nan nap naq nbu nde ndo nds new nio njn njo nld nmf nmz nno nob nog non npi npo nrf nri nrm nse nus nya nyn nzm obo oci ojb olo orv ory oss ota oto otw pam pan pap pbt pcd pck pcm pfl plt pmq pmx pnb pnt pol por pov ppk pps prg pui pxm quc qul qup qus quz raw rcf rel rhg ria rjs rmc rml rmn rmy rnl roh ron rtm rue run rus sah san sat sck scn sda sdc sdh ses sgc sgh sid sin sju skr slk slv sma sme smj smn smo sms smt sna snd som sot spa srd srp ssw sun swe swg swh syc syl szl tab tam taq tat tcy tcz tel tet tgk tha thl tig tir tkl tkr tlh tly tok ton tpi tpw trc trp trs ttj tuk tur tuv twx tyv tzl tzm udm uig ukr urd uzn uzs vap vie vot vro war way wba wbm wes whk wlx wol wsg wwa xal xho xmm xmv xog yaz ydd yor yrk yrl yua yue zea zgh zom zsm zul	transformers	apache-2.0	readme_rev 1	mradermacher	text-generation-inference translation transformers unsloth qwen3 omnitranslate

About

static quants of https://huggingface.co/MihaiPopa-1/OmniTranslate-1.0

For a convenient overview and download list, visit our model page for this model.

weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Link	Type	Size/GB	Notes
GGUF	Q2_K	0.4
GGUF	Q3_K_S	0.4
GGUF	Q3_K_M	0.4	lower quality
GGUF	Q3_K_L	0.5
GGUF	IQ4_XS	0.5
GGUF	Q4_K_S	0.5	fast, recommended
GGUF	Q4_K_M	0.5	fast, recommended
GGUF	Q5_K_S	0.5
GGUF	Q5_K_M	0.5
GGUF	Q6_K	0.6	very good quality
GGUF	Q8_0	0.7	fast, best quality
GGUF	f16	1.3	16 bpw, overkill

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

And here are Artefact2's thoughts on the matter: https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9

FAQ / Model Request

See https://huggingface.co/mradermacher/model_requests for some answers to questions you might have and/or if you want some other model quantized.

Thanks

I thank my company, nethype GmbH, for letting me use its servers and providing upgrades to my workstation to enable this work in my free time.