Osmosis-Apply-1.7B-GGUF/README.md

license, base_model, language, pipeline_tag, library_name, tags

license	base_model	language	pipeline_tag	library_name	tags
apache-2.0	osmosis-ai/Osmosis-Apply-1.7B	en	text-generation	transformers	text-generation-inference

Osmosis-Apply-1.7B-GGUF

Osmosis-Apply-1.7B is a specialized language model finetuned on Qwen3-1.7B designed to perform code merges, similar to the apply feature of modern AI code editors. Given an original code snippet and an edit snippet, this model can apply the edit snippet to original code snippet, updating the code snippet with the edit.

Model files

File	Size	Format
Osmosis-Apply-1.7B.BF16.gguf	3.45 GB	BF16
Osmosis-Apply-1.7B.F16.gguf	3.45 GB	F16
Osmosis-Apply-1.7B.F32.gguf	6.89 GB	F32
Osmosis-Apply-1.7B.Q2_K.gguf	778 MB	Q2_K
Osmosis-Apply-1.7B.Q3_K_L.gguf	1 GB	Q3_K_L
Osmosis-Apply-1.7B.Q3_K_M.gguf	940 MB	Q3_K_M
Osmosis-Apply-1.7B.Q3_K_S.gguf	867 MB	Q3_K_S
Osmosis-Apply-1.7B.Q4_K_M.gguf	1.11 GB	Q4_K_M
Osmosis-Apply-1.7B.Q4_K_S.gguf	1.06 GB	Q4_K_S
Osmosis-Apply-1.7B.Q5_K_M.gguf	1.26 GB	Q5_K_M
Osmosis-Apply-1.7B.Q5_K_S.gguf	1.23 GB	Q5_K_S
Osmosis-Apply-1.7B.Q6_K.gguf	1.42 GB	Q6_K
Osmosis-Apply-1.7B.Q8_0.gguf	1.83 GB	Q8_0
.gitattributes	2.38 kB	-
README.md	428 Bytes	-
config.json	29 Bytes	-

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):