tags, model_name, base_model, inference, model_creator, pipeline_tag, quantized_by, license

tags	model_name	base_model	inference	model_creator	pipeline_tag	quantized_by	license
quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit GGUF phi phi-3 text-generation	Phi-3-mini-mango-1-GGUF	rhysjones/Phi-3-mini-mango-1	false	rhysjones	text-generation	rhysjones	mit

Description

These are GGUF model format files for the rhysjones/Phi-3-mini-mango-1 Phi-3 4k model.

Conversion process

The useful conversion script GGUF-n-Go by thesven was used along with llama.cpp to generate the different quantized sizes for the model.