tags, license, library_name, inference, pipeline_tag

tags	license	library_name	inference	pipeline_tag
quantized 2-bit 3-bit 4-bit 5-bit 6-bit 8-bit fp16 GGUF transformers pytorch yi text-generation conversational endpoints_compatible text-generation-inference text-generation	apache-2.0	transformers	false	text-generation

The gguf quantization of Fi-9B