bloomz-Alpaca-560M-GGUF/README.md

base_model, datasets, inference, language, model_creator, model_name, pipeline_tag, quantized_by, tags, widget

base_model	datasets	inference	language	model_creator	model_name	pipeline_tag	quantized_by	tags	widget
p208p2002/bloomz-Alpaca-560M	tatsu-lab/alpaca	false	en	p208p2002	bloomz-Alpaca-560M	text-generation	afrideva	text-generation-inference gguf ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0	text ### Instruction: How can we reduce air pollution? ### Response:

p208p2002/bloomz-Alpaca-560M-GGUF

Quantized GGUF model files for bloomz-Alpaca-560M from p208p2002

Name	Quant method	Size
bloomz-alpaca-560m.q2_k.gguf	q2_k	430.81 MB
bloomz-alpaca-560m.q3_k_m.gguf	q3_k_m	492.33 MB
bloomz-alpaca-560m.q4_k_m.gguf	q4_k_m	561.16 MB
bloomz-alpaca-560m.q5_k_m.gguf	q5_k_m	625.29 MB
bloomz-alpaca-560m.q6_k.gguf	q6_k	682.78 MB
bloomz-alpaca-560m.q8_0.gguf	q8_0	880.26 MB

Original Model Card:

Fine-Tune BLOOMZ Model on Alpaca 52K.