base_model, datasets, inference, model_creator, model_name, pipeline_tag, quantized_by, tags, widget

base_model	datasets	inference	model_creator	model_name	pipeline_tag	quantized_by	tags	widget
Felladrin/llama2_xs_460M_experimental_evol_instruct	KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format	false	Felladrin	llama2_xs_460M_experimental_evol_instruct	text-generation	afrideva	autotrain text-generation gguf ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0	text ### Instruction: Find me a list of some nice places to visit around the world. ### Response: text ### Instruction: Tell me all you know about the Earth. ### Response:

Felladrin/llama2_xs_460M_experimental_evol_instruct-GGUF

Quantized GGUF model files for llama2_xs_460M_experimental_evol_instruct from Felladrin

Name	Quant method	Size
llama2_xs_460m_experimental_evol_instruct.q2_k.gguf	q2_k	212.56 MB
llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf	q3_k_m	238.87 MB
llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf	q4_k_m	288.52 MB
llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf	q5_k_m	333.29 MB
llama2_xs_460m_experimental_evol_instruct.q6_k.gguf	q6_k	380.87 MB
llama2_xs_460m_experimental_evol_instruct.q8_0.gguf	q8_0	492.67 MB

Original Model Card:

ahxt's llama2_xs_460M_experimental trained on the WizardLM's Evol Instruct dataset using AutoTrain

• Base model: ahxt/llama2_xs_460M_experimental
• Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
• Training: 13.5h under these parameters

Recommended Prompt Format

### Instruction:
<instruction>

### Response:

Recommended Inference Parameters

repetition_penalty: 1.15
do_sample: true
temperature: 0.5
top_p: 0.5