Meta-Llama-3.1-8B-Instruct-128k-GGUF/README.md

license, base_model, pipeline_tag, tags

license	base_model	pipeline_tag	tags
llama3.1	meta-llama/Meta-Llama-3.1-8B-Instruct	text-generation	text-generation-inference

Note

This is a model that is assumed to perform well, but may require more testing and user feedback. Be aware, only models featured within the GUI of GPT4All, are curated and officially supported by Nomic. Use at your own risk.

About

Model converted and quantized by: 3Simplex.
GPT4All v3.1.1 required.

Prompt Template

<|start_header_id|>system<|end_header_id|>

{system_prompt}<|eot_id|>

<|start_header_id|>user<|end_header_id|>

{user_input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>

{assistant_response}

128k Context Length

"llama.context_length": 131072