GritLM-7B-GGUF/README.md

license, pipeline_tag, library_name

license	pipeline_tag	library_name
apache-2.0	text-generation	gguf

GGUF quants for https://huggingface.co/GritLM/GritLM-7B

GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.

Layers	Context	Template (Text Representation)	Template (Text Generation)
32	32768	<s><|user|> {instruction} <|embed|> {sample}	<s><|user|> {prompt} <|assistant|> {response}