--- license: other license_name: exaone license_link: LICENSE model_name: EXAONE-3.5-7.8B-Instruct base_model: LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct quantized_by: Second State Inc. language: - en - ko tags: - lg-ai - exaone - gguf pipeline_tag: text-generation library_name: transformers --- # EXAONE-3.5-7.8B-Instruct-GGUF ## Original Model [LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct) ## Run with Gaianet **Prompt template** prompt template: `exaone-chat` **Context size** chat_ctx_size: `32000` **Run with GaiaNet** - Quick start: https://docs.gaianet.ai/node-guide/quick-start - Customize your node: https://docs.gaianet.ai/node-guide/customize *Quantized with llama.cpp b4932*