gaianet/EXAONE-3.5-7.8B-Instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: gaianet/EXAONE-3.5-7.8B-Instruct-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-26 23:26:18 +08:00
commit 6cd86c2fea
16 changed files with 168 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
EXAONE-3.5-7.8B-Instruct-f16.gguf filter=lfs diff=lfs merge=lfs -text

3
EXAONE-3.5-7.8B-Instruct-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ae27fa0e8f3b91081ce91b8241248a7a99974cbcce21a27a6fdf9a9c50504d2
size 3053868960

3
EXAONE-3.5-7.8B-Instruct-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3beba6701da05cbfca258d8e2f910857c1f9d7243a5b722f613cfb27cab84326
size 4185937824

3
EXAONE-3.5-7.8B-Instruct-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb1cbd4c0333f8288a8dca35c6fbe4a6bfbc2e25d4d568f883a927eb0d59d1ce
size 3882899360

3
EXAONE-3.5-7.8B-Instruct-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c952a90d64c85c5e4370e61791143211708ca9a923c8b054ba8f0984e8b05416
size 3528480672

3
EXAONE-3.5-7.8B-Instruct-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f01dd5cd9a793422a81d65a581f40d5e251906ea05e59cfa80a29a029e3da70b
size 4511127456

3
EXAONE-3.5-7.8B-Instruct-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7f6d1fdbe388c15b038150706c851591612252bf679dbeca6359ea6dbe78e3f9
size 4770650016

3
EXAONE-3.5-7.8B-Instruct-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2eff7af76a22b4eb6128c1947cfc1ca6c2516a5aa130bc5bc50d8893120a7f9
size 4542584736

3
EXAONE-3.5-7.8B-Instruct-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a84f4c6e41670762f924ce77880f661f0a0f758a77213a3dc8600f6522b2f3d
size 5435971488

3
EXAONE-3.5-7.8B-Instruct-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64a544a98a8a528bab6ad1605c811b9dd6ffedc1b8ee7cdda9f7d7f4f5d33c5f
size 5569664928

3
EXAONE-3.5-7.8B-Instruct-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:203f8674c835d1139abe751f25f8ec4a1f7c20d93fed6917780d39cf7ea1d77c
size 5435971488

3
EXAONE-3.5-7.8B-Instruct-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15e4d1d3ff7c426c9c5e8bb5ccf028cf94d06e1178b6d054f2ad20d1754ef9ca
size 6418618272

3
EXAONE-3.5-7.8B-Instruct-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8032de629508aed6fd50c8c2ea0055a5b6d284fe63c1fbe0b815e97af53e761
size 8312084384

3
EXAONE-3.5-7.8B-Instruct-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c9a65c06234a83316aa40ea490e20139ddb5bce58149c3056ac145a06a19231
size 15641630624

42
README.md Normal file
View File

@@ -0,0 +1,42 @@
---
license: other
license_name: exaone
license_link: LICENSE
model_name: EXAONE-3.5-7.8B-Instruct
base_model: LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct
quantized_by: Second State Inc.
language:
- en
- ko
tags:
- lg-ai
- exaone
- gguf
pipeline_tag: text-generation
library_name: transformers
---
# EXAONE-3.5-7.8B-Instruct-GGUF
## Original Model
[LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct](https://huggingface.co/LGAI-EXAONE/EXAONE-3.5-7.8B-Instruct)
## Run with Gaianet
**Prompt template**
prompt template: `exaone-chat`
**Context size**
chat_ctx_size: `32000`
**Run with GaiaNet**
- Quick start: https://docs.gaianet.ai/node-guide/quick-start
- Customize your node: https://docs.gaianet.ai/node-guide/customize
*Quantized with llama.cpp b4932*

39
config.json Normal file
View File

@@ -0,0 +1,39 @@
{
"activation_function": "silu",
"architectures": [
"ExaoneForCausalLM"
],
"attention_dropout": 0.0,
"auto_map": {
"AutoConfig": "configuration_exaone.ExaoneConfig",
"AutoModelForCausalLM": "modeling_exaone.ExaoneForCausalLM",
"AutoModelForSequenceClassification": "modeling_exaone.ExaoneForSequenceClassification"
},
"bos_token_id": 1,
"embed_dropout": 0.0,
"eos_token_id": 361,
"head_dim": 128,
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"layer_norm_epsilon": 1e-05,
"max_position_embeddings": 32768,
"model_type": "exaone",
"num_attention_heads": 32,
"num_key_value_heads": 8,
"num_layers": 32,
"pad_token_id": 0,
"rope_scaling": {
"factor": 8.0,
"high_freq_factor": 4.0,
"low_freq_factor": 1.0,
"original_max_position_embeddings": 8192,
"rope_type": "llama3"
},
"rope_theta": 1000000.0,
"tie_word_embeddings": false,
"torch_dtype": "float32",
"transformers_version": "4.43.0",
"use_cache": true,
"vocab_size": 102400
}