Severian/ANIMA-Cognitive-Mistral-v1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update config.json

Browse Source
This commit is contained in:
Severian
2023-10-08 22:42:16 +00:00
committed by huggingface-web
parent f4ad452d09
commit 92be4f0252
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
config.json
View File

@@ -10,7 +10,7 @@
"initializer_range": 0.02, "initializer_range": 0.02,
"intermediate_size": 14336, "intermediate_size": 14336,
"max_position_embeddings": 32768, "max_position_embeddings": 32768,
"model_type": "llama", "model_type": "mistral",
"num_attention_heads": 32, "num_attention_heads": 32,
"num_hidden_layers": 32, "num_hidden_layers": 32,
"num_key_value_heads": 8, "num_key_value_heads": 8,