wpsytz123/signaldesk-qualifier-8b-r4
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Fix rope_scaling: move rope_theta to top level

Browse Source
This commit is contained in:
Parker Sytz
2026-03-21 13:01:24 +00:00
committed by system
parent 07f90ba4c7
commit e65a63695e
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
config.json
View File

@@ -29,7 +29,7 @@
"high_freq_factor": 4.0, "high_freq_factor": 4.0,
"low_freq_factor": 1.0, "low_freq_factor": 1.0,
"original_max_position_embeddings": 8192, "original_max_position_embeddings": 8192,
"rope_theta": 500000.0,
"rope_type": "llama3" "rope_type": "llama3"
} },
"rope_theta": 500000.0
} }