初始化项目,由ModelHub XC社区提供模型
Model: V-YangXu/StarCoder-Alpaca Source: Original Platform
This commit is contained in:
7
README.md
Normal file
7
README.md
Normal file
@@ -0,0 +1,7 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
---
|
||||
|
||||
StarCoder finetuned on 20k AlpacaCode Dataset.
|
||||
|
||||
The StarCoder models are 15.5B parameter models trained on 80+ programming languages from The Stack (v1.2), with opt-out requests excluded. The model uses Multi Query Attention, a context window of 8192 tokens, and was trained using the Fill-in-the-Middle objective on 1 trillion tokens.
|
||||
Reference in New Issue
Block a user