初始化项目,由ModelHub XC社区提供模型
Model: ericpolewski/AIRIC-The-Intern Source: Original Platform
This commit is contained in:
8
README.md
Normal file
8
README.md
Normal file
@@ -0,0 +1,8 @@
|
||||
---
|
||||
license: mit
|
||||
---
|
||||
This is an instruct model. It's to test out the effects of my dataset on the InternLM model if you just change everything to say "Llama" instead of "InternLM" in the config files.
|
||||
|
||||
I had a theory that a lot of these models are just Llama models with extraneous loaders. This is to test that theory.
|
||||
|
||||
Trained at rank 256 for 1 epoch at constant learning rate.
|
||||
Reference in New Issue
Block a user