mesolitica/tinyllama-1.1b-4096-fpf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mesolitica/tinyllama-1.1b-4096-fpf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-03 11:55:12 +08:00
commit d7316afcbb
10 changed files with 168 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
README.md Normal file
View File

@@ -0,0 +1,10 @@
---
language:
- ms
---
# Full Parameter Finetuning TinyLlama-1.1B-intermediate-step-955k-2.0T 4096 context length Mistral on Malaysian text
README at https://github.com/mesolitica/malaya/tree/5.1/session/tiny-llama#4096-context-length
WandB, https://wandb.ai/mesolitica/finetune-tinyllama-1.1B?workspace=user-husein-mesolitica