mesolitica/tinyllama-1.1b-4096-fpf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
d7316afcbb45295f1267ba0bef03fb73bd927c7c
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

language
language
ms

Full Parameter Finetuning TinyLlama-1.1B-intermediate-step-955k-2.0T 4096 context length Mistral on Malaysian text

README at https://github.com/mesolitica/malaya/tree/5.1/session/tiny-llama#4096-context-length

WandB, https://wandb.ai/mesolitica/finetune-tinyllama-1.1B?workspace=user-husein-mesolitica

Description
Model synced from source: mesolitica/tinyllama-1.1b-4096-fpf
Readme 514 KiB