mesolitica/tinyllama-1.1b-4096-fpf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
main
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

language
language
ms

Full Parameter Finetuning TinyLlama-1.1B-intermediate-step-955k-2.0T 4096 context length Mistral on Malaysian text

README at https://github.com/mesolitica/malaya/tree/5.1/session/tiny-llama#4096-context-length

WandB, https://wandb.ai/mesolitica/finetune-tinyllama-1.1B?workspace=user-husein-mesolitica

Description
Model synced from source: mesolitica/tinyllama-1.1b-4096-fpf
Readme 514 KiB