774634d350145a1c290e0a29de2a4fdc514bc57e
Model: Ryder99/Llama-3.2-3B-Instruct-Hindi Source: Original Platform
base_model, tags, license, language
| base_model | tags | license | language | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit |
|
apache-2.0 |
|
Uploaded model
- Developed by: Ryder99
- License: apache-2.0
- Finetuned from model : unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit
So... Since making Llama-3.2-1B-Instruct-Hindi I spent even more time reading the Unsloth documentation, and with some compromises was able to finetune a 3B model (it just barely avoided OOM). This should be better than the 1B model, but I haven't tested it out thoroughly yet. Whatever else I wrote on the 1B model card remains true, so check it out if you want. I hope you find this model useful.
For queries, or to help me train larger models ( ...I couldn't get lab access :( ... ) you can mail me here.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Description
