LSX-UniWue/LLaMmlein_1B_prerelease
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
1 Commit 1 Branch 0 Tags
main
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE

README.md

datasets, language, pipeline_tag, library_name, license, new_version
datasets language pipeline_tag library_name license new_version
togethercomputer/RedPajama-Data-V2
LSX-UniWue/LLaMmlein-Dataset
de
text-generation transformers other LSX-UniWue/LLaMmlein_1B

LLäMmlein 1B

This is a German Tinyllama 1B language model trained from scratch using the Tinyllama codebase on the German portion of RedPajama V2. Find more details on our page and our preprint!

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("LSX-UniWue/LLaMmlein_1B")

tokenizer = AutoTokenizer.from_pretrained("LSX-UniWue/LLaMmlein_1B")

Evaluation

We evaluated our results on the SuperGLEBer benchmark. Data Take Down

Description
Model synced from source: LSX-UniWue/LLaMmlein_1B_prerelease
Readme 478 KiB