初始化项目,由ModelHub XC社区提供模型
Model: LSX-UniWue/LLaMmlein_1B_prerelease Source: Original Platform
This commit is contained in:
32
README.md
Normal file
32
README.md
Normal file
@@ -0,0 +1,32 @@
|
||||
---
|
||||
datasets:
|
||||
- togethercomputer/RedPajama-Data-V2
|
||||
- LSX-UniWue/LLaMmlein-Dataset
|
||||
language:
|
||||
- de
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
license: other
|
||||
new_version: LSX-UniWue/LLaMmlein_1B
|
||||
---
|
||||
|
||||
# LLäMmlein 1B
|
||||
|
||||
This is a German Tinyllama 1B language model trained from scratch using the [Tinyllama](https://github.com/jzhang38/TinyLlama) codebase on the German portion of [RedPajama V2](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-V2).
|
||||
Find more details on our [page](https://www.informatik.uni-wuerzburg.de/datascience/projects/nlp/llammlein/) and our [preprint](https://arxiv.org/abs/2411.11171)!
|
||||
|
||||
|
||||
### Usage
|
||||
|
||||
```python
|
||||
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||
|
||||
model = AutoModelForCausalLM.from_pretrained("LSX-UniWue/LLaMmlein_1B")
|
||||
|
||||
tokenizer = AutoTokenizer.from_pretrained("LSX-UniWue/LLaMmlein_1B")
|
||||
```
|
||||
|
||||
|
||||
### Evaluation
|
||||
We evaluated our results on the [SuperGLEBer](https://lsx-uniwue.github.io/SuperGLEBer-site/) benchmark.
|
||||
[Data Take Down](https://www.informatik.uni-wuerzburg.de/datascience/projects/nlp/llammlein/)
|
||||
Reference in New Issue
Block a user