Compare commits
10 Commits
a98b3f4786
...
e4095399dd
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
e4095399dd | ||
|
|
fa31b5a5d7 | ||
|
|
06d9b60a91 | ||
|
|
c152e00e93 | ||
|
|
4b18e5b9d6 | ||
|
|
aa4c27b3a1 | ||
|
|
5f284aa418 | ||
|
|
c861aad2ef | ||
|
|
0e16271f54 | ||
|
|
2f38f7051e |
@@ -11,11 +11,14 @@ datasets:
|
|||||||
- wikimedia/wikipedia
|
- wikimedia/wikipedia
|
||||||
- FreedomIntelligence/alpaca-gpt4-deutsch
|
- FreedomIntelligence/alpaca-gpt4-deutsch
|
||||||
---
|
---
|
||||||
|
|
||||||
# SmolLM2-360m-German-Instruct
|
# SmolLM2-360m-German-Instruct
|
||||||
|
|
||||||
|
<p align="center">
|
||||||
|
<img alt="Showcase image for SmolLM2-360m-German-Instruct" src="https://huggingface.co/mags0ft/SmolLM2-360m-German-Instruct/resolve/main/showcase-image.png" width="600" />
|
||||||
|
</p>
|
||||||
|
|
||||||
This is a continued pre-train as well as an instruct fine-tune done using Unsloth in order to make SmolLM2 360m capable of speaking German.
|
This is a continued pre-train as well as an instruct fine-tune done using Unsloth in order to make SmolLM2 360m capable of speaking German.
|
||||||
It has been trained on 15% of the German Wikipedia as well as the full German version of the Alpaca-GPT4 dataset (translated version).
|
It has been trained on 25% of the German Wikipedia as well as the full German version of the Alpaca-GPT4 dataset (translated version).
|
||||||
|
|
||||||
Even though a lot of training has been done, this is still a tiny model and is highly limited to its small size. Expect many hallucinations and do not use this in a demanding production workflow.
|
Even though a lot of training has been done, this is still a tiny model and is highly limited to its small size. Expect many hallucinations and do not use this in a demanding production workflow.
|
||||||
|
|
||||||
|
|||||||
@@ -1,3 +1,3 @@
|
|||||||
version https://git-lfs.github.com/spec/v1
|
version https://git-lfs.github.com/spec/v1
|
||||||
oid sha256:1462d84557a08d69405309f3c16ada8d1c52fc6449ded0e0ae2d5dbe7373c816
|
oid sha256:ed010060c32323c44e6248aaef94f4a4a5630a6dcfeacd8afc5c0c185826d5b9
|
||||||
size 819925536
|
size 819925536
|
||||||
|
|||||||
@@ -1,3 +1,3 @@
|
|||||||
version https://git-lfs.github.com/spec/v1
|
version https://git-lfs.github.com/spec/v1
|
||||||
oid sha256:41222834cd1a584a897092dadad995f389839de5e24881530bd63e9c229b64c5
|
oid sha256:89e56c696d512be022033dacec04ad432384e1e9b7c4d3439c18bd452e42d306
|
||||||
size 723674912
|
size 723674912
|
||||||
|
|||||||
@@ -1,3 +1,3 @@
|
|||||||
version https://git-lfs.github.com/spec/v1
|
version https://git-lfs.github.com/spec/v1
|
||||||
oid sha256:8440cc3ea124948730bdcefff5b955064cd80cbe029cebb2b1b79d875b855dc1
|
oid sha256:b5041c903e83c1864164de3f9f78e9e1286f6298cfe15d5e7822141aa4ea0f49
|
||||||
size 303030816
|
size 303030816
|
||||||
|
|||||||
@@ -1,3 +1,3 @@
|
|||||||
version https://git-lfs.github.com/spec/v1
|
version https://git-lfs.github.com/spec/v1
|
||||||
oid sha256:8673622683be5beb60ca75993f01050c3ee6576564b21befac2a0f20b929039e
|
oid sha256:59a931c76d445f1d6ab91c0687003070003d2c59fdc03d92086b108eeb487d94
|
||||||
size 436539936
|
size 436539936
|
||||||
|
|||||||
@@ -1,3 +1,3 @@
|
|||||||
version https://git-lfs.github.com/spec/v1
|
version https://git-lfs.github.com/spec/v1
|
||||||
oid sha256:dc5c4ca40209ad8c39d456e20dada1e5a37ae356bb097646c0db2f934bc012c0
|
oid sha256:6e70474f66335edacd1977498a0dc5351f8c201c8f28c15bcc9de5596acbff82
|
||||||
size 1619494
|
size 1618360
|
||||||
|
|||||||
Reference in New Issue
Block a user