diff --git a/README.md b/README.md index 48603ed..e75ec9c 100644 --- a/README.md +++ b/README.md @@ -10,7 +10,9 @@ tags: - llama --- + # theprint-MoE-8x3-0126-GGUF + An 18B parameter Mixture of Experts model combining 8 specialized 3B experts, with 2 experts activated per token by default (configurable up to 4 at inference). ## Architecture