Add support for tie_word_embeddings when loading weights + support for SmolLM (#1508)

This commit is contained in:
TianyiQ
2024-09-24 21:50:20 -07:00
committed by GitHub
parent fb2d0680e0
commit 3c93187caf
3 changed files with 10 additions and 0 deletions

View File

@@ -263,6 +263,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct
- BaiChuan2
- MiniCPM / MiniCPM 3
- XVERSE / XVERSE MoE
- SmolLM
**Embedding Models**