From c3c74bf87480c9cfa98ae182b7917cae979bc484 Mon Sep 17 00:00:00 2001 From: Yineng Zhang Date: Sat, 27 Jul 2024 14:07:37 +1000 Subject: [PATCH] docs: update model support (#760) --- docs/model_support.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/model_support.md b/docs/model_support.md index 7e1230d9b..4cfa4c0da 100644 --- a/docs/model_support.md +++ b/docs/model_support.md @@ -13,3 +13,4 @@ To port a model from vLLM to SGLang, you can compare these two files [SGLang LLa - Test correctness by comparing the final logits and outputs of the two following commands: - `python3 playground/reference_hf.py --model [new model]` - `python3 -m sglang.bench_latency --model [new model] --correct --output-len 16 --trust-remote-code` + - Update [Supported Models](https://github.com/sgl-project/sglang/tree/main?tab=readme-ov-file#supported-models) at [README](../README.md).