EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Lianmin Zheng
2024-07-01 09:54:08 -07:00
committed by GitHub
parent 75b31a2a88
commit 26294b2f3d
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@@ -396,7 +396,8 @@ Instructions for supporting a new model are [here](https://github.com/sgl-projec
- Mixtral-8x7B on NVIDIA A10G, FP16, Tensor Parallelism=8
![mixtral_8x7b](assets/mixtral_8x7b.jpg)
Learn more [here](docs/benchmark_results.md).
- Learn more about the above [results](docs/benchmark_results.md).
- Synthetic latency and throughput benchmark [scripts](https://github.com/sgl-project/sglang/tree/main/benchmark/latency_throughput).
## Roadmap
https://github.com/sgl-project/sglang/issues/157