EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Add flashinfer && Oultines (#1)

Browse Source
This commit is contained in:
Liangsheng Yin
2024-01-09 00:26:18 +08:00
committed by GitHub
parent 22085081bb
commit ead5b39f82
2 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
3rdparty/flashinfer vendored Submodule

Submodule 3rdparty/flashinfer added at 00cf5f46fd

2
README.md
View File

@@ -164,4 +164,4 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port
} }
``` ```
We learned from the design and reused some code of the following projects: [Guidance](https://github.com/guidance-ai/guidance), [vLLM](https://github.com/vllm-project/vllm), [LightLLM](https://github.com/ModelTC/lightllm), [FlashInfer](https://github.com/flashinfer-ai/flashinfer), [LMQL](https://github.com/eth-sri/lmql). We learned from the design and reused some code of the following projects: [Guidance](https://github.com/guidance-ai/guidance), [vLLM](https://github.com/vllm-project/vllm), [LightLLM](https://github.com/ModelTC/lightllm), [FlashInfer](https://github.com/flashinfer-ai/flashinfer), [Outlines](https://github.com/outlines-dev/outlines), [LMQL](https://github.com/eth-sri/lmql).