From ead5b39f82f0664f6b8ffd571c9b41b8a2dd1e22 Mon Sep 17 00:00:00 2001 From: Liangsheng Yin Date: Tue, 9 Jan 2024 00:26:18 +0800 Subject: [PATCH] Add flashinfer && Oultines (#1) --- 3rdparty/flashinfer | 1 + README.md | 2 +- 2 files changed, 2 insertions(+), 1 deletion(-) create mode 160000 3rdparty/flashinfer diff --git a/3rdparty/flashinfer b/3rdparty/flashinfer new file mode 160000 index 000000000..00cf5f46f --- /dev/null +++ b/3rdparty/flashinfer @@ -0,0 +1 @@ +Subproject commit 00cf5f46fdbb4f1dbd9277fe3b842621c1d9e7dc diff --git a/README.md b/README.md index fc666595d..40fe5d5c3 100644 --- a/README.md +++ b/README.md @@ -164,4 +164,4 @@ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --port } ``` -We learned from the design and reused some code of the following projects: [Guidance](https://github.com/guidance-ai/guidance), [vLLM](https://github.com/vllm-project/vllm), [LightLLM](https://github.com/ModelTC/lightllm), [FlashInfer](https://github.com/flashinfer-ai/flashinfer), [LMQL](https://github.com/eth-sri/lmql). +We learned from the design and reused some code of the following projects: [Guidance](https://github.com/guidance-ai/guidance), [vLLM](https://github.com/vllm-project/vllm), [LightLLM](https://github.com/ModelTC/lightllm), [FlashInfer](https://github.com/flashinfer-ai/flashinfer), [Outlines](https://github.com/outlines-dev/outlines), [LMQL](https://github.com/eth-sri/lmql).