EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525)

Browse Source
This commit is contained in:
Ying Sheng
2024-09-27 23:32:11 -07:00
committed by GitHub
parent b1e330bcb0
commit 9aa6553d2a
13 changed files with 478 additions and 44 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
.github/workflows/pr-test.yml vendored
View File

@@ -29,6 +29,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Run test
@@ -48,6 +49,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Run test
@@ -67,6 +69,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Run test
@@ -86,6 +89,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[dev]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Run test
@@ -105,6 +109,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Benchmark Single Latency
@@ -136,6 +141,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Benchmark Offline Throughput (w/o RadixAttention)
@@ -167,6 +173,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
- name: Benchmark Offline Throughput (TP=2)
@@ -198,6 +205,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
git clone https://github.com/merrymercy/human-eval.git
@@ -221,6 +229,7 @@ jobs:
run: |
pip install --upgrade pip
pip install -e "python[all]"
pip install transformers==4.44
pip install flashinfer -i https://flashinfer.ai/whl/cu121/torch2.4/ --force-reinstall
git clone https://github.com/merrymercy/human-eval.git