Liangsheng Yin
|
7623091d97
|
RadixCache method adjust (#977)
|
2024-08-07 15:52:24 -07:00 |
|
Liangsheng Yin
|
f724f1f1e9
|
PrefillAdder abstraction (#968)
|
2024-08-07 13:47:28 -07:00 |
|
Zhiqiang Xie
|
6db27f7b3b
|
misc: correct the int data type for token ids and indices (#969)
|
2024-08-08 04:40:07 +08:00 |
|
Liangsheng Yin
|
4d929107ae
|
Run purge-cache only in sgl-project (#976)
|
2024-08-07 13:16:36 -07:00 |
|
Liangsheng Yin
|
fbe0c818c2
|
Purge self-runner's pip cache weekly (#975)
|
2024-08-07 12:43:12 -07:00 |
|
Yineng Zhang
|
dc9d06d886
|
chore: bump v0.2.11 (#970)
|
2024-08-07 20:47:53 +08:00 |
|
Yineng Zhang
|
c31f084c71
|
chore: update vllm to 0.5.4 (#966)
|
2024-08-07 21:15:41 +10:00 |
|
Liangsheng Yin
|
a01ddd9605
|
misc: fix the req_to_token member change (#967)
|
2024-08-07 01:52:10 -07:00 |
|
Liangsheng Yin
|
7fa54a1ab3
|
Make req_pool_indices on CPU (#960)
|
2024-08-07 01:41:25 -07:00 |
|
Yineng Zhang
|
05abd1261c
|
misc: add compute capability in check_env (#965)
|
2024-08-07 18:39:36 +10:00 |
|
yichuan~
|
5f6fa04a3f
|
misc: simplify test (#964)
|
2024-08-07 01:23:27 -07:00 |
|
Yineng Zhang
|
58a0970853
|
misc: update issue template (#963)
|
2024-08-07 17:41:21 +10:00 |
|
Ying Sheng
|
ff68ae857a
|
Show more error messages for warmup errors (#932)
|
2024-08-06 23:57:06 -07:00 |
|
yichuan~
|
795eab6dda
|
Add support for Batch API test (#936)
|
2024-08-06 23:52:10 -07:00 |
|
Meng, Peng
|
41bb1ab10d
|
fix nsys cannot profile cuda kernel (#957)
|
2024-08-07 11:51:21 +08:00 |
|
Liangsheng Yin
|
87e8c090e9
|
Organize code (rename, movement) (#953)
|
2024-08-06 20:50:32 -07:00 |
|
Liangsheng Yin
|
ad56e68495
|
Fix stuck in get_new_prefill_batch (#948)
|
2024-08-06 01:05:58 -07:00 |
|
yichuan~
|
ffb15744b5
|
Support multiple args options (#941)
|
2024-08-06 04:12:53 +10:00 |
|
Ke Bao
|
a9c833d580
|
Fix union operator (#940)
|
2024-08-06 00:46:34 +08:00 |
|
Aidan Cooper
|
94e0115186
|
Feat: add alternative choices selection methods (#835)
|
2024-08-05 03:27:49 -07:00 |
|
Aidan Cooper
|
b216a545b3
|
Remove leftover auth_token (#934)
|
2024-08-05 03:25:48 -07:00 |
|
Yineng Zhang
|
fde8340550
|
docs: update README (#935)
|
2024-08-05 20:06:06 +10:00 |
|
yichuan~
|
fd7926e46e
|
Fix prompt len in parallel sampling (#928)
|
2024-08-05 00:56:08 -07:00 |
|
Ying Sheng
|
399cad91f3
|
Update README.md (#927)
|
2024-08-04 23:01:35 -07:00 |
|
Ying Sheng
|
0a4f5f9bea
|
Test regex in vision api (#926)
|
2024-08-04 22:52:41 -07:00 |
|
Ying Sheng
|
3bc99e6fe4
|
Test openai vision api (#925)
|
2024-08-05 13:51:55 +10:00 |
|
min-xu-et
|
ebf69964cd
|
latency test enhancement - final part (#921)
|
2024-08-04 18:15:23 -07:00 |
|
Ying Sheng
|
141e8c71a3
|
Bump version to 0.2.10 (#923)
|
2024-08-04 16:52:51 -07:00 |
|
yichuan~
|
d53dcf9c98
|
Support more OpenAI API test (#916)
|
2024-08-04 16:43:09 -07:00 |
|
Liangsheng Yin
|
bb66cc4c52
|
Fix CI && python3.8 compatible (#920)
|
2024-08-04 16:02:05 -07:00 |
|
Ying Sheng
|
975adb802b
|
Update hyperparameter_tuning.md (#918)
|
2024-08-04 13:51:52 -07:00 |
|
Ying Sheng
|
0d4f3a9fcd
|
Make API Key OpenAI-compatible (#917)
|
2024-08-04 13:35:44 -07:00 |
|
min-xu-et
|
afd411d09f
|
enhance latency test - part 2 (#915)
|
2024-08-04 12:27:25 -07:00 |
|
Ke Bao
|
e1eae1fd15
|
Support MLA for DeepSeek-V2 with Triton - step 1 (#905)
|
2024-08-05 03:40:33 +10:00 |
|
Yineng Zhang
|
f4d9953d9d
|
misc: add triton in check_env PACKAGE_LIST (#914)
|
2024-08-04 23:20:59 +10:00 |
|
Yineng Zhang
|
4f00525057
|
fix: use e2e and unit test only for original repo or pr (#912)
|
2024-08-04 16:34:50 +10:00 |
|
Ying Sheng
|
995af5a54b
|
Improve the structure of CI (#911)
|
2024-08-03 23:09:21 -07:00 |
|
min-xu-et
|
539856455d
|
latency test enhancement - part 1 (#909)
|
2024-08-03 22:44:58 -07:00 |
|
Ying Sheng
|
70cc0749ce
|
Add model accuracy test - step 1 (#866)
|
2024-08-03 18:20:50 -07:00 |
|
min-xu-et
|
7dd8a7e6d9
|
fixed an error handling in bench_latency.py (#904)
|
2024-08-03 17:42:17 -07:00 |
|
Liangsheng Yin
|
947402c829
|
Reorder CI unit tests. (#908)
|
2024-08-03 16:18:50 -07:00 |
|
Ying Sheng
|
8c5382e62c
|
Update README.md
|
2024-08-03 12:58:41 -07:00 |
|
Ying Sheng
|
001b0bdd08
|
Update the base image of the docker (#900)
|
2024-08-02 21:54:57 -07:00 |
|
Ying Sheng
|
b906c01592
|
Bump version to 0.2.9.post1 (#899)
|
2024-08-02 12:08:00 -07:00 |
|
min-xu-et
|
9319cd139c
|
[minor] fixed code formatting doc (#896)
|
2024-08-03 02:39:28 +10:00 |
|
Yineng Zhang
|
046c2b339e
|
chore: add multipart dep for fastapi (#895)
|
2024-08-03 00:50:19 +10:00 |
|
Yineng Zhang
|
6b8f66efe1
|
misc: update cuda graph capture exception log (#894)
|
2024-08-03 00:40:52 +10:00 |
|
Yineng Zhang
|
7937a886b2
|
docs: update setup runner (#884)
|
2024-08-02 21:03:53 +10:00 |
|
Yineng Zhang
|
2e218b9e04
|
fix: set env in runner (#891)
|
2024-08-02 20:48:56 +10:00 |
|
Ying Sheng
|
30a9b2ef20
|
Bump version to v0.2.9 (#890)
|
2024-08-02 01:45:48 -07:00 |
|