Chayenne
|
908dd7f9aa
|
Add engine api (#1894)
|
2024-11-02 22:03:38 -07:00 |
|
Chayenne
|
f4cd804073
|
Fix ci and link error (#1892)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-11-02 19:08:49 -07:00 |
|
Lianmin Zheng
|
be7986e005
|
Fix docs (#1890)
|
2024-11-02 13:26:32 -07:00 |
|
Chayenne
|
5a5f18432f
|
Fix docs ci (#1888)
|
2024-11-02 11:57:22 -07:00 |
|
Lianmin Zheng
|
7b394e5f2b
|
Fix docs (#1889)
|
2024-11-02 11:46:00 -07:00 |
|
Chayenne
|
3b60558dd7
|
Native api (#1886)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-11-02 01:02:17 -07:00 |
|
Lianmin Zheng
|
5a9a4f41c6
|
Update index.rst (#1885)
|
2024-11-02 00:20:33 -07:00 |
|
Chayenne
|
72e979bfb5
|
add native api docs (#1883)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-11-02 00:17:30 -07:00 |
|
Lianmin Zheng
|
660ecb731f
|
Fix doc links (#1882)
|
2024-11-01 20:42:30 -07:00 |
|
Lianmin Zheng
|
2565cb0f40
|
Update docs and workflow (#1881)
|
2024-11-01 20:29:41 -07:00 |
|
Lianmin Zheng
|
066e8a4ef0
|
Update docs title (#1879)
|
2024-11-01 20:00:41 -07:00 |
|
Lianmin Zheng
|
2134f0898c
|
Fix links in the docs (#1878)
|
2024-11-01 18:25:55 -07:00 |
|
Lianmin Zheng
|
a54f278d44
|
Add a FAQ documentation (#1877)
|
2024-11-01 18:16:29 -07:00 |
|
Lianmin Zheng
|
d1b31b0684
|
Improve docs and fix the broken links (#1875)
|
2024-11-01 17:47:44 -07:00 |
|
Chayenne
|
3bf3d011ed
|
Add vlm document (#1866)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-11-01 00:51:15 -07:00 |
|
Chayenne
|
61cf00e112
|
change file tree (#1859)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-10-31 20:10:16 -07:00 |
|
Lianmin Zheng
|
a2e0424abf
|
Fix memory leak for chunked prefill 2 (#1858)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2024-10-31 14:51:51 -07:00 |
|
Lianmin Zheng
|
d913d52c9a
|
Fix warnings in doc build (#1852)
|
2024-10-30 22:28:00 -07:00 |
|
Lianmin Zheng
|
0ab7bcaf66
|
Simplify documentation in README.md (#1851)
|
2024-10-30 21:57:49 -07:00 |
|
Chayenne
|
4ba815b84e
|
Fix suggest edit (#1842)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-10-30 12:28:12 -07:00 |
|
Lianmin Zheng
|
3184aa95a7
|
Update README.md (#1840)
|
2024-10-30 03:16:43 -07:00 |
|
Lianmin Zheng
|
b548801ddb
|
Update docs (#1839)
|
2024-10-30 02:49:08 -07:00 |
|
Chayenne
|
539df95d2c
|
Imporve openai api documents (#1827)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-10-30 00:39:41 -07:00 |
|
Chayenne
|
51c81e339b
|
Add openAI compatible API (#1810)
Co-authored-by: Chayenne <zhaochenyang@g.ucla.edu>
|
2024-10-27 10:51:42 -07:00 |
|
Lianmin Zheng
|
1be853ee69
|
Update hyperparameter_tuning.md (#1813)
|
2024-10-26 21:08:44 -07:00 |
|
Chayenne
|
ced362f7c6
|
Simplify our docs with complicated functions into utils (#1807)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
|
2024-10-26 17:44:11 +00:00 |
|
Lianmin Zheng
|
9084a86445
|
Update links (#1805)
|
2024-10-26 04:46:01 -07:00 |
|
Lianmin Zheng
|
6aa94b967c
|
Update ci workflows (#1804)
|
2024-10-26 04:32:36 -07:00 |
|
Chayenne
|
715b16c140
|
Add support for ipynb (#1786)
|
2024-10-25 20:48:35 -07:00 |
|
Lianmin Zheng
|
30643fed7f
|
Release v0.3.4.post2 (#1796)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
|
2024-10-25 11:07:19 -07:00 |
|
Lianmin Zheng
|
e646c5901e
|
Fix logprob in the overlapped mode (#1795)
|
2024-10-25 11:06:57 -07:00 |
|
Lianmin Zheng
|
b7d0559496
|
Update docs (#1768)
Co-authored-by: Chayenne Zhao <zhaochenyang20@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
|
2024-10-23 11:28:48 -07:00 |
|
Lianmin Zheng
|
ad4125d1a9
|
Fuse more ops & Simplify token mapping (#1758)
|
2024-10-22 23:20:43 -07:00 |
|
Byron Hsu
|
cd0be7489f
|
[doc] improve engine doc and add to readme (#1670)
|
2024-10-14 19:56:21 -07:00 |
|
Byron Hsu
|
c3f2fc5a7a
|
[doc] Add engine section in backend.md (#1656)
|
2024-10-13 00:33:58 -07:00 |
|
Theresa Barton
|
2c7d0a5b8b
|
[Fix] Fix all the Huggingface paths (#1553)
|
2024-10-02 10:12:07 -07:00 |
|
Lianmin Zheng
|
36d5acfca5
|
Rename InputMetadata -> ForwardBatch (#1543)
|
2024-09-30 02:41:11 -07:00 |
|
Lianmin Zheng
|
048685430d
|
Improve process creation (#1534)
|
2024-09-29 02:36:12 -07:00 |
|
Lianmin Zheng
|
4e4459b91f
|
Multiple minor fixes (#1530)
|
2024-09-28 14:43:35 -07:00 |
|
Ying Sheng
|
6f3cf1297e
|
[CI, AMD] Add AMD tests to CI (#1491)
|
2024-09-22 04:45:10 -07:00 |
|
Lianmin Zheng
|
167591e864
|
Better unit tests for adding a new model (#1488)
|
2024-09-22 01:50:37 -07:00 |
|
Yineng Zhang
|
441c22db8c
|
doc: update backend (#1486)
|
2024-09-21 22:05:12 +08:00 |
|
Ran Chen
|
ce636ac441
|
fix incorrect links in documentation (#1481)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2024-09-21 20:36:23 +08:00 |
|
Lianmin Zheng
|
7f24ea95c3
|
Fuse top_k and top_k in the sampler (#1457)
|
2024-09-18 04:35:35 -07:00 |
|
Ke Bao
|
c6b6d2e71b
|
Enable MLA by default (#1447)
|
2024-09-17 11:42:48 +00:00 |
|
Lianmin Zheng
|
e79f6cd73d
|
Release v0.3.1 (#1430)
|
2024-09-15 23:03:16 +09:00 |
|
Lianmin Zheng
|
9ba1f09760
|
[Fix] Fix logprob and normalized_logprob (#1428)
|
2024-09-15 06:36:06 -07:00 |
|
Lianmin Zheng
|
282681b8a1
|
Update backend.md (#1429)
|
2024-09-15 02:55:34 -07:00 |
|
Lianmin Zheng
|
46094e0c1b
|
Deprecate --disable-flashinfer and introduce --attention-backend (#1380)
|
2024-09-10 17:11:16 -07:00 |
|
Lianmin Zheng
|
8d1095dbf0
|
[Docs] Improve documentations (#1368)
|
2024-09-09 20:48:28 -07:00 |
|