Lianmin Zheng 09798b36cd Fix chunked prefill size for bench_offline_throughput (#2234)

2024-11-27 23:37:20 -08:00

..

sglang

Fix chunked prefill size for bench_offline_throughput (#2234)

2024-11-27 23:37:20 -08:00

pyproject.toml

Release v0.3.6.post2 (#2214)

2024-11-27 03:35:30 -08:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00