Qubitium c9de3e169c Eliminate 2 gpu ops during sampling when logit_bias is zero (#338) ...

Co-authored-by: hnyls2002 <hnyls2002@gmail.com>

2024-04-03 13:56:06 +08:00

..

backend

Fix llava parallelism/fork bug (#315)

2024-03-28 19:24:54 -07:00

lang

Fix llava parallelism/fork bug (#315)

2024-03-28 19:24:54 -07:00

srt

Eliminate 2 gpu ops during sampling when logit_bias is zero (#338)

2024-04-03 13:56:06 +08:00

test

Support oai in benchmark/mmlu (#323)

2024-03-22 13:37:57 -07:00

__init__.py

Update version to v0.1.14 (#324)

2024-03-22 13:42:22 -07:00

api.py

Fix RuntimeEndpoint (#279)

2024-03-11 05:24:24 -07:00

global_config.py

release initial code

2024-01-08 04:37:50 +00:00

launch_server.py

release initial code

2024-01-08 04:37:50 +00:00

utils.py

Fix RuntimeEndpoint (#279)

2024-03-11 05:24:24 -07:00