min-xu-et 7dd8a7e6d9 fixed an error handling in bench_latency.py (#904)

2024-08-03 17:42:17 -07:00

..

constrained

Support chunked prefill when radix cache is disabled (#811)

2024-08-01 00:29:01 -07:00

layers

Improve the coverage of the openai api server test (#878)

2024-08-01 16:01:30 -07:00

managers

fixed an error handling in bench_latency.py (#904)

2024-08-03 17:42:17 -07:00

mem_cache

Support chunked prefill when radix cache is disabled (#811)

2024-08-01 00:29:01 -07:00

model_executor

misc: update cuda graph capture exception log (#894)

2024-08-03 00:40:52 +10:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

Fix llama for classification (#855)

2024-07-31 15:48:31 -07:00

openai_api

Fix the double BOS problem in the HF chat template (#888)

2024-08-02 00:30:50 -07:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

sampling_params.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

server_args.py

Implement served_model_name to customize model id when use local mode… (#749)

2024-08-01 17:13:51 -07:00

server.py

Implement served_model_name to customize model id when use local mode… (#749)

2024-08-01 17:13:51 -07:00

utils.py

Make scripts under /test/srt as unit tests (#875)

2024-08-01 14:34:55 -07:00