Lianmin Zheng 57d0bd91ec Improve benchmark (#1140)

2024-08-17 17:43:23 -07:00

..

constrained

Fix jump forward final state circular path bug. (#1084)

2024-08-13 21:14:05 -07:00

layers

Fix the deadlock in multi-node tp (#1122)

2024-08-16 01:39:24 -07:00

managers

Improve the code style: more comments and remove useless packages (#1139)

2024-08-17 14:37:52 -07:00

mem_cache

Re-organize CI tests (#1052)

2024-08-12 03:39:01 -07:00

model_executor

fix: use fp16 dtype for sm75 (#1136)

2024-08-18 00:45:42 +10:00

models

Fix the deadlock in multi-node tp (#1122)

2024-08-16 01:39:24 -07:00

openai_api

Support jinja as chat template file (#1104)

2024-08-14 17:43:14 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

Improve benchmark (#1140)

2024-08-17 17:43:23 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

Support MLA for DeepSeek-V2 with Triton - step 1 (#905)

2024-08-05 03:40:33 +10:00

sampling_params.py

Use dtype to control generate (#1082)

2024-08-14 15:58:07 +00:00

server_args.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

server.py

Improve the code style: more comments and remove useless packages (#1139)

2024-08-17 14:37:52 -07:00

utils.py

Update grok 1 model (#1095)

2024-08-14 04:40:44 -07:00