Lianmin Zheng 8f790ac100 Fix a bug in cuda graph runner (#1094)

2024-08-14 03:25:38 -07:00

..

constrained

Fix jump forward final state circular path bug. (#1084)

2024-08-13 21:14:05 -07:00

layers

[Feat] Add window attention for gemma-2 (#1056)

2024-08-13 17:01:26 -07:00

managers

Fix create_abort_task, GenerateReqInput does not have rids. (#1079)

2024-08-13 12:47:22 +00:00

mem_cache

Re-organize CI tests (#1052)

2024-08-12 03:39:01 -07:00

model_executor

Fix a bug in cuda graph runner (#1094)

2024-08-14 03:25:38 -07:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

[Feat] Add window attention for gemma-2 (#1056)

2024-08-13 17:01:26 -07:00

openai_api

Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

Fix CI && python3.8 compatible (#920)

2024-08-04 16:02:05 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

Support MLA for DeepSeek-V2 with Triton - step 1 (#905)

2024-08-05 03:40:33 +10:00

sampling_params.py

Add skip_tokenizer_init args. (#959)

2024-08-09 12:14:13 -07:00

server_args.py

[Feat] Add window attention for gemma-2 (#1056)

2024-08-13 17:01:26 -07:00

server.py

[Feature] modify Runtime to support skip_tokenizer_init (#1088)

2024-08-14 00:28:04 -07:00

utils.py

Add skip_tokenizer_init args. (#959)

2024-08-09 12:14:13 -07:00