Liangsheng Yin 73cf6834f2 Support stop_token_ids in sglang API (#1092)

2024-08-15 00:31:39 +00:00

..

constrained

Fix jump forward final state circular path bug. (#1084)

2024-08-13 21:14:05 -07:00

layers

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

managers

Support stop_token_ids in sglang API (#1092)

2024-08-15 00:31:39 +00:00

mem_cache

Re-organize CI tests (#1052)

2024-08-12 03:39:01 -07:00

model_executor

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

Use dtype to control generate (#1082)

2024-08-14 15:58:07 +00:00

openai_api

Test the case when max_new_tokens is very large (#1038)

2024-08-11 16:41:03 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

Fix CI && python3.8 compatible (#920)

2024-08-04 16:02:05 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

Support MLA for DeepSeek-V2 with Triton - step 1 (#905)

2024-08-05 03:40:33 +10:00

sampling_params.py

Use dtype to control generate (#1082)

2024-08-14 15:58:07 +00:00

server_args.py

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

server.py

[Feature] modify Runtime to support skip_tokenizer_init (#1088)

2024-08-14 00:28:04 -07:00

utils.py

Update grok 1 model (#1095)

2024-08-14 04:40:44 -07:00