yichuan~ b997a18d74 [Feat]Add support for optional start len of logprobs (#1035) ...

Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

2024-08-18 23:45:41 -07:00

..

constrained

Fix jump forward final state circular path bug. (#1084)

2024-08-13 21:14:05 -07:00

layers

[Feat]Add support for optional start len of logprobs (#1035)

2024-08-18 23:45:41 -07:00

managers

[Feat]Add support for optional start len of logprobs (#1035)

2024-08-18 23:45:41 -07:00

mem_cache

Re-organize CI tests (#1052)

2024-08-12 03:39:01 -07:00

model_executor

[Feat]Add support for optional start len of logprobs (#1035)

2024-08-18 23:45:41 -07:00

models

Fix the deadlock in multi-node tp (#1122)

2024-08-16 01:39:24 -07:00

openai_api

[Feat]Add support for optional start len of logprobs (#1035)

2024-08-18 23:45:41 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

Fix duplicated imports in hf_transformers_utils.py (#1141)

2024-08-17 18:03:00 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

Support MLA for DeepSeek-V2 with Triton - step 1 (#905)

2024-08-05 03:40:33 +10:00

sampling_params.py

Use dtype to control generate (#1082)

2024-08-14 15:58:07 +00:00

server_args.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

server.py

[Feat]Add support for optional start len of logprobs (#1035)

2024-08-18 23:45:41 -07:00

utils.py

Update grok 1 model (#1095)

2024-08-14 04:40:44 -07:00