Ying Sheng 9f662501a3 Move torch.compile configs into cuda_graph_runner.py (#993)

2024-08-08 13:20:30 -07:00

..

constrained

Support chunked prefill when radix cache is disabled (#811)

2024-08-01 00:29:01 -07:00

layers

Add e5-mistral modules [unreachable code] - step 1/3 (#983)

2024-08-08 00:04:15 -07:00

managers

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

mem_cache

Fix chunked prefill (#984)

2024-08-07 22:28:42 -07:00

model_executor

Move torch.compile configs into cuda_graph_runner.py (#993)

2024-08-08 13:20:30 -07:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

Add io struct for embedding models [unreachable code] - step 2/3 (#987)

2024-08-08 07:52:31 +00:00

openai_api

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

sampling/penaltylib

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

Fix CI && python3.8 compatible (#920)

2024-08-04 16:02:05 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

Support MLA for DeepSeek-V2 with Triton - step 1 (#905)

2024-08-05 03:40:33 +10:00

sampling_params.py

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

server_args.py

Support multiple args options (#941)

2024-08-06 04:12:53 +10:00

server.py

Move torch.compile configs into cuda_graph_runner.py (#993)

2024-08-08 13:20:30 -07:00

utils.py

Move torch.compile configs into cuda_graph_runner.py (#993)

2024-08-08 13:20:30 -07:00