Lianmin Zheng a97df79124 Clean up readme and arguments of chunked prefill (#1022)

2024-08-11 01:18:52 -07:00

..

constrained

Add skip_tokenizer_init args. (#959)

2024-08-09 12:14:13 -07:00

layers

feat: use FlashInfer rmsnorm and silu (#907)

2024-08-11 14:57:13 +10:00

managers

Clean up readme and arguments of chunked prefill (#1022)

2024-08-11 01:18:52 -07:00

mem_cache

Fix input_ids && rename to fill_ids (#1021)

2024-08-10 16:24:12 -07:00

model_executor

Fix input_ids && rename to fill_ids (#1021)

2024-08-10 16:24:12 -07:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

feat: use FlashInfer rmsnorm and silu (#907)

2024-08-11 14:57:13 +10:00

openai_api

Add openai embedding API (#997)

2024-08-09 11:19:18 -07:00

sampling/penaltylib

bugfix: penalizers to be merged before reqs (#1001)

2024-08-09 21:46:24 +10:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

Fix CI && python3.8 compatible (#920)

2024-08-04 16:02:05 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

Support MLA for DeepSeek-V2 with Triton - step 1 (#905)

2024-08-05 03:40:33 +10:00

sampling_params.py

Add skip_tokenizer_init args. (#959)

2024-08-09 12:14:13 -07:00

server_args.py

Clean up readme and arguments of chunked prefill (#1022)

2024-08-11 01:18:52 -07:00

server.py

feat: use FlashInfer rmsnorm and silu (#907)

2024-08-11 14:57:13 +10:00

utils.py

Add skip_tokenizer_init args. (#959)

2024-08-09 12:14:13 -07:00