Lianmin Zheng a2486eb58f Fix a bug with logprob streaming + chunked prefill (#2403)

2024-12-08 03:55:27 -08:00

..

data_parallel_controller.py

Crash the server correctly during error (#2231)

2024-11-28 00:22:39 -08:00

detokenizer_manager.py

nit: Remove busy waiting on scheduler (#2382)

2024-12-08 01:06:15 -08:00

image_processor.py

Simplify tokenizer manager (#2254)

2024-11-29 02:18:51 -08:00

io_struct.py

Online weight updates from torch.distributed (#2279)

2024-12-01 23:23:18 -08:00

schedule_batch.py

Resubmit MoE-EP (#2371)

2024-12-06 15:05:21 +08:00

schedule_policy.py

Fix chunked prefill when ignore eos (#2290)

2024-12-01 00:37:53 -08:00

scheduler.py

Fix a bug with logprob streaming + chunked prefill (#2403)

2024-12-08 03:55:27 -08:00

session_controller.py

Fix hash collision for multi modal models (#2256)

2024-11-29 03:15:58 -08:00

tokenizer_manager.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

tp_worker_overlap_thread.py

Fix the overlap for xgrammar (#2377)

2024-12-06 05:49:29 -08:00

tp_worker.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00