Xiaoyu Zhang 286cad3ee3 h200 tuning fused_moe_triton config for Mixtral 8x7B/8x22B and Qwen2 57BA14B (#2689)

2024-12-31 23:17:36 +08:00

..

configs

Clean up wrapper in flashinfer backend (#2638)

2024-12-29 00:45:57 -08:00

constrained

[Feature] Support new parameter - EBNF in xgrammar (#2526)

2024-12-26 05:12:41 -08:00

distributed

adapt vllm distributed module to sglang (#2244)

2024-12-01 15:54:52 +08:00

layers

h200 tuning fused_moe_triton config for Mixtral 8x7B/8x22B and Qwen2 57BA14B (#2689)

2024-12-31 23:17:36 +08:00

lora

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

managers

Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684)

2024-12-31 02:25:05 -08:00

mem_cache

[Misc] Fix metrics, weight update lock, request logging (#2543)

2024-12-22 06:27:22 -08:00

metrics

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_executor

Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684)

2024-12-31 02:25:05 -08:00

model_loader

Error occurs when loading the gemma model in bitsandbytes format. (#2557)

2024-12-26 05:10:37 -08:00

models

AMD DeepSeek_V3 FP8 Numerical fix (#2667)

2024-12-30 21:31:12 +08:00

openai_api

[Fix] fix openai adapter (#2685)

2024-12-31 10:48:19 +00:00

sampling

Minor follow-up fixes for the logprob refactor (#2670)

2024-12-30 05:42:08 -08:00

speculative

Clean up wrapper in flashinfer backend (#2638)

2024-12-29 00:45:57 -08:00

_custom_ops.py

adapt vllm distributed module to sglang (#2244)

2024-12-01 15:54:52 +08:00

aio_rwlock.py

A better aio rwlock that guarantees the order (#2547)

2024-12-22 15:44:32 -08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

Make torch TP composable with torchao (#2436)

2024-12-11 04:21:42 -08:00

server_args.py

Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684)

2024-12-31 02:25:05 -08:00

server.py

[Docs] clean up structured outputs docs (#2654)

2024-12-29 23:57:16 -08:00

utils.py

[Feature] Function Calling (#2544)

2024-12-28 21:58:52 -08:00