HAI 10189d08dd [Performance]: Process affinity to CPU cores with multiple sockets support (#2171)

2024-11-25 14:57:32 -08:00

..

configs

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

constrained

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

layers

feat: fused_moe fp8 monkey patch (#2174)

2024-11-25 17:06:36 +08:00

lora

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

managers

[Performance]: Process affinity to CPU cores with multiple sockets support (#2171)

2024-11-25 14:57:32 -08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_executor

Use custom allreduce w/ torch.compile (#2185)

2024-11-25 14:55:01 -08:00

models

Rename triton_fused_moe -> fused_moe_triton (#2163)

2024-11-24 08:12:35 -08:00

openai_api

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampling

[Fix] Avoid calling fill_vocab_mask for terminated requests (#2175)

2024-11-25 17:31:25 +08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

[minor] Clean up unused imports (#2122)

2024-11-22 01:50:42 -08:00

server_args.py

Fix mixed chunked prefill in overlap mode (#2158)

2024-11-24 07:17:37 -08:00

server.py

Merged three native APIs into one: get_server_info (#2152)

2024-11-24 01:37:58 -08:00

utils.py

[Performance]: Process affinity to CPU cores with multiple sockets support (#2171)

2024-11-25 14:57:32 -08:00