Lianmin Zheng 7e4c6dd8da Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00

..

configs

Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2222)

2024-11-27 02:52:46 -08:00

constrained

Update XGrammar to the latest API (#2176)

2024-11-25 15:58:30 -08:00

layers

Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00

lora

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

managers

[Fix] fix assertion error for chunked prefill when disabling cache (#2282)

2024-11-30 17:53:43 -08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_executor

Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00

models

Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00

openai_api

Support LoRA in Completion API (#2243)

2024-11-29 16:13:38 -08:00

sampling

[Fix] Avoid calling fill_vocab_mask for terminated requests (#2175)

2024-11-25 17:31:25 +08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

[minor] Clean up unused imports (#2122)

2024-11-22 01:50:42 -08:00

server_args.py

Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00

server.py

Add get weights by parameter name for llama (#2266)

2024-11-29 23:36:38 -08:00

utils.py

Revert "[FEAT] Support GGUF format" (#2285)

2024-11-30 19:03:26 -08:00