Ninglin Du 840c5dbcb3 [FIX] Catch syntax error of Regex Guide to avoid crash (#1521)

2024-09-28 12:42:06 -07:00

..

configs

minor: fix config (#1524)

2024-09-27 01:49:16 -07:00

constrained

[FIX] Catch syntax error of Regex Guide to avoid crash (#1521)

2024-09-28 12:42:06 -07:00

layers

Add float8 dynamic quant to torchao_utils (#1528)

2024-09-28 12:27:54 -07:00

lora

[Feature, Hardware] Enable SGLang on AMD GPUs via PyTorch for ROCm (#1420)

2024-09-17 07:43:52 +00:00

managers

[Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525)

2024-09-27 23:32:11 -07:00

mem_cache

debug radixcache stack_overflow (#1499)

2024-09-24 04:58:01 -07:00

model_executor

[Fix] Ignore import error (#1513)

2024-09-25 11:32:21 -07:00

models

[Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525)

2024-09-27 23:32:11 -07:00

openai_api

[API, Feature] Support response prefill for openai API (#1490)

2024-09-22 06:46:17 -07:00

sampling

Simplify sampler and its error handling (#1441)

2024-09-16 21:23:31 -07:00

conversation.py

[Minor] move triton attention kernels into a separate folder (#1379)

2024-09-10 15:15:08 -07:00

hf_transformers_utils.py

[Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510)

2024-09-24 21:37:33 -07:00

mm_utils.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

server_args.py

Add bench_server_latency.py (#1452)

2024-09-18 00:56:06 -07:00

server.py

[Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525)

2024-09-27 23:32:11 -07:00

utils.py

[Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525)

2024-09-27 23:32:11 -07:00