Byron Hsu 862cd265e5 [engine] support async and streaming (#1614)

2024-10-11 15:26:25 -07:00

..

srt/sampling/penaltylib

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

few_shot_gsm8k_engine.py

[engine] support async and streaming (#1614)

2024-10-11 15:26:25 -07:00

few_shot_gsm8k.py

Add bench_server_latency.py (#1452)

2024-09-18 00:56:06 -07:00

long_prompt.txt

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

run_eval.py

Fix accuracy test (#1051)

2024-08-12 19:48:40 +10:00

runners.py

Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541)

2024-09-29 20:28:45 -07:00

simple_eval_common.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

Add longer accuracy test on CI (#1049)

2024-08-12 09:21:38 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

feat: use gelu_tanh_and_mul (#1193)

2024-08-24 01:58:16 -07:00

test_layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

test_programs.py

Support min_tokens in sgl.gen (#1573)

2024-10-05 21:51:12 -07:00

test_utils.py

default sampling param should be deepcopied (#1581)

2024-10-05 17:27:43 -07:00