Juwan Yoo ab7875941b feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

..

models

chore: update vllm to 0.5.4 (#966)

2024-08-07 21:15:41 +10:00

sampling/penaltylib

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

run_suite.py

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

test_chunked_prefill.py

chore: update vllm to 0.5.4 (#966)

2024-08-07 21:15:41 +10:00

test_eval_accuracy.py

chore: update vllm to 0.5.4 (#966)

2024-08-07 21:15:41 +10:00

test_openai_server.py

support more optioin about usage in stream mode (#985)

2024-08-08 09:41:57 +00:00

test_srt_endpoint.py

chore: update vllm to 0.5.4 (#966)

2024-08-07 21:15:41 +10:00

test_torch_compile.py

chore: update vllm to 0.5.4 (#966)

2024-08-07 21:15:41 +10:00

test_vision_openai_server.py

chore: update vllm to 0.5.4 (#966)

2024-08-07 21:15:41 +10:00