Byron Hsu 30af7dfb34 [router] add base_gpu_id server args & merged radix tree python reference (#2115)

2024-11-21 17:13:33 -08:00

..

lora

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

router

[router] add base_gpu_id server args & merged radix tree python reference (#2115)

2024-11-21 17:13:33 -08:00

launch_tgi.sh

Add OpenAI backend to the CI test (#869)

2024-08-01 09:25:24 -07:00

load_tokenizer.py

Add OpenAI backend to the CI test (#869)

2024-08-01 09:25:24 -07:00

reference_hf.py

Support cuda graph for DP attention (#2061)

2024-11-17 16:29:20 -08:00

test_session_id.py

Move test_session_id.py to playground (#2104)

2024-11-20 01:28:27 -08:00