SangBin Cho 9208618b3e [Core] in batch prefix caching by delay scheduling (#2442)

2024-12-11 12:51:50 -08:00

..

backend

[Core] in batch prefix caching by delay scheduling (#2442)

2024-12-11 12:51:50 -08:00

__init__.py

release initial code

2024-01-08 04:37:50 +00:00

chat_template.py

Add support for IBM Granite 3.x models (#2437)

2024-12-11 06:30:23 -08:00

choices.py

Fix union operator (#940)

2024-08-06 00:46:34 +08:00

compiler.py

Support min-p sampling (#1167)

2024-08-21 22:49:32 +00:00

interpreter.py

Support setting use_thread in the run_program for easier debugging. (#1823)

2024-10-29 06:51:47 +00:00

ir.py

Support setting use_thread in the run_program for easier debugging. (#1823)

2024-10-29 06:51:47 +00:00

tracer.py

using is not not != to test None (#2196)

2024-11-26 01:00:38 -08:00