Ying Sheng 60340a3643 Improve the coverage of the openai api server test (#878)

2024-08-01 16:01:30 -07:00

..

quantization

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

context_flashattention_nopad.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

extend_attention.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

fused_moe.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

linear.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

logits_processor.py

Improve the coverage of the openai api server test (#878)

2024-08-01 16:01:30 -07:00

radix_attention.py

Adjust default mem fraction to avoid OOM (#823)

2024-07-30 01:58:31 -07:00

token_attention.py

Code structure refactor (#807)

2024-07-29 23:04:48 -07:00