Liangsheng Yin 75ce37f401 Move sampler into CUDA graph (#1201) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>

2024-08-26 07:02:50 -07:00

..

chatglm.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

commandr.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

dbrx.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

deepseek_v2.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

deepseek.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

gemma2.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

gemma.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

gpt_bigcode.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

grok.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

internlm2.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

llama2.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

llama_classification.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

llama_embedding.py

Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186)

2024-08-25 10:29:12 -07:00

llava.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

llavavid.py

Organize code (rename, movement) (#953)

2024-08-06 20:50:32 -07:00

minicpm.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

mistral.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

mixtral_quant.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

mixtral.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

qwen2_moe.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

qwen2.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

qwen.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

stablelm.py

Move sampler into CUDA graph (#1201)

2024-08-26 07:02:50 -07:00

yivl.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00