DanielC12321 5e00ddebc0 Add new model: Gpt2 (#1833)

2024-10-29 17:52:33 -07:00

..

baichuan.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

chatglm.py

Add GLM-4 TextGeneration Model support for SGLang (#1736)

2024-10-21 04:08:30 +00:00

commandr.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

dbrx.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

deepseek_v2.py

Update vllm to 0.6.3 (#1711) (#1720)

2024-10-19 20:45:41 -07:00

deepseek.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

exaone.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

gemma2.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

gemma.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

gpt2.py

Add new model: Gpt2 (#1833)

2024-10-29 17:52:33 -07:00

gpt_bigcode.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

grok.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

internlm2.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

llama_classification.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

llama_embedding.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

llama_reward.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

llama.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

llava.py

Fix mixed batch for multi modal models (#1702)

2024-10-17 10:27:26 -07:00

llavavid.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

minicpm3.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

minicpm.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

mistral.py

[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

mixtral_quant.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

mixtral.py

[FP8 KV Cache, Mixtral] Avoid KeyError at loading pre-quantized FP8 m… (#1835)

2024-10-29 13:58:03 -07:00

mllama.py

Llama3.2 vision model support (#1551)

2024-10-21 15:01:21 -07:00

olmo.py

Use SGLang imports for linear layer (#1696)

2024-10-17 07:50:01 -07:00

olmoe.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

qwen2_moe.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

qwen2_vl.py

Llama3.2 vision model support (#1551)

2024-10-21 15:01:21 -07:00

qwen2.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

qwen.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

stablelm.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

torch_native_llama.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

xverse_moe.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

xverse.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00

yivl.py

[1/N] Remove CacheConfig import in all model files (#1658)

2024-10-14 09:06:34 -07:00