applesaucethebun d738ab52f8 fix some typos (#6209) ...

Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>

2025-05-13 01:42:38 +08:00

..

baichuan.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

bert.py

Feat/support encoder model (like bert) (#4887)

2025-04-17 01:50:48 -07:00

chatglm.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

clip.py

[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)

2025-05-08 10:01:19 -07:00

commandr.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

dbrx.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

deepseek_janus_pro.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

deepseek_nextn.py

[refactor] slightly tidy fp8 module (#5993)

2025-05-07 17:28:24 -07:00

deepseek_v2.py

Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558)

2025-05-11 23:36:29 -07:00

deepseek_vl2.py

[Fix]: support deepseek-vl2-tiny model (#5552)

2025-04-26 17:52:53 +08:00

deepseek.py

[Fix]: support deepseek-vl2-tiny model (#5552)

2025-04-26 17:52:53 +08:00

exaone.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

gemma2_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

gemma2.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

gemma3_causal.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

gemma3_mm.py

[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)

2025-05-08 10:01:19 -07:00

gemma.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

gpt2.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

gpt_bigcode.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

granite.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

grok.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

internlm2_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

internlm2.py

Support InternVL3 (#5350)

2025-05-01 22:38:59 -07:00

internvl.py

Support InternVL3 (#5350)

2025-05-01 22:38:59 -07:00

kimi_vl_moonvit.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

kimi_vl.py

[Feature] add support kimi vl model (#5383)

2025-04-29 21:31:19 -07:00

llama4.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

llama_classification.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama_eagle3.py

[PP] Add pipeline parallelism (#5724)

2025-04-30 18:18:07 -07:00

llama_eagle.py

[PP] Add pipeline parallelism (#5724)

2025-04-30 18:18:07 -07:00

llama_embedding.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama_reward.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

llama.py

Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558)

2025-05-11 23:36:29 -07:00

llava.py

refactor: multimodal data (#4754)

2025-03-31 09:57:51 -07:00

llavavid.py

refactor: multimodal data (#4754)

2025-03-31 09:57:51 -07:00

minicpm3.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

minicpm.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

minicpmo.py

vlm: enable radix cache for qwen-vl models (#5349)

2025-04-23 20:35:05 -07:00

minicpmv.py

[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)

2025-05-08 10:01:19 -07:00

mistral.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

mixtral_quant.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

mixtral.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

mllama4.py

vlm: enable radix cache for qwen-vl models (#5349)

2025-04-23 20:35:05 -07:00

mllama.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

olmo2.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

olmo.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

olmoe.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

phi3_small.py

Fix Phi3 serving which was broke by earlier change (#5991)

2025-05-03 00:28:47 -07:00

qwen2_5_vl.py

[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)

2025-05-08 10:01:19 -07:00

qwen2_classification.py

[Model] Support Qwen2ForSequenceClassification (#4609)

2025-03-24 19:13:44 -07:00

qwen2_eagle.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

qwen2_moe.py

[qwen3] support qwen3 ep moe (#5917)

2025-04-30 09:15:21 -07:00

qwen2_rm.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

qwen2_vl.py

[Feature] Add FlashAttention3 as a backend for VisionAttention (#5764)

2025-05-08 10:01:19 -07:00

qwen2.py

[Model] Adding Qwen3 and Qwen3MoE (#4693)

2025-04-18 09:51:29 -07:00

qwen3_moe.py

[qwen3] support qwen3 ep moe (#5917)

2025-04-30 09:15:21 -07:00

qwen3.py

[Model] Adding Qwen3 and Qwen3MoE (#4693)

2025-04-18 09:51:29 -07:00

qwen.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

registry.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

roberta.py

fix some typos (#6209)

2025-05-13 01:42:38 +08:00

stablelm.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

torch_native_llama.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

xiaomi_mimo.py

Support XiaomiMiMo/MiMo model inference (#5921)

2025-05-01 07:41:13 -07:00

xverse_moe.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

xverse.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

yivl.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00