Chranos
ad087d5cf3
debugging
2026-02-11 17:47:14 +08:00
Chranos
6b708a43d8
fix: add logger import to llama.py for unknown weight skip warning
...
The previous commit added a warning log for skipping unknown weights
(e.g. embed_tokens.biases) but missed importing the logger.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-02-11 17:47:14 +08:00
Chranos
8efce7c44c
debugging
2026-02-11 17:47:14 +08:00
Chranos
7420866d4c
fixed kvcache bug
2026-02-11 17:47:14 +08:00
Chranos
3fed2190ad
fixing kvcache bug
2026-02-06 16:39:42 +08:00
Chranos
c1b6f39a11
fix: pass lm_head to LogitsProcessor instead of calling forward()
...
In vLLM v0.6.2, ParallelLMHead.forward() raises RuntimeError since
its weights should be used through LogitsProcessor.linear_method.apply().
Pass lm_head as first arg to LogitsProcessor which handles the
hidden_states -> logits projection internally.
2026-02-06 15:05:49 +08:00
Chranos
3e301ce158
testing dynamic register
2026-02-06 15:05:49 +08:00
Chranos
87f96e1001
testing dynamic register
2026-02-06 15:05:49 +08:00
Chranos
e1a2afd244
testing dynamic register
2026-02-06 15:05:49 +08:00
Chranos
63a1a05999
testing dynamic register
2026-02-06 15:05:49 +08:00
Chranos
6d814b0cd4
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
dc239a740c
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
a476b6458b
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
80e9a636af
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
16353d5d2a
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
70bee4e3ec
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
83c958a7c5
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
9b84dd52be
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
2cb9f6ce1d
testing dynamic register
2026-02-06 15:05:48 +08:00
Chranos
92f0016e6f
add dynamic register
2026-02-05 15:53:43 +08:00
Chranos
9563c9af0d
opt llama3
2026-02-05 11:53:52 +08:00
Chranos
8511fe8530
add qwen3
2026-02-04 17:22:39 +08:00
