project6-dev f1a408c75f fix: cap default_max_tokens at 8192 — prevent OOM kill on unlimited generation ...

t3_max_tokens_none test sends request without max_tokens.
With max_model_len=262144, default_max_tokens was ~260K tokens.
Model generates indefinitely at 12 TPS, container gets OOM killed after ~6min.
Cap at 8192 prevents memory exhaustion while still allowing long outputs.

2026-08-12 04:06:21 +00:00

..

prebuilt/corex-3.2.3-ivcore10

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

qwen3_5

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

qwen3_5_moe

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

reasoning

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

vendor_overrides/vllm

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

wheels

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

api_server.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

bi100_env.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

bi100_profile.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

block_major_kv_cache.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_attn_head_rms_norm.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_fused_paged_prefill_split4.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_gdn_beta_decay.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_gdn_causal_conv.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_gdn_gated_norm.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_gdn_packed_decode.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_gdn_qk_map.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_moe_direct_routed.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_moe_exact_reduce.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_moe_weight_gather.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

build_corex_paged_kv_gather.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

chat_utils.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

cli_args.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_attn_head_rms_norm.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_block_major_kv_transfer.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_fused_paged_prefill_split4.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_gdn_beta_decay.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_gdn_causal_conv.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_gdn_gated_norm.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_gdn_packed_decode.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_gdn_qk_map.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_moe_direct_routed.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_moe_exact_reduce.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_moe_weight_gather.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_paged_kv_gather.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

corex_query_tiled_paged_prefill.cu

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

gdn_prefix.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

install_prebuilt_corex.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

mamba_cache.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

paged_attn.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_block_major_cache_engine.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_block_major_worker_capacity.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_block_manager_cache_trace.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_corex_swap_blocks.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_executor_startup_debug.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_model_runner.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_ops.sh

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_transformers_qwen3_5.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_utils.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_vllm_qwen3_5.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_vllm_tool_parser.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_worker_cache_transfer_order.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_worker_profile_override.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_worker_startup_profile_guard.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_xformers_profile.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_xformers_sdpa_batch_kernel.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_xformers_sdpa_batch.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_xformers_sdpa_seq_kernel.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

patch_xformers_sdpa_seq.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

protocol.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

qwen3_5.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

qwen3coder_tool_parser.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

scheduler.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

sequence.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00

serving_chat.py

fix: cap default_max_tokens at 8192 — prevent OOM kill on unlimited generation

2026-08-12 04:06:21 +00:00

serving_tokenization.py

wudixzy stack docker build test: 2615-line qwen3_5.py + 12 prebuilt .so + 251-line patch_ops.sh

2026-08-12 03:17:31 +00:00