dylanyunlong/project_6
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
06d56f6ff8eaae0aeb10b33418e91edf75ebd0db
project_6/sub791dockerrizhi_clean.txt
root 06d56f6ff8 sub791 docker rizhi log
2026-08-24 17:01:22 +00:00

3345 lines
610 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

2026-08-21T09:01:45.658004498Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:01:45.658066491Z import pynvml # type: ignore[import]
2026-08-21T09:01:47.200984875Z INFO 08-21 09:01:47 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:01:48.689063592Z 2026-08-21 09:01:48.688962: I tensorflow/core/util/port.cc:110] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2026-08-21T09:01:48.742734644Z 2026-08-21 09:01:48.742677: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
2026-08-21T09:01:48.742746164Z To enable the following instructions: SSE3 SSE4.1 SSE4.2 AVX AVX2 AVX512F AVX512_VNNI AVX512_BF16 AVX_VNNI AMX_TILE AMX_INT8 AMX_BF16 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-08-21T09:01:48.773931628Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:01:54.159789381Z INFO 08-21 09:01:54 api_server.py:1006] vLLM API server version 0.6.3
2026-08-21T09:01:54.160020367Z INFO 08-21 09:01:54 api_server.py:1007] args: Namespace(host=None, port=8000, uvicorn_log_level='info', allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], api_key=None, lora_modules=None, prompt_adapters=None, chat_template=None, response_role='assistant', ssl_keyfile=None, ssl_certfile=None, ssl_ca_certs=None, ssl_cert_reqs=0, root_path=None, middleware=[], return_tokens_as_token_ids=False, disable_frontend_multiprocessing=True, enable_auto_tool_choice=True, tool_call_parser='qwen3_coder', tool_parser_plugin='', reasoning_parser='qwen3', model='/model', tokenizer=None, skip_tokenizer_init=False, revision=None, code_revision=None, tokenizer_revision=None, tokenizer_mode='auto', trust_remote_code=True, download_dir=None, load_format='auto', config_format='auto', dtype='auto', kv_cache_dtype='auto', quantization_param_path=None, max_model_len=262144, guided_decoding_backend='outlines', distributed_executor_backend=None, worker_use_ray=False, pipeline_parallel_size=1, tensor_parallel_size=4, max_parallel_loading_workers=None, ray_workers_use_nsight=False, block_size=16, enable_prefix_caching=True, disable_sliding_window=False, use_v2_block_manager=True, num_lookahead_slots=0, seed=0, swap_space=4, cpu_offload_gb=0, gpu_memory_utilization=0.9, num_gpu_blocks_override=None, max_num_batched_tokens=8192, max_num_seqs=1, max_logprobs=20, disable_log_stats=False, quantization=None, rope_scaling=None, rope_theta=None, enforce_eager=True, max_context_len_to_capture=None, max_seq_len_to_capture=32768, disable_custom_all_reduce=False, tokenizer_pool_size=0, tokenizer_pool_type='ray', tokenizer_pool_extra_config=None, limit_mm_per_prompt=None, mm_processor_kwargs=None, enable_lora=False, max_loras=1, max_lora_rank=16, lora_extra_vocab_size=256, lora_dtype='auto', long_lora_scaling_factors=None, max_cpu_loras=None, fully_sharded_loras=False, enable_prompt_adapter=False, max_prompt_adapters=1, max_prompt_adapter_token=0, device='auto', num_scheduler_steps=1, multi_step_stream_outputs=True, scheduler_delay_factor=0.0, enable_chunked_prefill=True, speculative_model=None, speculative_model_quantization=None, num_speculative_tokens=None, speculative_disable_mqa_scorer=False, speculative_draft_tensor_parallel_size=None, speculative_max_model_len=None, speculative_disable_by_batch_size=None, ngram_prompt_lookup_max=None, ngram_prompt_lookup_min=None, spec_decoding_acceptance_method='rejection_sampler', typical_acceptance_sampler_posterior_threshold=None, typical_acceptance_sampler_posterior_alpha=None, disable_logprobs_during_spec_decoding=None, model_loader_extra_config=None, ignore_patterns=[], preemption_mode=None, served_model_name=['llm'], qlora_adapter_name_or_path=None, otlp_traces_endpoint=None, collect_detailed_traces=None, disable_async_output_proc=False, override_neuron_config=None, scheduling_policy='fcfs', disable_log_requests=True, max_log_len=None, disable_fastapi_docs=False)
2026-08-21T09:01:54.175663565Z INFO 08-21 09:01:54 config.py:1670] Downcasting torch.float32 to torch.float16.
2026-08-21T09:02:04.790340814Z INFO 08-21 09:02:04 arg_utils.py:909] Keeping prefix caching enabled for the Qwen3.6 native vision path.
2026-08-21T09:02:04.790824978Z INFO 08-21 09:02:04 config.py:887] Defaulting to use mp for distributed inference
2026-08-21T09:02:04.791125425Z INFO 08-21 09:02:04 config.py:1005] Chunked prefill is enabled with max_num_batched_tokens=8192.
2026-08-21T09:02:04.791228968Z WARNING 08-21 09:02:04 config.py:380] To see benefits of async output processing, enable CUDA graph. Since, enforce-eager is enabled, async output processor cannot be used
2026-08-21T09:02:04.797776622Z INFO 08-21 09:02:04 llm_engine.py:237] Initializing an LLM engine (v0.6.3) with config: model='/model', speculative_config=None, tokenizer='/model', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=262144, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=4, pipeline_parallel_size=1, disable_custom_all_reduce=True, quantization=None, enforce_eager=True, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=0, served_model_name=llm, use_v2_block_manager=True, num_scheduler_steps=1, chunked_prefill_enabled=True multi_step_stream_outputs=True, enable_prefix_caching=True, use_async_output_proc=False, use_cached_outputs=False, mm_processor_kwargs=None)
2026-08-21T09:02:05.293565575Z WARNING 08-21 09:02:05 multiproc_gpu_executor.py:58] Reducing Torch parallelism from 64 threads to 1 to avoid unnecessary CPU contention. Set OMP_NUM_THREADS in the external environment to tune this value as needed.
2026-08-21T09:02:05.335736867Z INFO 08-21 09:02:05 custom_cache_manager.py:17] Setting Triton cache manager to: vllm.triton_utils.custom_cache_manager:CustomCacheManager
2026-08-21T09:02:05.393315501Z INFO 08-21 09:02:05 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:05.393341804Z INFO 08-21 09:02:05 selector.py:115] Using XFormers backend.
2026-08-21T09:02:05.807302697Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.807309638Z import pynvml # type: ignore[import]
2026-08-21T09:02:05.824127325Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.824137656Z import pynvml # type: ignore[import]
2026-08-21T09:02:05.824256931Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.824269321Z import pynvml # type: ignore[import]
2026-08-21T09:02:07.329940131Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:07.337795612Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:07.337940204Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:08.918983194Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:08.918992985Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:08.918996192Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:14.460559487Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.460602035Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.461994280Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.462040598Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.471925854Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.471977270Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.482641607Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.483730800Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.493826451Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.817030241Z INFO 08-21 09:02:14 shm_broadcast.py:242] vLLM message queue communication handle: Handle(connect_ip='127.0.0.1', local_reader_ranks=[1, 2, 3], buffer=<vllm.distributed.device_communicators.shm_broadcast.ShmRingBuffer object at 0x7f0366c81930>, local_subscribe_port=59293, remote_subscribe_port=None)
2026-08-21T09:02:14.847415260Z INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.847614690Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.847739181Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.848387320Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.858988644Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=2 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.859467814Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=1 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.864551807Z INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=0 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.864802679Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=3 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.903080269Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.903130512Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.903137640Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.903191892Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.914028211Z INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.914071736Z INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.920641847Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.920693615Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:15.030346513Z
Loading safetensors checkpoint shards: 0% Completed | 0/16 [00:00<?, ?it/s]
2026-08-21T09:02:16.308418803Z
Loading safetensors checkpoint shards: 6% Completed | 1/16 [00:01<00:19, 1.28s/it]
2026-08-21T09:02:17.410325122Z
Loading safetensors checkpoint shards: 12% Completed | 2/16 [00:02<00:16, 1.17s/it]
2026-08-21T09:02:18.108433367Z
Loading safetensors checkpoint shards: 19% Completed | 3/16 [00:03<00:12, 1.05it/s]
2026-08-21T09:02:19.361631768Z
Loading safetensors checkpoint shards: 25% Completed | 4/16 [00:04<00:12, 1.07s/it]
2026-08-21T09:02:20.333177153Z
Loading safetensors checkpoint shards: 31% Completed | 5/16 [00:05<00:11, 1.04s/it]
2026-08-21T09:02:21.387274259Z
Loading safetensors checkpoint shards: 38% Completed | 6/16 [00:06<00:10, 1.04s/it]
2026-08-21T09:02:22.477924192Z
Loading safetensors checkpoint shards: 44% Completed | 7/16 [00:07<00:09, 1.06s/it]
2026-08-21T09:02:23.607999684Z
Loading safetensors checkpoint shards: 50% Completed | 8/16 [00:08<00:08, 1.08s/it]
2026-08-21T09:02:25.004995477Z
Loading safetensors checkpoint shards: 56% Completed | 9/16 [00:09<00:08, 1.18s/it]
2026-08-21T09:02:26.215485822Z
Loading safetensors checkpoint shards: 62% Completed | 10/16 [00:11<00:07, 1.19s/it]
2026-08-21T09:02:27.238527591Z
Loading safetensors checkpoint shards: 69% Completed | 11/16 [00:12<00:05, 1.14s/it]
2026-08-21T09:02:28.587124231Z
Loading safetensors checkpoint shards: 75% Completed | 12/16 [00:13<00:04, 1.20s/it]
2026-08-21T09:02:29.862053227Z
Loading safetensors checkpoint shards: 81% Completed | 13/16 [00:14<00:03, 1.22s/it]
2026-08-21T09:02:30.830194860Z
Loading safetensors checkpoint shards: 88% Completed | 14/16 [00:15<00:02, 1.15s/it]
2026-08-21T09:02:31.908294943Z
Loading safetensors checkpoint shards: 94% Completed | 15/16 [00:16<00:01, 1.13s/it]
2026-08-21T09:02:33.067985413Z
Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:18<00:00, 1.14s/it]
2026-08-21T09:02:33.068138250Z
Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:18<00:00, 1.13s/it]
2026-08-21T09:02:33.068152573Z
2026-08-21T09:02:33.515702169Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.517444102Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.518183686Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.531917125Z INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:09:17.971298089Z INFO 08-21 09:09:17 distributed_gpu_executor.py:57] # GPU blocks: 68837, # CPU blocks: 26214
2026-08-21T09:09:17.971331531Z INFO 08-21 09:09:17 distributed_gpu_executor.py:61] Maximum concurrency for 262144 tokens per request: 4.20x
2026-08-21T09:09:24.221172872Z INFO 08-21 09:09:24 serving_chat.py:230] "auto" tool choice has been enabled please note that while the parallel_tool_calls client option is preset for compatibility reasons, it will be ignored.
2026-08-21T09:09:24.222523596Z INFO 08-21 09:09:24 serving_chat.py:252] Reasoning parser 'qwen3' enabled.
2026-08-21T09:09:24.222583618Z WARNING 08-21 09:09:24 serving_embedding.py:199] embedding_mode is False. Embedding API will not work.
2026-08-21T09:09:24.222639176Z INFO 08-21 09:09:24 launcher.py:19] Available routes are:
2026-08-21T09:09:24.222672190Z INFO 08-21 09:09:24 launcher.py:27] Route: /openapi.json, Methods: HEAD, GET
2026-08-21T09:09:24.222701996Z INFO 08-21 09:09:24 launcher.py:27] Route: /docs, Methods: HEAD, GET
2026-08-21T09:09:24.222721615Z INFO 08-21 09:09:24 launcher.py:27] Route: /docs/oauth2-redirect, Methods: HEAD, GET
2026-08-21T09:09:24.222739200Z INFO 08-21 09:09:24 launcher.py:27] Route: /redoc, Methods: HEAD, GET
2026-08-21T09:09:24.222762599Z INFO 08-21 09:09:24 launcher.py:27] Route: /health, Methods: GET
2026-08-21T09:09:24.222783073Z INFO 08-21 09:09:24 launcher.py:27] Route: /tokenize, Methods: POST
2026-08-21T09:09:24.222806133Z INFO 08-21 09:09:24 launcher.py:27] Route: /detokenize, Methods: POST
2026-08-21T09:09:24.222823336Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/models, Methods: GET
2026-08-21T09:09:24.222843383Z INFO 08-21 09:09:24 launcher.py:27] Route: /version, Methods: GET
2026-08-21T09:09:24.222864866Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/chat/completions, Methods: POST
2026-08-21T09:09:24.222889197Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/completions, Methods: POST
2026-08-21T09:09:24.222905163Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/embeddings, Methods: POST
2026-08-21T09:09:24.241722634Z INFO: Started server process [1]
2026-08-21T09:09:24.241761044Z INFO: Waiting for application startup.
2026-08-21T09:09:24.242117727Z INFO: Application startup complete.
2026-08-21T09:09:24.242456628Z INFO: Uvicorn running on socket ('0.0.0.0', 8000) (Press CTRL+C to quit)
2026-08-21T09:09:44.973197045Z INFO: 172.17.0.1:33364 - "GET /health HTTP/1.1" 200 OK
2026-08-21T09:09:44.973986694Z INFO: 172.17.0.1:33364 - "GET /v1/models HTTP/1.1" 200 OK
2026-08-21T09:14:28.081063579Z INFO: 172.28.22.23:62189 - "GET /get_model_info HTTP/1.1" 404 Not Found
2026-08-21T09:14:28.083008410Z INFO: 172.28.22.23:48998 - "GET /get_server_info HTTP/1.1" 404 Not Found
2026-08-21T09:14:28.084421200Z INFO: 172.28.22.23:11136 - "GET /version HTTP/1.1" 200 OK
2026-08-21T09:14:28.546029658Z /usr/local/lib/python3.10/site-packages/pyairports/airports.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
2026-08-21T09:14:28.546035808Z from pkg_resources import resource_string
2026-08-21T09:14:31.031121478Z (VllmWorkerProcess pid=346) [BI100 PAGED_ATTN] decode_dispatch pid=346 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031157164Z (VllmWorkerProcess pid=345) [BI100 PAGED_ATTN] decode_dispatch pid=345 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031163055Z (VllmWorkerProcess pid=344) [BI100 PAGED_ATTN] decode_dispatch pid=344 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031174737Z [BI100 PAGED_ATTN] decode_dispatch pid=1 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:43.397959566Z INFO: 172.28.22.23:53703 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:14:56.712244813Z INFO: 172.28.22.23:42828 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:14:58.596985410Z INFO: 172.28.22.23:51862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:11.397216815Z INFO: 172.28.22.23:1803 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:11.527574677Z INFO: 172.28.22.23:45024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:16.668971652Z INFO 08-21 09:15:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-42885c3fc59a4603aa7a0b42cd5ba992 logical_start=0 logical_end=278 capped_end=272 physical_query_tokens=272
2026-08-21T09:15:22.809614262Z INFO: 172.28.22.23:16326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:22.938607196Z INFO 08-21 09:15:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c0ce10551734cc1af312b89f492bee7 logical_start=0 logical_end=36 capped_end=32 physical_query_tokens=32
2026-08-21T09:15:57.870375882Z INFO: 172.28.22.23:9657 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:58.450948648Z INFO 08-21 09:15:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c71140f8f214f919ddc14bfbde097f8 logical_start=0 logical_end=103 capped_end=96 physical_query_tokens=96
2026-08-21T09:16:34.673208668Z INFO: 172.28.22.23:38894 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:34.813601340Z INFO: 172.28.22.23:36520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:34.944326000Z INFO 08-21 09:16:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-573a281ccacc4e3ba6b391206492641d logical_start=0 logical_end=2576 capped_end=2560 physical_query_tokens=2560
2026-08-21T09:16:46.779132172Z INFO: 172.28.22.23:38743 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:46.905156615Z INFO 08-21 09:16:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4d6cb0370bac410c91d990926b58f78d checkpoint_tokens=2560 logical_tokens=2576 physical_query_tokens=16
2026-08-21T09:16:49.748182895Z INFO 08-21 09:16:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91c57d108cc94637b46ec1013b7dc374 logical_start=0 logical_end=61 capped_end=48 physical_query_tokens=48
2026-08-21T09:18:40.508209204Z INFO: 172.28.22.23:64130 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:18:45.788068145Z ERROR 08-21 09:18:45 serving_chat.py:351] Error in loading multi-modal data
2026-08-21T09:18:45.788113332Z ERROR 08-21 09:18:45 serving_chat.py:351] Traceback (most recent call last):
2026-08-21T09:18:45.788116769Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 770, in _request
2026-08-21T09:18:45.788119451Z ERROR 08-21 09:18:45 serving_chat.py:351] resp = await handler(req)
2026-08-21T09:18:45.788122901Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 725, in _connect_and_send_request
2026-08-21T09:18:45.788125748Z ERROR 08-21 09:18:45 serving_chat.py:351] conn = await self._connector.connect(
2026-08-21T09:18:45.788127966Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 642, in connect
2026-08-21T09:18:45.788130504Z ERROR 08-21 09:18:45 serving_chat.py:351] proto = await self._create_connection(req, traces, timeout)
2026-08-21T09:18:45.788132451Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1209, in _create_connection
2026-08-21T09:18:45.788134512Z ERROR 08-21 09:18:45 serving_chat.py:351] _, proto = await self._create_direct_connection(req, traces, timeout)
2026-08-21T09:18:45.788136782Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1550, in _create_direct_connection
2026-08-21T09:18:45.788138782Z ERROR 08-21 09:18:45 serving_chat.py:351] transp, proto = await self._wrap_create_connection(
2026-08-21T09:18:45.788149409Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1283, in _wrap_create_connection
2026-08-21T09:18:45.788151631Z ERROR 08-21 09:18:45 serving_chat.py:351] return await self._loop.create_connection(*args, **kwargs, sock=sock)
2026-08-21T09:18:45.788153565Z ERROR 08-21 09:18:45 serving_chat.py:351] File "uvloop/loop.pyx", line 2088, in create_connection
2026-08-21T09:18:45.788155625Z ERROR 08-21 09:18:45 serving_chat.py:351] File "uvloop/loop.pyx", line 2083, in uvloop.loop.Loop.create_connection
2026-08-21T09:18:45.788157615Z ERROR 08-21 09:18:45 serving_chat.py:351] asyncio.exceptions.CancelledError
2026-08-21T09:18:45.788159503Z ERROR 08-21 09:18:45 serving_chat.py:351]
2026-08-21T09:18:45.788161568Z ERROR 08-21 09:18:45 serving_chat.py:351] The above exception was the direct cause of the following exception:
2026-08-21T09:18:45.788163452Z ERROR 08-21 09:18:45 serving_chat.py:351]
2026-08-21T09:18:45.788165202Z ERROR 08-21 09:18:45 serving_chat.py:351] Traceback (most recent call last):
2026-08-21T09:18:45.788167072Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 349, in create_chat_completion
2026-08-21T09:18:45.788169170Z ERROR 08-21 09:18:45 serving_chat.py:351] mm_data = await mm_data_future
2026-08-21T09:18:45.788171155Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 247, in all_mm_data
2026-08-21T09:18:45.788173162Z ERROR 08-21 09:18:45 serving_chat.py:351] items = await asyncio.gather(*self._items)
2026-08-21T09:18:45.788175010Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/multimodal/utils.py", line 140, in async_get_and_parse_image
2026-08-21T09:18:45.788177125Z ERROR 08-21 09:18:45 serving_chat.py:351] image = await async_fetch_image(image_url)
2026-08-21T09:18:45.788179162Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/multimodal/utils.py", line 62, in async_fetch_image
2026-08-21T09:18:45.788181192Z ERROR 08-21 09:18:45 serving_chat.py:351] image_raw = await global_http_connection.async_get_bytes(
2026-08-21T09:18:45.788183046Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/connections.py", line 92, in async_get_bytes
2026-08-21T09:18:45.788185135Z ERROR 08-21 09:18:45 serving_chat.py:351] async with await self.get_async_response(url, timeout=timeout) as r:
2026-08-21T09:18:45.788187056Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 1488, in __aenter__
2026-08-21T09:18:45.788188984Z ERROR 08-21 09:18:45 serving_chat.py:351] self._resp: _RetType = await self._coro
2026-08-21T09:18:45.788191124Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 622, in _request
2026-08-21T09:18:45.788198539Z ERROR 08-21 09:18:45 serving_chat.py:351] with timer:
2026-08-21T09:18:45.788201691Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/helpers.py", line 685, in __exit__
2026-08-21T09:18:45.788203928Z ERROR 08-21 09:18:45 serving_chat.py:351] raise asyncio.TimeoutError from exc_val
2026-08-21T09:18:45.788205796Z ERROR 08-21 09:18:45 serving_chat.py:351] asyncio.exceptions.TimeoutError
2026-08-21T09:18:45.788226758Z WARNING 08-21 09:18:45 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=1 image_data=0 image_remote=1 image_other=0 stream=0 n=1
2026-08-21T09:18:45.788396490Z INFO: 172.28.22.23:23129 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:18:45.930641865Z INFO 08-21 09:18:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3fec7fa21a184eb2ab4a3c044edf5c03 logical_start=0 logical_end=23 capped_end=16 physical_query_tokens=16
2026-08-21T09:18:47.913816886Z INFO: 172.28.22.23:54731 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:18:48.045655043Z INFO 08-21 09:18:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-36d7ba16d6c5491ebacfcb8b6f4825b7 checkpoint_tokens=16 logical_tokens=23 physical_query_tokens=7
2026-08-21T09:18:49.004123322Z INFO: 172.28.22.23:21649 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:06.457083652Z INFO: 172.28.22.23:64717 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:08.350398724Z INFO: 172.28.22.23:59924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:23.414385591Z INFO: 172.28.22.23:51405 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:26.150188101Z INFO: 172.28.22.23:52470 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:28.878740751Z INFO: 172.28.22.23:7922 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:31.608038328Z INFO: 172.28.22.23:42513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:34.334499609Z INFO: 172.28.22.23:62916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:34.465025736Z WARNING 08-21 09:19:34 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_top_p messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:19:34.465205081Z INFO: 172.28.22.23:24189 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:19:37.191970829Z INFO: 172.28.22.23:50925 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:39.947018745Z INFO: 172.28.22.23:50244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:42.673506761Z INFO: 172.28.22.23:1213 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:42.806138320Z WARNING 08-21 09:19:42 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_top_p messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:19:42.806310454Z INFO: 172.28.22.23:34038 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:19:45.532279664Z INFO: 172.28.22.23:5739 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:48.259219117Z INFO: 172.28.22.23:12781 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:50.991256420Z INFO: 172.28.22.23:1473 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:53.726241177Z INFO: 172.28.22.23:24937 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:56.457646810Z INFO: 172.28.22.23:54539 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:59.184734984Z INFO: 172.28.22.23:42676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:20:01.918288455Z INFO: 172.28.22.23:56438 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:20:01.921448839Z WARNING 08-21 09:20:01 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=n_exceeds_max_num_seqs messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=2
2026-08-21T09:20:01.921569549Z INFO: 172.28.22.23:17450 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:02:04.790824978Z INFO 08-21 09:02:04 config.py:887] Defaulting to use mp for distributed inference
2026-08-21T09:02:04.791125425Z INFO 08-21 09:02:04 config.py:1005] Chunked prefill is enabled with max_num_batched_tokens=8192.
2026-08-21T09:02:04.791228968Z WARNING 08-21 09:02:04 config.py:380] To see benefits of async output processing, enable CUDA graph. Since, enforce-eager is enabled, async output processor cannot be used
2026-08-21T09:02:04.797776622Z INFO 08-21 09:02:04 llm_engine.py:237] Initializing an LLM engine (v0.6.3) with config: model='/model', speculative_config=None, tokenizer='/model', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=262144, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=4, pipeline_parallel_size=1, disable_custom_all_reduce=True, quantization=None, enforce_eager=True, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=0, served_model_name=llm, use_v2_block_manager=True, num_scheduler_steps=1, chunked_prefill_enabled=True multi_step_stream_outputs=True, enable_prefix_caching=True, use_async_output_proc=False, use_cached_outputs=False, mm_processor_kwargs=None)
2026-08-21T09:02:05.293565575Z WARNING 08-21 09:02:05 multiproc_gpu_executor.py:58] Reducing Torch parallelism from 64 threads to 1 to avoid unnecessary CPU contention. Set OMP_NUM_THREADS in the external environment to tune this value as needed.
2026-08-21T09:02:05.335736867Z INFO 08-21 09:02:05 custom_cache_manager.py:17] Setting Triton cache manager to: vllm.triton_utils.custom_cache_manager:CustomCacheManager
2026-08-21T09:02:05.393315501Z INFO 08-21 09:02:05 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:05.393341804Z INFO 08-21 09:02:05 selector.py:115] Using XFormers backend.
2026-08-21T09:02:05.807302697Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.807309638Z import pynvml # type: ignore[import]
2026-08-21T09:02:05.824127325Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.824137656Z import pynvml # type: ignore[import]
2026-08-21T09:02:05.824256931Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.824269321Z import pynvml # type: ignore[import]
2026-08-21T09:02:07.329940131Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:07.337795612Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:07.337940204Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:08.918983194Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:08.918992985Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:08.918996192Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:14.460559487Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.460602035Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.461994280Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.462040598Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.471925854Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.471977270Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.482641607Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.483730800Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.493826451Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.817030241Z INFO 08-21 09:02:14 shm_broadcast.py:242] vLLM message queue communication handle: Handle(connect_ip='127.0.0.1', local_reader_ranks=[1, 2, 3], buffer=<vllm.distributed.device_communicators.shm_broadcast.ShmRingBuffer object at 0x7f0366c81930>, local_subscribe_port=59293, remote_subscribe_port=None)
2026-08-21T09:02:14.847415260Z INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.847614690Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.847739181Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.848387320Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.858988644Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=2 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.859467814Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=1 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.864551807Z INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=0 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.864802679Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=3 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.903080269Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.903130512Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.903137640Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.903191892Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.914028211Z INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.914071736Z INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.920641847Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.920693615Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:15.030346513Z
Loading safetensors checkpoint shards: 0% Completed | 0/16 [00:00<?, ?it/s]
2026-08-21T09:02:16.308418803Z
Loading safetensors checkpoint shards: 6% Completed | 1/16 [00:01<00:19, 1.28s/it]
2026-08-21T09:02:17.410325122Z
Loading safetensors checkpoint shards: 12% Completed | 2/16 [00:02<00:16, 1.17s/it]
2026-08-21T09:02:18.108433367Z
Loading safetensors checkpoint shards: 19% Completed | 3/16 [00:03<00:12, 1.05it/s]
2026-08-21T09:02:19.361631768Z
Loading safetensors checkpoint shards: 25% Completed | 4/16 [00:04<00:12, 1.07s/it]
2026-08-21T09:02:20.333177153Z
Loading safetensors checkpoint shards: 31% Completed | 5/16 [00:05<00:11, 1.04s/it]
2026-08-21T09:02:21.387274259Z
Loading safetensors checkpoint shards: 38% Completed | 6/16 [00:06<00:10, 1.04s/it]
2026-08-21T09:02:22.477924192Z
Loading safetensors checkpoint shards: 44% Completed | 7/16 [00:07<00:09, 1.06s/it]
2026-08-21T09:02:23.607999684Z
Loading safetensors checkpoint shards: 50% Completed | 8/16 [00:08<00:08, 1.08s/it]
2026-08-21T09:02:25.004995477Z
Loading safetensors checkpoint shards: 56% Completed | 9/16 [00:09<00:08, 1.18s/it]
2026-08-21T09:02:26.215485822Z
Loading safetensors checkpoint shards: 62% Completed | 10/16 [00:11<00:07, 1.19s/it]
2026-08-21T09:02:27.238527591Z
Loading safetensors checkpoint shards: 69% Completed | 11/16 [00:12<00:05, 1.14s/it]
2026-08-21T09:02:28.587124231Z
Loading safetensors checkpoint shards: 75% Completed | 12/16 [00:13<00:04, 1.20s/it]
2026-08-21T09:02:29.862053227Z
Loading safetensors checkpoint shards: 81% Completed | 13/16 [00:14<00:03, 1.22s/it]
2026-08-21T09:02:30.830194860Z
Loading safetensors checkpoint shards: 88% Completed | 14/16 [00:15<00:02, 1.15s/it]
2026-08-21T09:02:31.908294943Z
Loading safetensors checkpoint shards: 94% Completed | 15/16 [00:16<00:01, 1.13s/it]
2026-08-21T09:02:33.067985413Z
Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:18<00:00, 1.14s/it]
2026-08-21T09:02:33.068138250Z
Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:18<00:00, 1.13s/it]
2026-08-21T09:02:33.068152573Z
2026-08-21T09:02:33.515702169Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.517444102Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.518183686Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.531917125Z INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:09:17.971298089Z INFO 08-21 09:09:17 distributed_gpu_executor.py:57] # GPU blocks: 68837, # CPU blocks: 26214
2026-08-21T09:09:17.971331531Z INFO 08-21 09:09:17 distributed_gpu_executor.py:61] Maximum concurrency for 262144 tokens per request: 4.20x
2026-08-21T09:09:24.221172872Z INFO 08-21 09:09:24 serving_chat.py:230] "auto" tool choice has been enabled please note that while the parallel_tool_calls client option is preset for compatibility reasons, it will be ignored.
2026-08-21T09:09:24.222523596Z INFO 08-21 09:09:24 serving_chat.py:252] Reasoning parser 'qwen3' enabled.
2026-08-21T09:09:24.222583618Z WARNING 08-21 09:09:24 serving_embedding.py:199] embedding_mode is False. Embedding API will not work.
2026-08-21T09:09:24.222639176Z INFO 08-21 09:09:24 launcher.py:19] Available routes are:
2026-08-21T09:09:24.222672190Z INFO 08-21 09:09:24 launcher.py:27] Route: /openapi.json, Methods: HEAD, GET
2026-08-21T09:09:24.222701996Z INFO 08-21 09:09:24 launcher.py:27] Route: /docs, Methods: HEAD, GET
2026-08-21T09:09:24.222721615Z INFO 08-21 09:09:24 launcher.py:27] Route: /docs/oauth2-redirect, Methods: HEAD, GET
2026-08-21T09:09:24.222739200Z INFO 08-21 09:09:24 launcher.py:27] Route: /redoc, Methods: HEAD, GET
2026-08-21T09:09:24.222762599Z INFO 08-21 09:09:24 launcher.py:27] Route: /health, Methods: GET
2026-08-21T09:09:24.222783073Z INFO 08-21 09:09:24 launcher.py:27] Route: /tokenize, Methods: POST
2026-08-21T09:09:24.222806133Z INFO 08-21 09:09:24 launcher.py:27] Route: /detokenize, Methods: POST
2026-08-21T09:09:24.222823336Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/models, Methods: GET
2026-08-21T09:09:24.222843383Z INFO 08-21 09:09:24 launcher.py:27] Route: /version, Methods: GET
2026-08-21T09:09:24.222864866Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/chat/completions, Methods: POST
2026-08-21T09:09:24.222889197Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/completions, Methods: POST
2026-08-21T09:09:24.222905163Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/embeddings, Methods: POST
2026-08-21T09:09:24.241722634Z INFO: Started server process [1]
2026-08-21T09:09:24.241761044Z INFO: Waiting for application startup.
2026-08-21T09:09:24.242117727Z INFO: Application startup complete.
2026-08-21T09:09:24.242456628Z INFO: Uvicorn running on socket ('0.0.0.0', 8000) (Press CTRL+C to quit)
2026-08-21T09:09:44.973197045Z INFO: 172.17.0.1:33364 - "GET /health HTTP/1.1" 200 OK
2026-08-21T09:09:44.973986694Z INFO: 172.17.0.1:33364 - "GET /v1/models HTTP/1.1" 200 OK
2026-08-21T09:14:28.081063579Z INFO: 172.28.22.23:62189 - "GET /get_model_info HTTP/1.1" 404 Not Found
2026-08-21T09:14:28.083008410Z INFO: 172.28.22.23:48998 - "GET /get_server_info HTTP/1.1" 404 Not Found
2026-08-21T09:14:28.084421200Z INFO: 172.28.22.23:11136 - "GET /version HTTP/1.1" 200 OK
2026-08-21T09:14:28.546029658Z /usr/local/lib/python3.10/site-packages/pyairports/airports.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
2026-08-21T09:14:28.546035808Z from pkg_resources import resource_string
2026-08-21T09:14:31.031121478Z (VllmWorkerProcess pid=346) [BI100 PAGED_ATTN] decode_dispatch pid=346 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031157164Z (VllmWorkerProcess pid=345) [BI100 PAGED_ATTN] decode_dispatch pid=345 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031163055Z (VllmWorkerProcess pid=344) [BI100 PAGED_ATTN] decode_dispatch pid=344 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031174737Z [BI100 PAGED_ATTN] decode_dispatch pid=1 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:43.397959566Z INFO: 172.28.22.23:53703 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:14:56.712244813Z INFO: 172.28.22.23:42828 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:14:58.596985410Z INFO: 172.28.22.23:51862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:11.397216815Z INFO: 172.28.22.23:1803 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:11.527574677Z INFO: 172.28.22.23:45024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:16.668971652Z INFO 08-21 09:15:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-42885c3fc59a4603aa7a0b42cd5ba992 logical_start=0 logical_end=278 capped_end=272 physical_query_tokens=272
2026-08-21T09:15:22.809614262Z INFO: 172.28.22.23:16326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:22.938607196Z INFO 08-21 09:15:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c0ce10551734cc1af312b89f492bee7 logical_start=0 logical_end=36 capped_end=32 physical_query_tokens=32
2026-08-21T09:15:57.870375882Z INFO: 172.28.22.23:9657 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:58.450948648Z INFO 08-21 09:15:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c71140f8f214f919ddc14bfbde097f8 logical_start=0 logical_end=103 capped_end=96 physical_query_tokens=96
2026-08-21T09:16:34.673208668Z INFO: 172.28.22.23:38894 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:34.813601340Z INFO: 172.28.22.23:36520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:34.944326000Z INFO 08-21 09:16:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-573a281ccacc4e3ba6b391206492641d logical_start=0 logical_end=2576 capped_end=2560 physical_query_tokens=2560
2026-08-21T09:16:46.779132172Z INFO: 172.28.22.23:38743 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:46.905156615Z INFO 08-21 09:16:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4d6cb0370bac410c91d990926b58f78d checkpoint_tokens=2560 logical_tokens=2576 physical_query_tokens=16
2026-08-21T09:16:49.748182895Z INFO 08-21 09:16:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91c57d108cc94637b46ec1013b7dc374 logical_start=0 logical_end=61 capped_end=48 physical_query_tokens=48
2026-08-21T09:18:40.508209204Z INFO: 172.28.22.23:64130 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:18:45.788068145Z ERROR 08-21 09:18:45 serving_chat.py:351] Error in loading multi-modal data
2026-08-21T09:18:45.788113332Z ERROR 08-21 09:18:45 serving_chat.py:351] Traceback (most recent call last):
2026-08-21T09:18:45.788116769Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 770, in _request
2026-08-21T09:18:45.788119451Z ERROR 08-21 09:18:45 serving_chat.py:351] resp = await handler(req)
2026-08-21T09:18:45.788122901Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 725, in _connect_and_send_request
2026-08-21T09:18:45.788125748Z ERROR 08-21 09:18:45 serving_chat.py:351] conn = await self._connector.connect(
2026-08-21T09:18:45.788127966Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 642, in connect
2026-08-21T09:18:45.788130504Z ERROR 08-21 09:18:45 serving_chat.py:351] proto = await self._create_connection(req, traces, timeout)
2026-08-21T09:18:45.788132451Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1209, in _create_connection
2026-08-21T09:18:45.788134512Z ERROR 08-21 09:18:45 serving_chat.py:351] _, proto = await self._create_direct_connection(req, traces, timeout)
2026-08-21T09:18:45.788136782Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1550, in _create_direct_connection
2026-08-21T09:18:45.788138782Z ERROR 08-21 09:18:45 serving_chat.py:351] transp, proto = await self._wrap_create_connection(
2026-08-21T09:18:45.788149409Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1283, in _wrap_create_connection
2026-08-21T09:18:45.788151631Z ERROR 08-21 09:18:45 serving_chat.py:351] return await self._loop.create_connection(*args, **kwargs, sock=sock)
2026-08-21T09:18:45.788153565Z ERROR 08-21 09:18:45 serving_chat.py:351] File "uvloop/loop.pyx", line 2088, in create_connection
2026-08-21T09:18:45.788155625Z ERROR 08-21 09:18:45 serving_chat.py:351] File "uvloop/loop.pyx", line 2083, in uvloop.loop.Loop.create_connection
2026-08-21T09:18:45.788157615Z ERROR 08-21 09:18:45 serving_chat.py:351] asyncio.exceptions.CancelledError
2026-08-21T09:18:45.788159503Z ERROR 08-21 09:18:45 serving_chat.py:351]
2026-08-21T09:18:45.788161568Z ERROR 08-21 09:18:45 serving_chat.py:351] The above exception was the direct cause of the following exception:
2026-08-21T09:18:45.788163452Z ERROR 08-21 09:18:45 serving_chat.py:351]
2026-08-21T09:18:45.788165202Z ERROR 08-21 09:18:45 serving_chat.py:351] Traceback (most recent call last):
2026-08-21T09:18:45.788167072Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 349, in create_chat_completion
2026-08-21T09:18:45.788169170Z ERROR 08-21 09:18:45 serving_chat.py:351] mm_data = await mm_data_future
2026-08-21T09:18:45.788171155Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 247, in all_mm_data
2026-08-21T09:18:45.788173162Z ERROR 08-21 09:18:45 serving_chat.py:351] items = await asyncio.gather(*self._items)
2026-08-21T09:18:45.788175010Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/multimodal/utils.py", line 140, in async_get_and_parse_image
2026-08-21T09:18:45.788177125Z ERROR 08-21 09:18:45 serving_chat.py:351] image = await async_fetch_image(image_url)
2026-08-21T09:18:45.788179162Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/multimodal/utils.py", line 62, in async_fetch_image
2026-08-21T09:18:45.788181192Z ERROR 08-21 09:18:45 serving_chat.py:351] image_raw = await global_http_connection.async_get_bytes(
2026-08-21T09:18:45.788183046Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/connections.py", line 92, in async_get_bytes
2026-08-21T09:18:45.788185135Z ERROR 08-21 09:18:45 serving_chat.py:351] async with await self.get_async_response(url, timeout=timeout) as r:
2026-08-21T09:18:45.788187056Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 1488, in __aenter__
2026-08-21T09:18:45.788188984Z ERROR 08-21 09:18:45 serving_chat.py:351] self._resp: _RetType = await self._coro
2026-08-21T09:18:45.788191124Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 622, in _request
2026-08-21T09:18:45.788198539Z ERROR 08-21 09:18:45 serving_chat.py:351] with timer:
2026-08-21T09:18:45.788201691Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/helpers.py", line 685, in __exit__
2026-08-21T09:18:45.788203928Z ERROR 08-21 09:18:45 serving_chat.py:351] raise asyncio.TimeoutError from exc_val
2026-08-21T09:18:45.788205796Z ERROR 08-21 09:18:45 serving_chat.py:351] asyncio.exceptions.TimeoutError
2026-08-21T09:18:45.788226758Z WARNING 08-21 09:18:45 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=1 image_data=0 image_remote=1 image_other=0 stream=0 n=1
2026-08-21T09:18:45.788396490Z INFO: 172.28.22.23:23129 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:18:45.930641865Z INFO 08-21 09:18:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3fec7fa21a184eb2ab4a3c044edf5c03 logical_start=0 logical_end=23 capped_end=16 physical_query_tokens=16
2026-08-21T09:18:47.913816886Z INFO: 172.28.22.23:54731 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:18:48.045655043Z INFO 08-21 09:18:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-36d7ba16d6c5491ebacfcb8b6f4825b7 checkpoint_tokens=16 logical_tokens=23 physical_query_tokens=7
2026-08-21T09:18:49.004123322Z INFO: 172.28.22.23:21649 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:06.457083652Z INFO: 172.28.22.23:64717 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:08.350398724Z INFO: 172.28.22.23:59924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:23.414385591Z INFO: 172.28.22.23:51405 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:26.150188101Z INFO: 172.28.22.23:52470 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:28.878740751Z INFO: 172.28.22.23:7922 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:31.608038328Z INFO: 172.28.22.23:42513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:34.334499609Z INFO: 172.28.22.23:62916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:34.465025736Z WARNING 08-21 09:19:34 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_top_p messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:19:34.465205081Z INFO: 172.28.22.23:24189 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:19:37.191970829Z INFO: 172.28.22.23:50925 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:39.947018745Z INFO: 172.28.22.23:50244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:42.673506761Z INFO: 172.28.22.23:1213 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:42.806138320Z WARNING 08-21 09:19:42 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_top_p messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:19:42.806310454Z INFO: 172.28.22.23:34038 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:19:45.532279664Z INFO: 172.28.22.23:5739 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:48.259219117Z INFO: 172.28.22.23:12781 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:50.991256420Z INFO: 172.28.22.23:1473 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:53.726241177Z INFO: 172.28.22.23:24937 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:56.457646810Z INFO: 172.28.22.23:54539 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:59.184734984Z INFO: 172.28.22.23:42676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:20:01.918288455Z INFO: 172.28.22.23:56438 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:20:01.921448839Z WARNING 08-21 09:20:01 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=n_exceeds_max_num_seqs messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=2
2026-08-21T09:20:01.921569549Z INFO: 172.28.22.23:17450 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:25:02.197056520Z INFO 08-21 09:25:02 serving_chat.py:1029] Client disconnected (non-stream watcher), aborting request chat-aa56f31b73944408b7401ca42e955d8f
2026-08-21T09:25:02.197291822Z WARNING 08-21 09:25:02 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:25:03.413958542Z INFO: 172.28.22.23:42925 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:25:09.915011334Z INFO: 172.28.22.23:45264 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:28:37.716436318Z INFO: 172.28.22.23:62984 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:01:45.658004498Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:01:45.658066491Z import pynvml # type: ignore[import]
2026-08-21T09:01:47.200984875Z INFO 08-21 09:01:47 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:01:48.689063592Z 2026-08-21 09:01:48.688962: I tensorflow/core/util/port.cc:110] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2026-08-21T09:01:48.742734644Z 2026-08-21 09:01:48.742677: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
2026-08-21T09:01:48.742746164Z To enable the following instructions: SSE3 SSE4.1 SSE4.2 AVX AVX2 AVX512F AVX512_VNNI AVX512_BF16 AVX_VNNI AMX_TILE AMX_INT8 AMX_BF16 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2026-08-21T09:01:48.773931628Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:01:54.159789381Z INFO 08-21 09:01:54 api_server.py:1006] vLLM API server version 0.6.3
2026-08-21T09:01:54.160020367Z INFO 08-21 09:01:54 api_server.py:1007] args: Namespace(host=None, port=8000, uvicorn_log_level='info', allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], api_key=None, lora_modules=None, prompt_adapters=None, chat_template=None, response_role='assistant', ssl_keyfile=None, ssl_certfile=None, ssl_ca_certs=None, ssl_cert_reqs=0, root_path=None, middleware=[], return_tokens_as_token_ids=False, disable_frontend_multiprocessing=True, enable_auto_tool_choice=True, tool_call_parser='qwen3_coder', tool_parser_plugin='', reasoning_parser='qwen3', model='/model', tokenizer=None, skip_tokenizer_init=False, revision=None, code_revision=None, tokenizer_revision=None, tokenizer_mode='auto', trust_remote_code=True, download_dir=None, load_format='auto', config_format='auto', dtype='auto', kv_cache_dtype='auto', quantization_param_path=None, max_model_len=262144, guided_decoding_backend='outlines', distributed_executor_backend=None, worker_use_ray=False, pipeline_parallel_size=1, tensor_parallel_size=4, max_parallel_loading_workers=None, ray_workers_use_nsight=False, block_size=16, enable_prefix_caching=True, disable_sliding_window=False, use_v2_block_manager=True, num_lookahead_slots=0, seed=0, swap_space=4, cpu_offload_gb=0, gpu_memory_utilization=0.9, num_gpu_blocks_override=None, max_num_batched_tokens=8192, max_num_seqs=1, max_logprobs=20, disable_log_stats=False, quantization=None, rope_scaling=None, rope_theta=None, enforce_eager=True, max_context_len_to_capture=None, max_seq_len_to_capture=32768, disable_custom_all_reduce=False, tokenizer_pool_size=0, tokenizer_pool_type='ray', tokenizer_pool_extra_config=None, limit_mm_per_prompt=None, mm_processor_kwargs=None, enable_lora=False, max_loras=1, max_lora_rank=16, lora_extra_vocab_size=256, lora_dtype='auto', long_lora_scaling_factors=None, max_cpu_loras=None, fully_sharded_loras=False, enable_prompt_adapter=False, max_prompt_adapters=1, max_prompt_adapter_token=0, device='auto', num_scheduler_steps=1, multi_step_stream_outputs=True, scheduler_delay_factor=0.0, enable_chunked_prefill=True, speculative_model=None, speculative_model_quantization=None, num_speculative_tokens=None, speculative_disable_mqa_scorer=False, speculative_draft_tensor_parallel_size=None, speculative_max_model_len=None, speculative_disable_by_batch_size=None, ngram_prompt_lookup_max=None, ngram_prompt_lookup_min=None, spec_decoding_acceptance_method='rejection_sampler', typical_acceptance_sampler_posterior_threshold=None, typical_acceptance_sampler_posterior_alpha=None, disable_logprobs_during_spec_decoding=None, model_loader_extra_config=None, ignore_patterns=[], preemption_mode=None, served_model_name=['llm'], qlora_adapter_name_or_path=None, otlp_traces_endpoint=None, collect_detailed_traces=None, disable_async_output_proc=False, override_neuron_config=None, scheduling_policy='fcfs', disable_log_requests=True, max_log_len=None, disable_fastapi_docs=False)
2026-08-21T09:01:54.175663565Z INFO 08-21 09:01:54 config.py:1670] Downcasting torch.float32 to torch.float16.
2026-08-21T09:02:04.790340814Z INFO 08-21 09:02:04 arg_utils.py:909] Keeping prefix caching enabled for the Qwen3.6 native vision path.
2026-08-21T09:02:04.790824978Z INFO 08-21 09:02:04 config.py:887] Defaulting to use mp for distributed inference
2026-08-21T09:02:04.791125425Z INFO 08-21 09:02:04 config.py:1005] Chunked prefill is enabled with max_num_batched_tokens=8192.
2026-08-21T09:02:04.791228968Z WARNING 08-21 09:02:04 config.py:380] To see benefits of async output processing, enable CUDA graph. Since, enforce-eager is enabled, async output processor cannot be used
2026-08-21T09:02:04.797776622Z INFO 08-21 09:02:04 llm_engine.py:237] Initializing an LLM engine (v0.6.3) with config: model='/model', speculative_config=None, tokenizer='/model', skip_tokenizer_init=False, tokenizer_mode=auto, revision=None, override_neuron_config=None, rope_scaling=None, rope_theta=None, tokenizer_revision=None, trust_remote_code=True, dtype=torch.float16, max_seq_len=262144, download_dir=None, load_format=LoadFormat.AUTO, tensor_parallel_size=4, pipeline_parallel_size=1, disable_custom_all_reduce=True, quantization=None, enforce_eager=True, kv_cache_dtype=auto, quantization_param_path=None, device_config=cuda, decoding_config=DecodingConfig(guided_decoding_backend='outlines'), observability_config=ObservabilityConfig(otlp_traces_endpoint=None, collect_model_forward_time=False, collect_model_execute_time=False), seed=0, served_model_name=llm, use_v2_block_manager=True, num_scheduler_steps=1, chunked_prefill_enabled=True multi_step_stream_outputs=True, enable_prefix_caching=True, use_async_output_proc=False, use_cached_outputs=False, mm_processor_kwargs=None)
2026-08-21T09:02:05.293565575Z WARNING 08-21 09:02:05 multiproc_gpu_executor.py:58] Reducing Torch parallelism from 64 threads to 1 to avoid unnecessary CPU contention. Set OMP_NUM_THREADS in the external environment to tune this value as needed.
2026-08-21T09:02:05.335736867Z INFO 08-21 09:02:05 custom_cache_manager.py:17] Setting Triton cache manager to: vllm.triton_utils.custom_cache_manager:CustomCacheManager
2026-08-21T09:02:05.393315501Z INFO 08-21 09:02:05 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:05.393341804Z INFO 08-21 09:02:05 selector.py:115] Using XFormers backend.
2026-08-21T09:02:05.807302697Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.807309638Z import pynvml # type: ignore[import]
2026-08-21T09:02:05.824127325Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.824137656Z import pynvml # type: ignore[import]
2026-08-21T09:02:05.824256931Z /usr/local/corex/lib64/python3/dist-packages/torch/cuda/__init__.py:51: FutureWarning: The pynvml package is deprecated. Please install nvidia-ml-py instead. If you did not install pynvml directly, please report this to the maintainers of the package that installed pynvml for you.
2026-08-21T09:02:05.824269321Z import pynvml # type: ignore[import]
2026-08-21T09:02:07.329940131Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:07.337795612Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:07.337940204Z INFO 08-21 09:02:07 importing.py:10] Triton not installed; certain GPU-related functions will not be available.
2026-08-21T09:02:08.918983194Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:08.918992985Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:08.918996192Z WARNING:tensorflow:Deprecation warnings have been disabled. Set TF_ENABLE_DEPRECATION_WARNINGS=1 to re-enable them.
2026-08-21T09:02:14.460559487Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.460602035Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.461994280Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.462040598Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.471925854Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.471977270Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.482641607Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.483730800Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.493826451Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 multiproc_worker_utils.py:216] Worker ready; awaiting tasks
2026-08-21T09:02:14.817030241Z INFO 08-21 09:02:14 shm_broadcast.py:242] vLLM message queue communication handle: Handle(connect_ip='127.0.0.1', local_reader_ranks=[1, 2, 3], buffer=<vllm.distributed.device_communicators.shm_broadcast.ShmRingBuffer object at 0x7f0366c81930>, local_subscribe_port=59293, remote_subscribe_port=None)
2026-08-21T09:02:14.847415260Z INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.847614690Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.847739181Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.848387320Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 model_runner.py:1138] Starting to load model /model...
2026-08-21T09:02:14.858988644Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=2 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.859467814Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=1 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.864551807Z INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=0 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.864802679Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 qwen3_5.py:2024] [BI100] Qwen hybrid KV accounting; tp_rank=3 env_mode=full_attention config_mode=full_attention configured_kv_layers=10 full_attention_layers=10 full_attention_ordinals=3,7,11,15,19,23,27,31,35,39
2026-08-21T09:02:14.903080269Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.903130512Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.903137640Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.903191892Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.914028211Z INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.914071736Z INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:14.920641847Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:266] Cannot use FlashAttention-2 backend because the vllm.vllm_flash_attn package is not found. Make sure that vllm_flash_attn was built and installed (on by default).
2026-08-21T09:02:14.920693615Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:14 selector.py:115] Using XFormers backend.
2026-08-21T09:02:15.030346513Z
Loading safetensors checkpoint shards: 0% Completed | 0/16 [00:00<?, ?it/s]
2026-08-21T09:02:16.308418803Z
Loading safetensors checkpoint shards: 6% Completed | 1/16 [00:01<00:19, 1.28s/it]
2026-08-21T09:02:17.410325122Z
Loading safetensors checkpoint shards: 12% Completed | 2/16 [00:02<00:16, 1.17s/it]
2026-08-21T09:02:18.108433367Z
Loading safetensors checkpoint shards: 19% Completed | 3/16 [00:03<00:12, 1.05it/s]
2026-08-21T09:02:19.361631768Z
Loading safetensors checkpoint shards: 25% Completed | 4/16 [00:04<00:12, 1.07s/it]
2026-08-21T09:02:20.333177153Z
Loading safetensors checkpoint shards: 31% Completed | 5/16 [00:05<00:11, 1.04s/it]
2026-08-21T09:02:21.387274259Z
Loading safetensors checkpoint shards: 38% Completed | 6/16 [00:06<00:10, 1.04s/it]
2026-08-21T09:02:22.477924192Z
Loading safetensors checkpoint shards: 44% Completed | 7/16 [00:07<00:09, 1.06s/it]
2026-08-21T09:02:23.607999684Z
Loading safetensors checkpoint shards: 50% Completed | 8/16 [00:08<00:08, 1.08s/it]
2026-08-21T09:02:25.004995477Z
Loading safetensors checkpoint shards: 56% Completed | 9/16 [00:09<00:08, 1.18s/it]
2026-08-21T09:02:26.215485822Z
Loading safetensors checkpoint shards: 62% Completed | 10/16 [00:11<00:07, 1.19s/it]
2026-08-21T09:02:27.238527591Z
Loading safetensors checkpoint shards: 69% Completed | 11/16 [00:12<00:05, 1.14s/it]
2026-08-21T09:02:28.587124231Z
Loading safetensors checkpoint shards: 75% Completed | 12/16 [00:13<00:04, 1.20s/it]
2026-08-21T09:02:29.862053227Z
Loading safetensors checkpoint shards: 81% Completed | 13/16 [00:14<00:03, 1.22s/it]
2026-08-21T09:02:30.830194860Z
Loading safetensors checkpoint shards: 88% Completed | 14/16 [00:15<00:02, 1.15s/it]
2026-08-21T09:02:31.908294943Z
Loading safetensors checkpoint shards: 94% Completed | 15/16 [00:16<00:01, 1.13s/it]
2026-08-21T09:02:33.067985413Z
Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:18<00:00, 1.14s/it]
2026-08-21T09:02:33.068138250Z
Loading safetensors checkpoint shards: 100% Completed | 16/16 [00:18<00:00, 1.13s/it]
2026-08-21T09:02:33.068152573Z
2026-08-21T09:02:33.515702169Z (VllmWorkerProcess pid=344) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.517444102Z (VllmWorkerProcess pid=345) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.518183686Z (VllmWorkerProcess pid=346) INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:02:33.531917125Z INFO 08-21 09:02:33 model_runner.py:1149] Loading model weights took 16.7383 GB
2026-08-21T09:09:17.971298089Z INFO 08-21 09:09:17 distributed_gpu_executor.py:57] # GPU blocks: 68837, # CPU blocks: 26214
2026-08-21T09:09:17.971331531Z INFO 08-21 09:09:17 distributed_gpu_executor.py:61] Maximum concurrency for 262144 tokens per request: 4.20x
2026-08-21T09:09:24.221172872Z INFO 08-21 09:09:24 serving_chat.py:230] "auto" tool choice has been enabled please note that while the parallel_tool_calls client option is preset for compatibility reasons, it will be ignored.
2026-08-21T09:09:24.222523596Z INFO 08-21 09:09:24 serving_chat.py:252] Reasoning parser 'qwen3' enabled.
2026-08-21T09:09:24.222583618Z WARNING 08-21 09:09:24 serving_embedding.py:199] embedding_mode is False. Embedding API will not work.
2026-08-21T09:09:24.222639176Z INFO 08-21 09:09:24 launcher.py:19] Available routes are:
2026-08-21T09:09:24.222672190Z INFO 08-21 09:09:24 launcher.py:27] Route: /openapi.json, Methods: HEAD, GET
2026-08-21T09:09:24.222701996Z INFO 08-21 09:09:24 launcher.py:27] Route: /docs, Methods: HEAD, GET
2026-08-21T09:09:24.222721615Z INFO 08-21 09:09:24 launcher.py:27] Route: /docs/oauth2-redirect, Methods: HEAD, GET
2026-08-21T09:09:24.222739200Z INFO 08-21 09:09:24 launcher.py:27] Route: /redoc, Methods: HEAD, GET
2026-08-21T09:09:24.222762599Z INFO 08-21 09:09:24 launcher.py:27] Route: /health, Methods: GET
2026-08-21T09:09:24.222783073Z INFO 08-21 09:09:24 launcher.py:27] Route: /tokenize, Methods: POST
2026-08-21T09:09:24.222806133Z INFO 08-21 09:09:24 launcher.py:27] Route: /detokenize, Methods: POST
2026-08-21T09:09:24.222823336Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/models, Methods: GET
2026-08-21T09:09:24.222843383Z INFO 08-21 09:09:24 launcher.py:27] Route: /version, Methods: GET
2026-08-21T09:09:24.222864866Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/chat/completions, Methods: POST
2026-08-21T09:09:24.222889197Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/completions, Methods: POST
2026-08-21T09:09:24.222905163Z INFO 08-21 09:09:24 launcher.py:27] Route: /v1/embeddings, Methods: POST
2026-08-21T09:09:24.241722634Z INFO: Started server process [1]
2026-08-21T09:09:24.241761044Z INFO: Waiting for application startup.
2026-08-21T09:09:24.242117727Z INFO: Application startup complete.
2026-08-21T09:09:24.242456628Z INFO: Uvicorn running on socket ('0.0.0.0', 8000) (Press CTRL+C to quit)
2026-08-21T09:09:44.973197045Z INFO: 172.17.0.1:33364 - "GET /health HTTP/1.1" 200 OK
2026-08-21T09:09:44.973986694Z INFO: 172.17.0.1:33364 - "GET /v1/models HTTP/1.1" 200 OK
2026-08-21T09:14:28.081063579Z INFO: 172.28.22.23:62189 - "GET /get_model_info HTTP/1.1" 404 Not Found
2026-08-21T09:14:28.083008410Z INFO: 172.28.22.23:48998 - "GET /get_server_info HTTP/1.1" 404 Not Found
2026-08-21T09:14:28.084421200Z INFO: 172.28.22.23:11136 - "GET /version HTTP/1.1" 200 OK
2026-08-21T09:14:28.546029658Z /usr/local/lib/python3.10/site-packages/pyairports/airports.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
2026-08-21T09:14:28.546035808Z from pkg_resources import resource_string
2026-08-21T09:14:31.031121478Z (VllmWorkerProcess pid=346) [BI100 PAGED_ATTN] decode_dispatch pid=346 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031157164Z (VllmWorkerProcess pid=345) [BI100 PAGED_ATTN] decode_dispatch pid=345 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031163055Z (VllmWorkerProcess pid=344) [BI100 PAGED_ATTN] decode_dispatch pid=344 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:31.031174737Z [BI100 PAGED_ATTN] decode_dispatch pid=1 rank=? local_rank=? path=native_v1 actual_max=15 max_seq_len=15 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 1) required_blocks=1 threshold=32768
2026-08-21T09:14:43.397959566Z INFO: 172.28.22.23:53703 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:14:56.712244813Z INFO: 172.28.22.23:42828 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:14:58.596985410Z INFO: 172.28.22.23:51862 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:11.397216815Z INFO: 172.28.22.23:1803 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:11.527574677Z INFO: 172.28.22.23:45024 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:16.668971652Z INFO 08-21 09:15:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-42885c3fc59a4603aa7a0b42cd5ba992 logical_start=0 logical_end=278 capped_end=272 physical_query_tokens=272
2026-08-21T09:15:22.809614262Z INFO: 172.28.22.23:16326 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:22.938607196Z INFO 08-21 09:15:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c0ce10551734cc1af312b89f492bee7 logical_start=0 logical_end=36 capped_end=32 physical_query_tokens=32
2026-08-21T09:15:57.870375882Z INFO: 172.28.22.23:9657 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:15:58.450948648Z INFO 08-21 09:15:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c71140f8f214f919ddc14bfbde097f8 logical_start=0 logical_end=103 capped_end=96 physical_query_tokens=96
2026-08-21T09:16:34.673208668Z INFO: 172.28.22.23:38894 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:34.813601340Z INFO: 172.28.22.23:36520 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:34.944326000Z INFO 08-21 09:16:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-573a281ccacc4e3ba6b391206492641d logical_start=0 logical_end=2576 capped_end=2560 physical_query_tokens=2560
2026-08-21T09:16:46.779132172Z INFO: 172.28.22.23:38743 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:16:46.905156615Z INFO 08-21 09:16:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4d6cb0370bac410c91d990926b58f78d checkpoint_tokens=2560 logical_tokens=2576 physical_query_tokens=16
2026-08-21T09:16:49.748182895Z INFO 08-21 09:16:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91c57d108cc94637b46ec1013b7dc374 logical_start=0 logical_end=61 capped_end=48 physical_query_tokens=48
2026-08-21T09:18:40.508209204Z INFO: 172.28.22.23:64130 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:18:45.788068145Z ERROR 08-21 09:18:45 serving_chat.py:351] Error in loading multi-modal data
2026-08-21T09:18:45.788113332Z ERROR 08-21 09:18:45 serving_chat.py:351] Traceback (most recent call last):
2026-08-21T09:18:45.788116769Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 770, in _request
2026-08-21T09:18:45.788119451Z ERROR 08-21 09:18:45 serving_chat.py:351] resp = await handler(req)
2026-08-21T09:18:45.788122901Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 725, in _connect_and_send_request
2026-08-21T09:18:45.788125748Z ERROR 08-21 09:18:45 serving_chat.py:351] conn = await self._connector.connect(
2026-08-21T09:18:45.788127966Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 642, in connect
2026-08-21T09:18:45.788130504Z ERROR 08-21 09:18:45 serving_chat.py:351] proto = await self._create_connection(req, traces, timeout)
2026-08-21T09:18:45.788132451Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1209, in _create_connection
2026-08-21T09:18:45.788134512Z ERROR 08-21 09:18:45 serving_chat.py:351] _, proto = await self._create_direct_connection(req, traces, timeout)
2026-08-21T09:18:45.788136782Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1550, in _create_direct_connection
2026-08-21T09:18:45.788138782Z ERROR 08-21 09:18:45 serving_chat.py:351] transp, proto = await self._wrap_create_connection(
2026-08-21T09:18:45.788149409Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/connector.py", line 1283, in _wrap_create_connection
2026-08-21T09:18:45.788151631Z ERROR 08-21 09:18:45 serving_chat.py:351] return await self._loop.create_connection(*args, **kwargs, sock=sock)
2026-08-21T09:18:45.788153565Z ERROR 08-21 09:18:45 serving_chat.py:351] File "uvloop/loop.pyx", line 2088, in create_connection
2026-08-21T09:18:45.788155625Z ERROR 08-21 09:18:45 serving_chat.py:351] File "uvloop/loop.pyx", line 2083, in uvloop.loop.Loop.create_connection
2026-08-21T09:18:45.788157615Z ERROR 08-21 09:18:45 serving_chat.py:351] asyncio.exceptions.CancelledError
2026-08-21T09:18:45.788159503Z ERROR 08-21 09:18:45 serving_chat.py:351]
2026-08-21T09:18:45.788161568Z ERROR 08-21 09:18:45 serving_chat.py:351] The above exception was the direct cause of the following exception:
2026-08-21T09:18:45.788163452Z ERROR 08-21 09:18:45 serving_chat.py:351]
2026-08-21T09:18:45.788165202Z ERROR 08-21 09:18:45 serving_chat.py:351] Traceback (most recent call last):
2026-08-21T09:18:45.788167072Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 349, in create_chat_completion
2026-08-21T09:18:45.788169170Z ERROR 08-21 09:18:45 serving_chat.py:351] mm_data = await mm_data_future
2026-08-21T09:18:45.788171155Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 247, in all_mm_data
2026-08-21T09:18:45.788173162Z ERROR 08-21 09:18:45 serving_chat.py:351] items = await asyncio.gather(*self._items)
2026-08-21T09:18:45.788175010Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/multimodal/utils.py", line 140, in async_get_and_parse_image
2026-08-21T09:18:45.788177125Z ERROR 08-21 09:18:45 serving_chat.py:351] image = await async_fetch_image(image_url)
2026-08-21T09:18:45.788179162Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/multimodal/utils.py", line 62, in async_fetch_image
2026-08-21T09:18:45.788181192Z ERROR 08-21 09:18:45 serving_chat.py:351] image_raw = await global_http_connection.async_get_bytes(
2026-08-21T09:18:45.788183046Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/corex/lib64/python3/dist-packages/vllm/connections.py", line 92, in async_get_bytes
2026-08-21T09:18:45.788185135Z ERROR 08-21 09:18:45 serving_chat.py:351] async with await self.get_async_response(url, timeout=timeout) as r:
2026-08-21T09:18:45.788187056Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 1488, in __aenter__
2026-08-21T09:18:45.788188984Z ERROR 08-21 09:18:45 serving_chat.py:351] self._resp: _RetType = await self._coro
2026-08-21T09:18:45.788191124Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 622, in _request
2026-08-21T09:18:45.788198539Z ERROR 08-21 09:18:45 serving_chat.py:351] with timer:
2026-08-21T09:18:45.788201691Z ERROR 08-21 09:18:45 serving_chat.py:351] File "/usr/local/lib/python3.10/site-packages/aiohttp/helpers.py", line 685, in __exit__
2026-08-21T09:18:45.788203928Z ERROR 08-21 09:18:45 serving_chat.py:351] raise asyncio.TimeoutError from exc_val
2026-08-21T09:18:45.788205796Z ERROR 08-21 09:18:45 serving_chat.py:351] asyncio.exceptions.TimeoutError
2026-08-21T09:18:45.788226758Z WARNING 08-21 09:18:45 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=1 image_data=0 image_remote=1 image_other=0 stream=0 n=1
2026-08-21T09:18:45.788396490Z INFO: 172.28.22.23:23129 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:18:45.930641865Z INFO 08-21 09:18:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3fec7fa21a184eb2ab4a3c044edf5c03 logical_start=0 logical_end=23 capped_end=16 physical_query_tokens=16
2026-08-21T09:18:47.913816886Z INFO: 172.28.22.23:54731 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:18:48.045655043Z INFO 08-21 09:18:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-36d7ba16d6c5491ebacfcb8b6f4825b7 checkpoint_tokens=16 logical_tokens=23 physical_query_tokens=7
2026-08-21T09:18:49.004123322Z INFO: 172.28.22.23:21649 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:06.457083652Z INFO: 172.28.22.23:64717 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:08.350398724Z INFO: 172.28.22.23:59924 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:23.414385591Z INFO: 172.28.22.23:51405 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:26.150188101Z INFO: 172.28.22.23:52470 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:28.878740751Z INFO: 172.28.22.23:7922 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:31.608038328Z INFO: 172.28.22.23:42513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:34.334499609Z INFO: 172.28.22.23:62916 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:34.465025736Z WARNING 08-21 09:19:34 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_top_p messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:19:34.465205081Z INFO: 172.28.22.23:24189 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:19:37.191970829Z INFO: 172.28.22.23:50925 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:39.947018745Z INFO: 172.28.22.23:50244 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:42.673506761Z INFO: 172.28.22.23:1213 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:42.806138320Z WARNING 08-21 09:19:42 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_top_p messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:19:42.806310454Z INFO: 172.28.22.23:34038 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:19:45.532279664Z INFO: 172.28.22.23:5739 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:48.259219117Z INFO: 172.28.22.23:12781 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:50.991256420Z INFO: 172.28.22.23:1473 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:53.726241177Z INFO: 172.28.22.23:24937 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:56.457646810Z INFO: 172.28.22.23:54539 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:19:59.184734984Z INFO: 172.28.22.23:42676 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:20:01.918288455Z INFO: 172.28.22.23:56438 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:20:01.921448839Z WARNING 08-21 09:20:01 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=n_exceeds_max_num_seqs messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=2
2026-08-21T09:20:01.921569549Z INFO: 172.28.22.23:17450 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:25:02.197056520Z INFO 08-21 09:25:02 serving_chat.py:1029] Client disconnected (non-stream watcher), aborting request chat-aa56f31b73944408b7401ca42e955d8f
2026-08-21T09:25:02.197291822Z WARNING 08-21 09:25:02 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:25:03.413958542Z INFO: 172.28.22.23:42925 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:25:09.915011334Z INFO: 172.28.22.23:45264 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:28:37.716436318Z INFO: 172.28.22.23:62984 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:39.799485472Z INFO: 172.28.22.23:27413 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:39.934565453Z WARNING 08-21 09:31:39 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=invalid_max_tokens messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:31:39.934734684Z INFO: 172.28.22.23:41084 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:31:40.063217862Z WARNING 08-21 09:31:40 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=context_length_exceeded messages=1 systems=0 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=none images=0 image_data=0 image_remote=0 image_other=0 stream=0 n=1
2026-08-21T09:31:40.063390399Z INFO: 172.28.22.23:20206 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:31:40.193219247Z INFO 08-21 09:31:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f4d07df967934523b0b3a83bf4ec819d logical_start=0 logical_end=21 capped_end=16 physical_query_tokens=16
2026-08-21T09:31:42.228022490Z INFO: 172.28.22.23:31025 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:42.360647115Z INFO 08-21 09:31:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aed25c1415a345699109ea7a43f9f760 logical_start=0 logical_end=26 capped_end=16 physical_query_tokens=16
2026-08-21T09:31:44.535690724Z INFO: 172.28.22.23:47548 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:44.671178053Z INFO 08-21 09:31:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-afd1f5697713482d8a3b4878ed699b05 checkpoint_tokens=272 logical_tokens=278 physical_query_tokens=6
2026-08-21T09:31:47.766196707Z INFO: 172.28.22.23:51588 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:47.896645819Z INFO 08-21 09:31:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c16cf3c2389e44dd81acc842200d1a42 logical_start=0 logical_end=56 capped_end=48 physical_query_tokens=48
2026-08-21T09:31:50.771555086Z INFO: 172.28.22.23:17190 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:50.903492422Z INFO: 172.28.22.23:15657 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:31:51.025038044Z INFO 08-21 09:31:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-dce0991a71f6483c9fbbfd814a8606c4 logical_start=0 logical_end=19 capped_end=16 physical_query_tokens=16
2026-08-21T09:32:44.775416463Z
Compiling FSM index for all state transitions: 0%| | 0/243 [00:00<?, ?it/s]
Compiling FSM index for all state transitions: 0%| | 1/243 [00:05<20:57, 5.20s/it]
Compiling FSM index for all state transitions: 1%| | 3/243 [00:05<05:34, 1.39s/it]
Compiling FSM index for all state transitions: 2%|▏ | 4/243 [00:05<04:00, 1.00s/it]
Compiling FSM index for all state transitions: 2%|▏ | 6/243 [00:05<02:06, 1.88it/s]
Compiling FSM index for all state transitions: 3%|▎ | 8/243 [00:05<01:18, 2.99it/s]
Compiling FSM index for all state transitions: 4%|▍ | 10/243 [00:05<00:53, 4.34it/s]
Compiling FSM index for all state transitions: 5%|▍ | 12/243 [00:06<00:38, 5.93it/s]
Compiling FSM index for all state transitions: 6%|▌ | 14/243 [00:06<00:38, 6.01it/s]
Compiling FSM index for all state transitions: 7%|▋ | 16/243 [00:06<00:37, 6.00it/s]
Compiling FSM index for all state transitions: 7%|▋ | 18/243 [00:06<00:29, 7.50it/s]
Compiling FSM index for all state transitions: 8%|▊ | 20/243 [00:06<00:24, 9.11it/s]
Compiling FSM index for all state transitions: 9%|▉ | 22/243 [00:07<00:20, 10.85it/s]
Compiling FSM index for all state transitions: 10%|▉ | 24/243 [00:07<00:31, 6.86it/s]
Compiling FSM index for all state transitions: 11%|█ | 26/243 [00:07<00:25, 8.39it/s]
Compiling FSM index for all state transitions: 12%|█▏ | 28/243 [00:07<00:21, 9.90it/s]
Compiling FSM index for all state transitions: 12%|█▏ | 30/243 [00:07<00:18, 11.56it/s]
Compiling FSM index for all state transitions: 13%|█▎ | 32/243 [00:08<00:16, 13.12it/s]
Compiling FSM index for all state transitions: 14%|█▍ | 34/243 [00:08<00:14, 14.28it/s]
Compiling FSM index for all state transitions: 15%|█▍ | 36/243 [00:08<00:13, 15.13it/s]
Compiling FSM index for all state transitions: 16%|█▌ | 38/243 [00:08<00:19, 10.78it/s]
Compiling FSM index for all state transitions: 16%|█▋ | 40/243 [00:08<00:16, 12.13it/s]
Compiling FSM index for all state transitions: 17%|█▋ | 42/243 [00:08<00:15, 13.04it/s]
Compiling FSM index for all state transitions: 18%|█▊ | 44/243 [00:08<00:13, 14.37it/s]
Compiling FSM index for all state transitions: 19%|█▉ | 46/243 [00:09<00:12, 15.23it/s]
Compiling FSM index for all state transitions: 20%|█▉ | 48/243 [00:09<00:18, 10.45it/s]
Compiling FSM index for all state transitions: 21%|██ | 50/243 [00:09<00:16, 11.83it/s]
Compiling FSM index for all state transitions: 21%|██▏ | 52/243 [00:09<00:14, 13.02it/s]
Compiling FSM index for all state transitions: 22%|██▏ | 54/243 [00:09<00:13, 14.32it/s]
Compiling FSM index for all state transitions: 23%|██▎ | 56/243 [00:09<00:12, 15.46it/s]
Compiling FSM index for all state transitions: 24%|██▍ | 58/243 [00:09<00:11, 16.15it/s]
Compiling FSM index for all state transitions: 25%|██▍ | 60/243 [00:10<00:10, 16.65it/s]
Compiling FSM index for all state transitions: 26%|██▌ | 62/243 [00:10<00:16, 11.16it/s]
Compiling FSM index for all state transitions: 26%|██▋ | 64/243 [00:10<00:14, 12.47it/s]
Compiling FSM index for all state transitions: 27%|██▋ | 66/243 [00:10<00:12, 13.64it/s]
Compiling FSM index for all state transitions: 28%|██▊ | 68/243 [00:10<00:11, 14.87it/s]
Compiling FSM index for all state transitions: 29%|██▉ | 70/243 [00:10<00:10, 15.88it/s]
Compiling FSM index for all state transitions: 30%|██▉ | 72/243 [00:10<00:10, 16.46it/s]
Compiling FSM index for all state transitions: 30%|███ | 74/243 [00:10<00:10, 16.69it/s]
Compiling FSM index for all state transitions: 31%|███▏ | 76/243 [00:11<00:09, 17.31it/s]
Compiling FSM index for all state transitions: 32%|███▏ | 78/243 [00:11<00:09, 17.71it/s]
Compiling FSM index for all state transitions: 33%|███▎ | 80/243 [00:11<00:08, 18.17it/s]
Compiling FSM index for all state transitions: 34%|███▎ | 82/243 [00:11<00:08, 18.15it/s]
Compiling FSM index for all state transitions: 35%|███▍ | 84/243 [00:11<00:08, 18.10it/s]
Compiling FSM index for all state transitions: 35%|███▌ | 86/243 [00:11<00:08, 18.41it/s]
Compiling FSM index for all state transitions: 36%|███▌ | 88/243 [00:11<00:08, 18.66it/s]
Compiling FSM index for all state transitions: 37%|███▋ | 90/243 [00:11<00:08, 18.81it/s]
Compiling FSM index for all state transitions: 38%|███▊ | 92/243 [00:11<00:07, 18.93it/s]
Compiling FSM index for all state transitions: 39%|███▊ | 94/243 [00:12<00:07, 19.01it/s]
Compiling FSM index for all state transitions: 40%|███▉ | 96/243 [00:12<00:07, 19.02it/s]
Compiling FSM index for all state transitions: 40%|████ | 98/243 [00:12<00:12, 11.83it/s]
Compiling FSM index for all state transitions: 41%|████ | 100/243 [00:12<00:11, 12.90it/s]
Compiling FSM index for all state transitions: 42%|████▏ | 102/243 [00:12<00:09, 14.26it/s]
Compiling FSM index for all state transitions: 43%|████▎ | 104/243 [00:12<00:09, 15.42it/s]
Compiling FSM index for all state transitions: 44%|████▎ | 106/243 [00:12<00:08, 16.11it/s]
Compiling FSM index for all state transitions: 44%|████▍ | 108/243 [00:13<00:07, 16.93it/s]
Compiling FSM index for all state transitions: 45%|████▌ | 110/243 [00:13<00:07, 17.57it/s]
Compiling FSM index for all state transitions: 46%|████▌ | 112/243 [00:13<00:07, 18.05it/s]
Compiling FSM index for all state transitions: 47%|████▋ | 114/243 [00:13<00:07, 18.39it/s]
Compiling FSM index for all state transitions: 48%|████▊ | 116/243 [00:13<00:07, 17.93it/s]
Compiling FSM index for all state transitions: 49%|████▊ | 118/243 [00:13<00:06, 18.31it/s]
Compiling FSM index for all state transitions: 49%|████▉ | 120/243 [00:13<00:06, 18.30it/s]
Compiling FSM index for all state transitions: 50%|█████ | 122/243 [00:13<00:06, 18.48it/s]
Compiling FSM index for all state transitions: 51%|█████ | 124/243 [00:13<00:06, 18.69it/s]
Compiling FSM index for all state transitions: 52%|█████▏ | 126/243 [00:13<00:06, 18.17it/s]
Compiling FSM index for all state transitions: 53%|█████▎ | 128/243 [00:14<00:06, 18.48it/s]
Compiling FSM index for all state transitions: 53%|█████▎ | 130/243 [00:14<00:06, 18.71it/s]
Compiling FSM index for all state transitions: 54%|█████▍ | 132/243 [00:14<00:05, 18.80it/s]
Compiling FSM index for all state transitions: 55%|█████▌ | 134/243 [00:14<00:05, 18.89it/s]
Compiling FSM index for all state transitions: 56%|█████▌ | 136/243 [00:14<00:05, 19.01it/s]
Compiling FSM index for all state transitions: 57%|█████▋ | 138/243 [00:14<00:05, 19.03it/s]
Compiling FSM index for all state transitions: 58%|█████▊ | 140/243 [00:14<00:09, 10.70it/s]
Compiling FSM index for all state transitions: 58%|█████▊ | 142/243 [00:15<00:09, 11.02it/s]
Compiling FSM index for all state transitions: 59%|█████▉ | 144/243 [00:15<00:07, 12.45it/s]
Compiling FSM index for all state transitions: 60%|██████ | 146/243 [00:15<00:10, 9.00it/s]
Compiling FSM index for all state transitions: 61%|██████ | 148/243 [00:15<00:08, 10.67it/s]
Compiling FSM index for all state transitions: 62%|██████▏ | 150/243 [00:15<00:07, 12.28it/s]
Compiling FSM index for all state transitions: 63%|██████▎ | 152/243 [00:15<00:06, 13.57it/s]
Compiling FSM index for all state transitions: 63%|██████▎ | 154/243 [00:16<00:05, 14.85it/s]
Compiling FSM index for all state transitions: 64%|██████▍ | 156/243 [00:16<00:05, 15.63it/s]
Compiling FSM index for all state transitions: 65%|██████▌ | 158/243 [00:16<00:07, 10.83it/s]
Compiling FSM index for all state transitions: 66%|██████▌ | 160/243 [00:16<00:06, 12.04it/s]
Compiling FSM index for all state transitions: 67%|██████▋ | 162/243 [00:16<00:05, 13.51it/s]
Compiling FSM index for all state transitions: 67%|██████▋ | 164/243 [00:16<00:05, 14.79it/s]
Compiling FSM index for all state transitions: 68%|██████▊ | 166/243 [00:16<00:04, 15.61it/s]
Compiling FSM index for all state transitions: 69%|██████▉ | 168/243 [00:17<00:04, 16.07it/s]
Compiling FSM index for all state transitions: 70%|██████▉ | 170/243 [00:17<00:04, 16.87it/s]
Compiling FSM index for all state transitions: 71%|███████ | 172/243 [00:17<00:04, 17.45it/s]
Compiling FSM index for all state transitions: 72%|███████▏ | 174/243 [00:17<00:03, 17.93it/s]
Compiling FSM index for all state transitions: 72%|███████▏ | 176/243 [00:17<00:03, 18.33it/s]
Compiling FSM index for all state transitions: 73%|███████▎ | 178/243 [00:17<00:03, 17.83it/s]
Compiling FSM index for all state transitions: 74%|███████▍ | 180/243 [00:17<00:03, 18.21it/s]
Compiling FSM index for all state transitions: 75%|███████▍ | 182/243 [00:17<00:03, 18.30it/s]
Compiling FSM index for all state transitions: 76%|███████▌ | 184/243 [00:17<00:03, 18.54it/s]
Compiling FSM index for all state transitions: 77%|███████▋ | 186/243 [00:18<00:03, 18.74it/s]
Compiling FSM index for all state transitions: 77%|███████▋ | 188/243 [00:18<00:02, 18.89it/s]
Compiling FSM index for all state transitions: 78%|███████▊ | 190/243 [00:18<00:02, 18.97it/s]
Compiling FSM index for all state transitions: 79%|███████▉ | 192/243 [00:18<00:04, 11.83it/s]
Compiling FSM index for all state transitions: 80%|███████▉ | 194/243 [00:18<00:03, 12.85it/s]
Compiling FSM index for all state transitions: 81%|████████ | 196/243 [00:18<00:03, 13.95it/s]
Compiling FSM index for all state transitions: 81%|████████▏ | 198/243 [00:18<00:02, 15.16it/s]
Compiling FSM index for all state transitions: 82%|████████▏ | 200/243 [00:18<00:02, 16.13it/s]
Compiling FSM index for all state transitions: 83%|████████▎ | 202/243 [00:19<00:02, 16.64it/s]
Compiling FSM index for all state transitions: 84%|████████▍ | 204/243 [00:19<00:02, 17.33it/s]
Compiling FSM index for all state transitions: 85%|████████▍ | 206/243 [00:19<00:02, 17.83it/s]
Compiling FSM index for all state transitions: 86%|████████▌ | 208/243 [00:19<00:01, 18.22it/s]
Compiling FSM index for all state transitions: 86%|████████▋ | 210/243 [00:19<00:01, 17.56it/s]
Compiling FSM index for all state transitions: 87%|████████▋ | 212/243 [00:19<00:01, 16.98it/s]
Compiling FSM index for all state transitions: 88%|████████▊ | 214/243 [00:19<00:01, 17.62it/s]
Compiling FSM index for all state transitions: 89%|████████▉ | 216/243 [00:19<00:01, 18.03it/s]
Compiling FSM index for all state transitions: 90%|████████▉ | 218/243 [00:19<00:01, 18.36it/s]
Compiling FSM index for all state transitions: 91%|█████████ | 220/243 [00:20<00:01, 18.26it/s]
Compiling FSM index for all state transitions: 91%|█████████▏| 222/243 [00:20<00:01, 18.19it/s]
Compiling FSM index for all state transitions: 92%|█████████▏| 224/243 [00:20<00:01, 18.52it/s]
Compiling FSM index for all state transitions: 93%|█████████▎| 226/243 [00:20<00:00, 18.75it/s]
Compiling FSM index for all state transitions: 94%|█████████▍| 228/243 [00:20<00:00, 18.90it/s]
Compiling FSM index for all state transitions: 95%|█████████▍| 230/243 [00:20<00:00, 19.02it/s]
Compiling FSM index for all state transitions: 95%|█████████▌| 232/243 [00:20<00:00, 19.08it/s]
Compiling FSM index for all state transitions: 96%|█████████▋| 234/243 [00:21<00:01, 6.75it/s]
Compiling FSM index for all state transitions: 97%|█████████▋| 236/243 [00:21<00:00, 7.64it/s]
Compiling FSM index for all state transitions: 98%|█████████▊| 238/243 [00:24<00:02, 2.11it/s]
Compiling FSM index for all state transitions: 98%|█████████▊| 239/243 [00:25<00:02, 1.46it/s]
Compiling FSM index for all state transitions: 99%|█████████▉| 241/243 [00:25<00:00, 2.11it/s]
Compiling FSM index for all state transitions: 100%|██████████| 243/243 [00:26<00:00, 2.94it/s]
Compiling FSM index for all state transitions: 100%|██████████| 243/243 [00:26<00:00, 9.21it/s]
2026-08-21T09:32:44.995654613Z INFO 08-21 09:32:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-68c352cd63564c5cb6f8ac6a5502f646 logical_start=0 logical_end=35 capped_end=32 physical_query_tokens=32
2026-08-21T09:32:48.717516290Z INFO: 172.28.22.23:55843 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:32:51.828703486Z
Compiling FSM index for all state transitions: 0%| | 0/35 [00:00<?, ?it/s]
Compiling FSM index for all state transitions: 3%|▎ | 1/35 [00:00<00:16, 2.12it/s]
Compiling FSM index for all state transitions: 9%|▊ | 3/35 [00:00<00:05, 6.10it/s]
Compiling FSM index for all state transitions: 14%|█▍ | 5/35 [00:00<00:03, 9.31it/s]
Compiling FSM index for all state transitions: 20%|██ | 7/35 [00:00<00:02, 11.87it/s]
Compiling FSM index for all state transitions: 26%|██▌ | 9/35 [00:00<00:01, 13.62it/s]
Compiling FSM index for all state transitions: 31%|███▏ | 11/35 [00:01<00:01, 14.88it/s]
Compiling FSM index for all state transitions: 37%|███▋ | 13/35 [00:01<00:02, 10.34it/s]
Compiling FSM index for all state transitions: 43%|████▎ | 15/35 [00:01<00:01, 12.02it/s]
Compiling FSM index for all state transitions: 49%|████▊ | 17/35 [00:01<00:01, 13.44it/s]
Compiling FSM index for all state transitions: 54%|█████▍ | 19/35 [00:01<00:01, 14.53it/s]
Compiling FSM index for all state transitions: 60%|██████ | 21/35 [00:01<00:00, 15.43it/s]
Compiling FSM index for all state transitions: 66%|██████▌ | 23/35 [00:01<00:00, 16.41it/s]
Compiling FSM index for all state transitions: 71%|███████▏ | 25/35 [00:01<00:00, 17.16it/s]
Compiling FSM index for all state transitions: 77%|███████▋ | 27/35 [00:02<00:00, 17.45it/s]
Compiling FSM index for all state transitions: 83%|████████▎ | 29/35 [00:02<00:00, 17.65it/s]
Compiling FSM index for all state transitions: 89%|████████▊ | 31/35 [00:02<00:00, 18.12it/s]
Compiling FSM index for all state transitions: 94%|█████████▍| 33/35 [00:02<00:00, 17.77it/s]
Compiling FSM index for all state transitions: 100%|██████████| 35/35 [00:02<00:00, 18.19it/s]
Compiling FSM index for all state transitions: 100%|██████████| 35/35 [00:02<00:00, 11.88it/s]
2026-08-21T09:32:51.867433261Z INFO 08-21 09:32:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6f2ad123f3e64a31afc900d6938bbed9 logical_start=0 logical_end=23 capped_end=16 physical_query_tokens=16
2026-08-21T09:32:55.049069066Z INFO: 172.28.22.23:10907 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:32:55.182800169Z INFO 08-21 09:32:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5159d96c9b4a47fdb034b2e919e6f51e logical_start=0 logical_end=31 capped_end=16 physical_query_tokens=16
2026-08-21T09:33:00.105203258Z INFO: 172.28.22.23:43928 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:33:01.611031318Z INFO: 172.28.22.23:29584 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:33:01.744610794Z INFO 08-21 09:33:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-552f38b8f2b649668b922f9d035cf646 logical_start=0 logical_end=22 capped_end=16 physical_query_tokens=16
2026-08-21T09:33:04.137520488Z INFO: 172.28.22.23:53577 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:33:04.271096339Z INFO 08-21 09:33:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-073d839dcd294555bcaeb0a382e2dff7 logical_start=0 logical_end=20 capped_end=16 physical_query_tokens=16
2026-08-21T09:33:06.407303491Z INFO: 172.28.22.23:24357 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:33:06.539159817Z INFO 08-21 09:33:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5d320a15525f4b82b045431da8d2cc6e logical_start=0 logical_end=32 capped_end=16 physical_query_tokens=16
2026-08-21T09:33:09.915026287Z INFO: 172.28.22.23:31403 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:33:10.605731623Z INFO 08-21 09:33:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8388457f98db4ff28380ce249b720d6b logical_start=0 logical_end=1304 capped_end=1296 physical_query_tokens=1296
2026-08-21T09:51:16.609800820Z INFO 08-21 09:51:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-28181a48f5264444801f3ff82c744e6c logical_start=0 logical_end=43 capped_end=32 physical_query_tokens=32
2026-08-21T09:51:18.959831799Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:51:18.976030534Z WARNING 08-21 09:51:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=5 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=2 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:51:18.976198881Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:51:18.986051396Z WARNING 08-21 09:51:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=3 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:51:18.986180087Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:51:18.994283506Z WARNING 08-21 09:51:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=3 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:51:18.994406170Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:51:19.153615490Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:51:19.418036728Z INFO 08-21 09:51:19 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9ef8730ceab44029b84f86f6beacbf5f logical_start=0 logical_end=7438 capped_end=7424 physical_query_tokens=7424
2026-08-21T09:51:47.208505871Z WARNING 08-21 09:51:47 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=38 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:51:47.208753165Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:51:47.380444868Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:51:47.505329740Z INFO 08-21 09:51:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a66c518b5a65493098592ccdef3c2da5 logical_start=0 logical_end=918 capped_end=912 physical_query_tokens=912
2026-08-21T09:55:10.084827747Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:56:00.860419688Z INFO 08-21 09:56:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-dc8f6cd6ad0a41b98321bb204c869746 logical_start=40960 logical_end=45454 capped_end=45440 physical_query_tokens=4480
2026-08-21T09:56:10.795189992Z (VllmWorkerProcess pid=346) [BI100 PAGED_ATTN] decode_dispatch pid=346 rank=? local_rank=? path=pytorch_corex_gather actual_max=45455 max_seq_len=45455 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 2841) required_blocks=2841 threshold=32768
2026-08-21T09:56:10.795196239Z (VllmWorkerProcess pid=345) [BI100 PAGED_ATTN] decode_dispatch pid=345 rank=? local_rank=? path=pytorch_corex_gather actual_max=45455 max_seq_len=45455 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 2841) required_blocks=2841 threshold=32768
2026-08-21T09:56:10.795198845Z [BI100 PAGED_ATTN] decode_dispatch pid=1 rank=? local_rank=? path=pytorch_corex_gather actual_max=45455 max_seq_len=45455 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 2841) required_blocks=2841 threshold=32768
2026-08-21T09:56:10.795208559Z (VllmWorkerProcess pid=344) [BI100 PAGED_ATTN] decode_dispatch pid=344 rank=? local_rank=? path=pytorch_corex_gather actual_max=45455 max_seq_len=45455 query=(1, 4, 256) key_cache=(68837, 1, 32, 16, 8) value_cache=(68837, 1, 256, 16) block_tables=(1, 2841) required_blocks=2841 threshold=32768
2026-08-21T09:56:30.682587155Z WARNING 08-21 09:56:30 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=4 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:56:30.682847261Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:56:30.863158447Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:56:31.121940297Z INFO 08-21 09:56:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-523ff78684674770b186e3cd35af51b0 logical_start=0 logical_end=3334 capped_end=3328 physical_query_tokens=3328
2026-08-21T09:56:49.890090625Z WARNING 08-21 09:56:49 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=4 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=67 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:56:49.890278898Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:56:49.900093954Z WARNING 08-21 09:56:49 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=9 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=4 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:56:49.900225849Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:56:49.907455946Z WARNING 08-21 09:56:49 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=7 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=3 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:56:49.907577547Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:56:49.914202565Z WARNING 08-21 09:56:49 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=12 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=22 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:56:49.914319626Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:56:50.100401205Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:56:50.368452233Z INFO 08-21 09:56:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-57df9fe819c24e0e87f1511230252a00 logical_start=0 logical_end=8192 capped_end=7040 physical_query_tokens=7040
2026-08-21T09:56:58.152195640Z INFO 08-21 09:56:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-57df9fe819c24e0e87f1511230252a00 logical_start=7040 logical_end=11310 capped_end=11296 physical_query_tokens=4256
2026-08-21T09:57:17.650039995Z WARNING 08-21 09:57:17 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=7 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=4 tool_msgs=3 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:57:17.650282183Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:57:17.871019385Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:57:35.951509616Z INFO 08-21 09:57:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0a0ae33d024b46f097b9bad8e6d15564 logical_start=16384 logical_end=21577 capped_end=21568 physical_query_tokens=5184
2026-08-21T09:58:01.807320400Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:58:02.070950978Z INFO 08-21 09:58:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f0e42ef7250d431b8b9308ec5ff0b033 checkpoint_tokens=7040 logical_tokens=8192 physical_query_tokens=1152
2026-08-21T09:58:06.248136379Z INFO 08-21 09:58:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f0e42ef7250d431b8b9308ec5ff0b033 logical_start=8192 logical_end=11631 capped_end=11264 physical_query_tokens=3072
2026-08-21T09:58:11.791514336Z INFO 08-21 09:58:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f0e42ef7250d431b8b9308ec5ff0b033 logical_start=11264 logical_end=11631 capped_end=11616 physical_query_tokens=352
2026-08-21T09:58:30.522514847Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:58:30.827786120Z INFO 08-21 09:58:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6a3d390ba9c34ff296d393a2142e0709 checkpoint_tokens=45440 logical_tokens=49084 physical_query_tokens=3644
2026-08-21T09:58:30.827827645Z INFO 08-21 09:58:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6a3d390ba9c34ff296d393a2142e0709 logical_start=45440 logical_end=49084 capped_end=49072 physical_query_tokens=3632
2026-08-21T09:58:52.835172982Z WARNING 08-21 09:58:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=4 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=38 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:58:52.835409933Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:58:53.042300633Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:59:01.776056497Z INFO 08-21 09:59:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-95b03e8f7d754bd190418958dbdab471 logical_start=8192 logical_end=13787 capped_end=13776 physical_query_tokens=5584
2026-08-21T09:59:22.017994701Z WARNING 08-21 09:59:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=16 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=8 assistant_tool_msgs=6 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:59:22.018236885Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:59:22.031310000Z WARNING 08-21 09:59:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=12 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=21 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:59:22.031436146Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:59:22.237732701Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:59:30.989169770Z INFO 08-21 09:59:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1a2adb6668df4720876c9d280023ea92 logical_start=8192 logical_end=13625 capped_end=13616 physical_query_tokens=5424
2026-08-21T09:59:46.212781207Z WARNING 08-21 09:59:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=415 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=33 tool_msgs=44 assistant_tool_msgs=39 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:59:46.213029851Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:59:46.226840208Z WARNING 08-21 09:59:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=14 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=21 tool_msgs=4 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:59:46.226971568Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:59:46.235584036Z WARNING 08-21 09:59:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=15 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=34 tool_msgs=6 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T09:59:46.235725218Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T09:59:46.503668576Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T09:59:46.803668272Z INFO 08-21 09:59:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-efb2a5c9d40e4dea93ef755af486be9c checkpoint_tokens=45440 logical_tokens=49152 physical_query_tokens=3712
2026-08-21T09:59:46.803702330Z INFO 08-21 09:59:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-efb2a5c9d40e4dea93ef755af486be9c logical_start=45440 logical_end=49152 capped_end=49024 physical_query_tokens=3584
2026-08-21T09:59:54.584262232Z INFO 08-21 09:59:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-efb2a5c9d40e4dea93ef755af486be9c logical_start=49024 logical_end=49263 capped_end=49248 physical_query_tokens=224
2026-08-21T10:00:13.323784339Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:00:13.580978820Z INFO 08-21 10:00:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2dfd4e0b37c94f7fa13a026ca5d71719 checkpoint_tokens=7424 logical_tokens=7940 physical_query_tokens=516
2026-08-21T10:00:13.581011381Z INFO 08-21 10:00:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2dfd4e0b37c94f7fa13a026ca5d71719 logical_start=7424 logical_end=7940 capped_end=7936 physical_query_tokens=512
2026-08-21T10:00:34.520180741Z WARNING 08-21 10:00:34 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=21 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=14 assistant_tool_msgs=5 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:00:34.520421203Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:00:34.714696896Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:00:34.973953212Z INFO 08-21 10:00:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2cfdaa209ff94fc7a56d186d5aa3383e checkpoint_tokens=7040 logical_tokens=7229 physical_query_tokens=189
2026-08-21T10:00:34.973994847Z INFO 08-21 10:00:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2cfdaa209ff94fc7a56d186d5aa3383e logical_start=7040 logical_end=7229 capped_end=7216 physical_query_tokens=176
2026-08-21T10:01:18.664462840Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:01:18.922320993Z INFO 08-21 10:01:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9dfaf7a000bd43408e9ef990d8338536 checkpoint_tokens=7936 logical_tokens=8044 physical_query_tokens=108
2026-08-21T10:01:18.922368018Z INFO 08-21 10:01:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9dfaf7a000bd43408e9ef990d8338536 logical_start=7936 logical_end=8044 capped_end=8032 physical_query_tokens=96
2026-08-21T10:01:45.531527024Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:01:45.787936470Z INFO 08-21 10:01:45 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-abbfcee60bed41e1a8dffa6d5fdf8ecd checkpoint_tokens=7040 logical_tokens=7197 physical_query_tokens=157
2026-08-21T10:01:45.787973557Z INFO 08-21 10:01:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-abbfcee60bed41e1a8dffa6d5fdf8ecd logical_start=7040 logical_end=7197 capped_end=7184 physical_query_tokens=144
2026-08-21T10:02:00.008691800Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:02:28.173375100Z INFO 08-21 10:02:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8723e8d510ca4213977f946bfb81c0f0 logical_start=24576 logical_end=32768 capped_end=26112 physical_query_tokens=1536
2026-08-21T10:02:44.622824809Z INFO 08-21 10:02:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8723e8d510ca4213977f946bfb81c0f0 logical_start=34304 logical_end=40506 capped_end=40496 physical_query_tokens=6192
2026-08-21T10:03:09.768411036Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:03:10.025740007Z INFO 08-21 10:03:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-13679ef993f6487789e5e0965745e550 checkpoint_tokens=7936 logical_tokens=8192 physical_query_tokens=256
2026-08-21T10:03:10.025766135Z INFO 08-21 10:03:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-13679ef993f6487789e5e0965745e550 logical_start=7936 logical_end=8192 capped_end=8000 physical_query_tokens=64
2026-08-21T10:03:12.135464884Z INFO 08-21 10:03:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-13679ef993f6487789e5e0965745e550 logical_start=8000 logical_end=9054 capped_end=9040 physical_query_tokens=1040
2026-08-21T10:03:34.840105181Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:03:35.098223651Z INFO 08-21 10:03:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fa2562c589a54fd7aabe99fbee59e54e checkpoint_tokens=7040 logical_tokens=8192 physical_query_tokens=1152
2026-08-21T10:03:35.098261047Z INFO 08-21 10:03:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fa2562c589a54fd7aabe99fbee59e54e logical_start=7040 logical_end=8192 capped_end=7168 physical_query_tokens=128
2026-08-21T10:03:37.581189198Z INFO 08-21 10:03:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fa2562c589a54fd7aabe99fbee59e54e logical_start=7168 logical_end=8499 capped_end=8496 physical_query_tokens=1328
2026-08-21T10:04:05.235035371Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:04:05.360807036Z INFO 08-21 10:04:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-59bcfd1933fe4c0ba0424b65032b1984 logical_start=0 logical_end=722 capped_end=720 physical_query_tokens=720
2026-08-21T10:07:01.366142683Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:07:01.630709736Z INFO 08-21 10:07:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c1f8705180d14ce0a5e797e699af325b checkpoint_tokens=7040 logical_tokens=7322 physical_query_tokens=282
2026-08-21T10:07:01.630745254Z INFO 08-21 10:07:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c1f8705180d14ce0a5e797e699af325b logical_start=7040 logical_end=7322 capped_end=7168 physical_query_tokens=128
2026-08-21T10:07:03.988628520Z INFO 08-21 10:07:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c1f8705180d14ce0a5e797e699af325b logical_start=7168 logical_end=7322 capped_end=7312 physical_query_tokens=144
2026-08-21T10:07:13.715582639Z WARNING 08-21 10:07:13 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=20 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=10 assistant_tool_msgs=8 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:07:13.715824320Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:07:13.907772030Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:07:14.163890631Z INFO 08-21 10:07:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4e3f6b07c4d8465b8f748818969ffdb7 checkpoint_tokens=7168 logical_tokens=7664 physical_query_tokens=496
2026-08-21T10:07:14.163927061Z INFO 08-21 10:07:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4e3f6b07c4d8465b8f748818969ffdb7 logical_start=7168 logical_end=7664 capped_end=7296 physical_query_tokens=128
2026-08-21T10:07:16.670127674Z INFO 08-21 10:07:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4e3f6b07c4d8465b8f748818969ffdb7 logical_start=7296 logical_end=7664 capped_end=7648 physical_query_tokens=352
2026-08-21T10:07:32.957381584Z WARNING 08-21 10:07:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=22 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=11 assistant_tool_msgs=9 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:07:32.957556009Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:07:33.145913631Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:07:33.403942182Z INFO 08-21 10:07:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f5b85ab323ba4030ade7e3caf14ce5db checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T10:07:36.242761169Z INFO 08-21 10:07:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f5b85ab323ba4030ade7e3caf14ce5db logical_start=8192 logical_end=9643 capped_end=9024 physical_query_tokens=832
2026-08-21T10:07:40.166549738Z INFO 08-21 10:07:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f5b85ab323ba4030ade7e3caf14ce5db logical_start=9024 logical_end=9643 capped_end=9632 physical_query_tokens=608
2026-08-21T10:08:01.003129418Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:08:01.257780463Z INFO 08-21 10:08:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1a5d9cc6e6a1452d97079d9197773168 checkpoint_tokens=7296 logical_tokens=7873 physical_query_tokens=577
2026-08-21T10:08:01.257823878Z INFO 08-21 10:08:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1a5d9cc6e6a1452d97079d9197773168 logical_start=7296 logical_end=7873 capped_end=7616 physical_query_tokens=320
2026-08-21T10:08:04.350074373Z INFO 08-21 10:08:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1a5d9cc6e6a1452d97079d9197773168 logical_start=7616 logical_end=7873 capped_end=7856 physical_query_tokens=240
2026-08-21T10:08:12.243612269Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:08:12.498537568Z INFO 08-21 10:08:12 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7de077d3d1af4fec921158b8b1b871aa checkpoint_tokens=7616 logical_tokens=7975 physical_query_tokens=359
2026-08-21T10:08:12.498576337Z INFO 08-21 10:08:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7de077d3d1af4fec921158b8b1b871aa logical_start=7616 logical_end=7975 capped_end=7872 physical_query_tokens=256
2026-08-21T10:08:15.491632765Z INFO 08-21 10:08:15 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7de077d3d1af4fec921158b8b1b871aa logical_start=7872 logical_end=7975 capped_end=7968 physical_query_tokens=96
2026-08-21T10:08:24.697148155Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:08:52.397710357Z INFO 08-21 10:08:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f94921c0ed43408fb56a992f7f0eb734 logical_start=24576 logical_end=27241 capped_end=27232 physical_query_tokens=2656
2026-08-21T10:08:59.919008658Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:09:00.183227325Z INFO 08-21 10:09:00 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e07688ab023e4ae189c2f4811206f394 checkpoint_tokens=9024 logical_tokens=9964 physical_query_tokens=940
2026-08-21T10:09:00.183261560Z INFO 08-21 10:09:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e07688ab023e4ae189c2f4811206f394 logical_start=9024 logical_end=9964 capped_end=9600 physical_query_tokens=576
2026-08-21T10:09:03.929896364Z INFO 08-21 10:09:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e07688ab023e4ae189c2f4811206f394 logical_start=9600 logical_end=9964 capped_end=9952 physical_query_tokens=352
2026-08-21T10:09:31.351781157Z WARNING 08-21 10:09:31 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=24 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=12 assistant_tool_msgs=10 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:09:31.352009737Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:09:31.548393222Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:09:31.808673774Z INFO 08-21 10:09:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1883de92cca74bc09ccb6a79528b54ab checkpoint_tokens=7872 logical_tokens=8163 physical_query_tokens=291
2026-08-21T10:09:31.808731506Z INFO 08-21 10:09:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1883de92cca74bc09ccb6a79528b54ab logical_start=7872 logical_end=8163 capped_end=7936 physical_query_tokens=64
2026-08-21T10:09:33.991629930Z INFO 08-21 10:09:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1883de92cca74bc09ccb6a79528b54ab logical_start=7936 logical_end=8163 capped_end=8160 physical_query_tokens=224
2026-08-21T10:09:43.153354312Z WARNING 08-21 10:09:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=26 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=13 assistant_tool_msgs=11 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:09:43.153517142Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:09:43.404444957Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:09:43.706749725Z INFO 08-21 10:09:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6c5de8143cd44afd9563380a91d10870 checkpoint_tokens=49024 logical_tokens=49152 physical_query_tokens=128
2026-08-21T10:09:46.794786246Z INFO 08-21 10:09:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6c5de8143cd44afd9563380a91d10870 logical_start=49152 logical_end=49698 capped_end=49216 physical_query_tokens=64
2026-08-21T10:09:49.525824914Z INFO 08-21 10:09:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6c5de8143cd44afd9563380a91d10870 logical_start=49216 logical_end=49698 capped_end=49696 physical_query_tokens=480
2026-08-21T10:10:03.899250258Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:10:04.024424469Z INFO 08-21 10:10:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0d0ffde6d4894f119280881dddf71cb3 logical_start=0 logical_end=543 capped_end=528 physical_query_tokens=528
2026-08-21T10:16:51.387953363Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:16:51.656254136Z INFO 08-21 10:16:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ec877a9e98c744319c9f9d83286cfc06 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T10:16:55.625122106Z INFO 08-21 10:16:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ec877a9e98c744319c9f9d83286cfc06 logical_start=8192 logical_end=9644 capped_end=8448 physical_query_tokens=256
2026-08-21T10:16:58.408794289Z INFO 08-21 10:16:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ec877a9e98c744319c9f9d83286cfc06 logical_start=8448 logical_end=9644 capped_end=9632 physical_query_tokens=1184
2026-08-21T10:17:32.895806045Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:17:33.160956889Z INFO 08-21 10:17:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4e6776dc4204442eb3611346abd4a3fa checkpoint_tokens=11264 logical_tokens=13629 physical_query_tokens=2365
2026-08-21T10:17:33.160993742Z INFO 08-21 10:17:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4e6776dc4204442eb3611346abd4a3fa logical_start=11264 logical_end=13629 capped_end=11584 physical_query_tokens=320
2026-08-21T10:17:36.416154829Z INFO 08-21 10:17:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4e6776dc4204442eb3611346abd4a3fa logical_start=11584 logical_end=13629 capped_end=13616 physical_query_tokens=2032
2026-08-21T10:18:06.689199264Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:18:06.815326753Z INFO 08-21 10:18:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-80a1923df4dc4ba5b55de876e7cb51cc logical_start=0 logical_end=340 capped_end=336 physical_query_tokens=336
2026-08-21T10:21:14.483935600Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:21:14.753647972Z INFO 08-21 10:21:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3d9f749ea3cb45b8af0b7846246df9fb checkpoint_tokens=9600 logical_tokens=10478 physical_query_tokens=878
2026-08-21T10:21:14.753688731Z INFO 08-21 10:21:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3d9f749ea3cb45b8af0b7846246df9fb logical_start=9600 logical_end=10478 capped_end=9920 physical_query_tokens=320
2026-08-21T10:21:18.103890930Z INFO 08-21 10:21:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3d9f749ea3cb45b8af0b7846246df9fb logical_start=9920 logical_end=10478 capped_end=10464 physical_query_tokens=544
2026-08-21T10:21:50.302032353Z WARNING 08-21 10:21:50 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=28 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=14 assistant_tool_msgs=12 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:21:50.302281826Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:21:50.503622795Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:21:50.763149894Z INFO 08-21 10:21:50 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-74069c9ea0734764a95a0f56db17370b checkpoint_tokens=9920 logical_tokens=10715 physical_query_tokens=795
2026-08-21T10:21:50.763200779Z INFO 08-21 10:21:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-74069c9ea0734764a95a0f56db17370b logical_start=9920 logical_end=10715 capped_end=10432 physical_query_tokens=512
2026-08-21T10:21:54.259965338Z INFO 08-21 10:21:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-74069c9ea0734764a95a0f56db17370b logical_start=10432 logical_end=10715 capped_end=10704 physical_query_tokens=272
2026-08-21T10:22:30.473364557Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:22:30.730814013Z INFO 08-21 10:22:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2a03ce2290784019bfa8137d106a2c15 checkpoint_tokens=7936 logical_tokens=8192 physical_query_tokens=256
2026-08-21T10:22:30.730859444Z INFO 08-21 10:22:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2a03ce2290784019bfa8137d106a2c15 logical_start=7936 logical_end=8192 capped_end=8128 physical_query_tokens=192
2026-08-21T10:22:33.613433010Z INFO 08-21 10:22:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2a03ce2290784019bfa8137d106a2c15 logical_start=8128 logical_end=8287 capped_end=8272 physical_query_tokens=144
2026-08-21T10:22:47.506617559Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:22:47.762814186Z INFO 08-21 10:22:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6571c7a591464707ae43bdb85ae29ee5 checkpoint_tokens=8128 logical_tokens=8192 physical_query_tokens=64
2026-08-21T10:22:49.877990901Z INFO 08-21 10:22:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6571c7a591464707ae43bdb85ae29ee5 logical_start=8192 logical_end=8410 capped_end=8256 physical_query_tokens=64
2026-08-21T10:22:52.164276796Z INFO 08-21 10:22:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6571c7a591464707ae43bdb85ae29ee5 logical_start=8256 logical_end=8410 capped_end=8400 physical_query_tokens=144
2026-08-21T10:23:02.544843620Z WARNING 08-21 10:23:02 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=30 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=15 assistant_tool_msgs=13 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:23:02.545069303Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:23:02.554148766Z WARNING 08-21 10:23:02 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=21 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=9 assistant_tool_msgs=6 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:23:02.554283231Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:23:02.815682459Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:23:03.118675200Z INFO 08-21 10:23:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8b33496d195a4f7f9e06f334520d8385 checkpoint_tokens=49216 logical_tokens=50019 physical_query_tokens=803
2026-08-21T10:23:03.118714677Z INFO 08-21 10:23:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8b33496d195a4f7f9e06f334520d8385 logical_start=49216 logical_end=50019 capped_end=49664 physical_query_tokens=448
2026-08-21T10:23:07.249722655Z INFO 08-21 10:23:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8b33496d195a4f7f9e06f334520d8385 logical_start=49664 logical_end=50019 capped_end=50016 physical_query_tokens=352
2026-08-21T10:23:50.903728889Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:23:51.161706993Z INFO 08-21 10:23:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6a6335dfb8b04a36b8e14a5cda26f8f0 checkpoint_tokens=8256 logical_tokens=8534 physical_query_tokens=278
2026-08-21T10:23:51.161741793Z INFO 08-21 10:23:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6a6335dfb8b04a36b8e14a5cda26f8f0 logical_start=8256 logical_end=8534 capped_end=8384 physical_query_tokens=128
2026-08-21T10:23:53.867724566Z INFO 08-21 10:23:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6a6335dfb8b04a36b8e14a5cda26f8f0 logical_start=8384 logical_end=8534 capped_end=8528 physical_query_tokens=144
2026-08-21T10:24:03.503159669Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:24:03.759828873Z INFO 08-21 10:24:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f1049dfb8d8a43059c2ca624773d16e8 checkpoint_tokens=8384 logical_tokens=8664 physical_query_tokens=280
2026-08-21T10:24:03.759860991Z INFO 08-21 10:24:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f1049dfb8d8a43059c2ca624773d16e8 logical_start=8384 logical_end=8664 capped_end=8512 physical_query_tokens=128
2026-08-21T10:24:06.524785707Z INFO 08-21 10:24:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f1049dfb8d8a43059c2ca624773d16e8 logical_start=8512 logical_end=8664 capped_end=8656 physical_query_tokens=144
2026-08-21T10:24:17.743326227Z WARNING 08-21 10:24:17 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=34 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=17 assistant_tool_msgs=15 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:24:17.743572510Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:24:17.755936649Z WARNING 08-21 10:24:17 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=22 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=7 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:24:17.756066171Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:24:17.765842590Z WARNING 08-21 10:24:17 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=35 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:24:17.765967317Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:24:17.945400108Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:24:18.204621227Z INFO 08-21 10:24:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-58d08a8ac9a848788c9948bd44d585e2 checkpoint_tokens=8512 logical_tokens=8783 physical_query_tokens=271
2026-08-21T10:24:18.204662824Z INFO 08-21 10:24:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-58d08a8ac9a848788c9948bd44d585e2 logical_start=8512 logical_end=8783 capped_end=8640 physical_query_tokens=128
2026-08-21T10:24:20.965314085Z INFO 08-21 10:24:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-58d08a8ac9a848788c9948bd44d585e2 logical_start=8640 logical_end=8783 capped_end=8768 physical_query_tokens=128
2026-08-21T10:24:30.513113909Z WARNING 08-21 10:24:30 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=24 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=11 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:24:30.513280759Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:24:30.705534843Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:24:30.969866297Z INFO 08-21 10:24:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-39d1639a29fc4df3a4756c8db5355e71 checkpoint_tokens=11584 logical_tokens=14545 physical_query_tokens=2961
2026-08-21T10:24:30.969917806Z INFO 08-21 10:24:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-39d1639a29fc4df3a4756c8db5355e71 logical_start=11584 logical_end=14545 capped_end=13568 physical_query_tokens=1984
2026-08-21T10:24:35.748940256Z INFO 08-21 10:24:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-39d1639a29fc4df3a4756c8db5355e71 logical_start=13568 logical_end=14545 capped_end=14528 physical_query_tokens=960
2026-08-21T10:25:03.688792723Z WARNING 08-21 10:25:03 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=36 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=18 assistant_tool_msgs=16 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:25:03.689041363Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:25:03.952062741Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:25:31.630300010Z INFO 08-21 10:25:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-11f8bb3452bd4a088e4048002eae4643 logical_start=24576 logical_end=27569 capped_end=27136 physical_query_tokens=2560
2026-08-21T10:25:37.514298123Z INFO 08-21 10:25:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-11f8bb3452bd4a088e4048002eae4643 logical_start=27136 logical_end=27569 capped_end=27552 physical_query_tokens=416
2026-08-21T10:25:43.285402199Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:25:43.555882303Z INFO 08-21 10:25:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0c53e1a7e0b84a5ab04618138e57519b checkpoint_tokens=10432 logical_tokens=12033 physical_query_tokens=1601
2026-08-21T10:25:43.555918825Z INFO 08-21 10:25:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0c53e1a7e0b84a5ab04618138e57519b logical_start=10432 logical_end=12033 capped_end=10688 physical_query_tokens=256
2026-08-21T10:25:46.558309864Z INFO 08-21 10:25:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0c53e1a7e0b84a5ab04618138e57519b logical_start=10688 logical_end=12033 capped_end=12016 physical_query_tokens=1328
2026-08-21T10:26:24.942973367Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:26:25.209621906Z INFO 08-21 10:26:25 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-28d3ae2328fc4a14b8afbf0e38ac895f checkpoint_tokens=13568 logical_tokens=14122 physical_query_tokens=554
2026-08-21T10:26:25.209673816Z INFO 08-21 10:26:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-28d3ae2328fc4a14b8afbf0e38ac895f logical_start=13568 logical_end=14122 capped_end=14112 physical_query_tokens=544
2026-08-21T10:26:57.941936505Z WARNING 08-21 10:26:57 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=295 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=21 tool_msgs=116 assistant_tool_msgs=114 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:26:57.942183172Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:26:57.963237917Z WARNING 08-21 10:26:57 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=38 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=19 assistant_tool_msgs=17 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:26:57.963524454Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:26:58.230652022Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:26:58.532465479Z INFO 08-21 10:26:58 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-764778bedc6b4dabb74a6b0f039a168e checkpoint_tokens=26112 logical_tokens=32768 physical_query_tokens=6656
2026-08-21T10:27:08.223943595Z INFO 08-21 10:27:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-764778bedc6b4dabb74a6b0f039a168e logical_start=32768 logical_end=40960 capped_end=40448 physical_query_tokens=7680
2026-08-21T10:27:19.648419826Z INFO 08-21 10:27:19 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-764778bedc6b4dabb74a6b0f039a168e logical_start=40448 logical_end=43882 capped_end=43872 physical_query_tokens=3424
2026-08-21T10:27:40.217569157Z WARNING 08-21 10:27:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=12 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=25 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=reasoning_effort validation_type=extra_forbidden
2026-08-21T10:27:40.217814796Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:40.228751031Z WARNING 08-21 10:27:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=30 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=19 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:27:40.228878467Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:40.239947705Z WARNING 08-21 10:27:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=44 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=22 assistant_tool_msgs=20 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:27:40.240070663Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:40.445570014Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:27:40.708200766Z INFO 08-21 10:27:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b0a709a2b67f46f1886498f1c0418f1f checkpoint_tokens=10688 logical_tokens=11658 physical_query_tokens=970
2026-08-21T10:27:40.708245699Z INFO 08-21 10:27:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b0a709a2b67f46f1886498f1c0418f1f logical_start=10688 logical_end=11658 capped_end=11648 physical_query_tokens=960
2026-08-21T10:27:52.638928683Z WARNING 08-21 10:27:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=40 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=20 assistant_tool_msgs=18 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:27:52.639089248Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:52.646153236Z WARNING 08-21 10:27:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=22 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:27:52.646273171Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:52.663959016Z WARNING 08-21 10:27:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=109 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=34 tool_msgs=54 assistant_tool_msgs=45 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:27:52.664087031Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:52.676628271Z WARNING 08-21 10:27:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=46 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=23 assistant_tool_msgs=21 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:27:52.676752546Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:27:52.844630035Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:27:52.969226632Z INFO 08-21 10:27:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6363d70a4cd54ee48553eb5d2c6775f3 logical_start=0 logical_end=122 capped_end=112 physical_query_tokens=112
2026-08-21T10:34:10.158009479Z WARNING 08-21 10:34:10 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=50 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=25 assistant_tool_msgs=23 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:34:10.158280433Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:34:10.336052179Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:34:10.461802883Z INFO 08-21 10:34:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-517747446464491fa9176c91db4ecec4 checkpoint_tokens=528 logical_tokens=543 physical_query_tokens=15
2026-08-21T10:41:32.534993707Z WARNING 08-21 10:41:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=52 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=35 tool_msgs=25 assistant_tool_msgs=15 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:41:32.535274530Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:41:32.547993434Z WARNING 08-21 10:41:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=26 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=7 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:41:32.548133767Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:41:32.762113792Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:41:33.033666211Z INFO 08-21 10:41:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-89e98c93cf764990920ab9092525f236 checkpoint_tokens=11648 logical_tokens=13068 physical_query_tokens=1420
2026-08-21T10:41:33.033708011Z INFO 08-21 10:41:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-89e98c93cf764990920ab9092525f236 logical_start=11648 logical_end=13068 capped_end=12032 physical_query_tokens=384
2026-08-21T10:41:36.432901830Z INFO 08-21 10:41:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-89e98c93cf764990920ab9092525f236 logical_start=12032 logical_end=13068 capped_end=13056 physical_query_tokens=1024
2026-08-21T10:42:03.451535316Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:42:03.707079087Z INFO 08-21 10:42:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-840e0a9da74a4d03b46087fe5e9d8466 checkpoint_tokens=7168 logical_tokens=7510 physical_query_tokens=342
2026-08-21T10:42:03.707112754Z INFO 08-21 10:42:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-840e0a9da74a4d03b46087fe5e9d8466 logical_start=7168 logical_end=7510 capped_end=7504 physical_query_tokens=336
2026-08-21T10:42:16.650648978Z WARNING 08-21 10:42:16 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=52 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=26 assistant_tool_msgs=24 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:42:16.650834990Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:42:16.663665138Z WARNING 08-21 10:42:16 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=24 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=6 assistant_tool_msgs=6 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:42:16.663800360Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:42:16.857866545Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:42:17.121546658Z INFO 08-21 10:42:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-bb462778ff524393b7b146c97c63b5ef checkpoint_tokens=13056 logical_tokens=13375 physical_query_tokens=319
2026-08-21T10:42:17.121583816Z INFO 08-21 10:42:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-bb462778ff524393b7b146c97c63b5ef logical_start=13056 logical_end=13375 capped_end=13360 physical_query_tokens=304
2026-08-21T10:42:47.220628061Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:42:47.474463994Z INFO 08-21 10:42:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-686cc14dfc7e467aacc91138885dfd79 checkpoint_tokens=7168 logical_tokens=7694 physical_query_tokens=526
2026-08-21T10:42:47.474505427Z INFO 08-21 10:42:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-686cc14dfc7e467aacc91138885dfd79 logical_start=7168 logical_end=7694 capped_end=7488 physical_query_tokens=320
2026-08-21T10:42:50.555899179Z INFO 08-21 10:42:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-686cc14dfc7e467aacc91138885dfd79 logical_start=7488 logical_end=7694 capped_end=7680 physical_query_tokens=192
2026-08-21T10:42:56.665000018Z WARNING 08-21 10:42:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=58 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=29 assistant_tool_msgs=27 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:42:56.665181916Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:42:56.676093894Z WARNING 08-21 10:42:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=56 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=28 assistant_tool_msgs=26 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:42:56.676237363Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:42:56.862402871Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:42:57.128478791Z INFO 08-21 10:42:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e5a495273df1434b9d96fcb3cd833b8b checkpoint_tokens=13056 logical_tokens=14631 physical_query_tokens=1575
2026-08-21T10:42:57.128515654Z INFO 08-21 10:42:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5a495273df1434b9d96fcb3cd833b8b logical_start=13056 logical_end=14631 capped_end=13312 physical_query_tokens=256
2026-08-21T10:43:00.316576371Z INFO 08-21 10:43:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5a495273df1434b9d96fcb3cd833b8b logical_start=13312 logical_end=14631 capped_end=14624 physical_query_tokens=1312
2026-08-21T10:43:32.828852908Z WARNING 08-21 10:43:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=34 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:43:32.829105097Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:43:33.007257960Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:43:33.133125739Z INFO 08-21 10:43:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-205513b8071a4a8dbd5a52f9dc67394d logical_start=0 logical_end=329 capped_end=320 physical_query_tokens=320
2026-08-21T10:47:32.639942266Z WARNING 08-21 10:47:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=60 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=30 assistant_tool_msgs=28 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:47:32.640222531Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:47:32.819564601Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:47:32.946199997Z INFO 08-21 10:47:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-df6d207b8eb948db82923508f464dfac logical_start=0 logical_end=1147 capped_end=1136 physical_query_tokens=1136
2026-08-21T10:51:57.884619067Z WARNING 08-21 10:51:57 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=4 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=32 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:51:57.884896132Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:51:57.891672338Z WARNING 08-21 10:51:57 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=1 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:51:57.891787321Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:51:58.103923963Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:52:06.881578692Z INFO 08-21 10:52:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4aa3a2907ad34b0eb2c3a24c97b82d34 logical_start=8192 logical_end=15084 capped_end=15072 physical_query_tokens=6880
2026-08-21T10:52:33.603346381Z WARNING 08-21 10:52:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=66 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=33 assistant_tool_msgs=31 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:52:33.603593428Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:52:33.612671091Z WARNING 08-21 10:52:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=32 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:52:33.612802763Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:52:33.805938097Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:52:34.064243870Z INFO 08-21 10:52:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c70fb10196174ae1997223020ca2c36a logical_start=0 logical_end=7433 capped_end=7424 physical_query_tokens=7424
2026-08-21T10:53:13.201454186Z WARNING 08-21 10:53:13 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=68 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=34 assistant_tool_msgs=32 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:53:13.201702530Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:53:13.215840958Z WARNING 08-21 10:53:13 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=70 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=35 assistant_tool_msgs=33 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:53:13.215972638Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:53:13.430933938Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:53:13.699315392Z INFO 08-21 10:53:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d8523fbd1ce34b0f8b9030ce9433f782 checkpoint_tokens=13312 logical_tokens=16293 physical_query_tokens=2981
2026-08-21T10:53:13.699354326Z INFO 08-21 10:53:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8523fbd1ce34b0f8b9030ce9433f782 logical_start=13312 logical_end=16293 capped_end=14592 physical_query_tokens=1280
2026-08-21T10:53:18.200328490Z INFO 08-21 10:53:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8523fbd1ce34b0f8b9030ce9433f782 logical_start=14592 logical_end=16293 capped_end=16288 physical_query_tokens=1696
2026-08-21T10:54:49.500246101Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T10:54:49.771095325Z INFO 08-21 10:54:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e75b0455b846443fbff8ea4c02fb6d05 checkpoint_tokens=14592 logical_tokens=16384 physical_query_tokens=1792
2026-08-21T10:54:49.771137056Z INFO 08-21 10:54:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e75b0455b846443fbff8ea4c02fb6d05 logical_start=14592 logical_end=16384 capped_end=16256 physical_query_tokens=1664
2026-08-21T10:54:54.534087810Z INFO 08-21 10:54:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e75b0455b846443fbff8ea4c02fb6d05 logical_start=16256 logical_end=18482 capped_end=18480 physical_query_tokens=2224
2026-08-21T10:55:18.561676451Z WARNING 08-21 10:55:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=72 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=36 assistant_tool_msgs=34 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T10:55:18.561926044Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T10:55:19.205160542Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:05:57.292668667Z INFO 08-21 11:05:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f924081d14944ee0813e7b39392fadba logical_start=253952 logical_end=254336 capped_end=254320 physical_query_tokens=368
2026-08-21T11:24:40.427745133Z WARNING 08-21 11:24:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=74 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=37 assistant_tool_msgs=35 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:24:40.428015585Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:24:40.621687960Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:24:40.884585167Z INFO 08-21 11:24:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1597b8084dbc45c8b65d26d83a4ed826 checkpoint_tokens=7168 logical_tokens=7670 physical_query_tokens=502
2026-08-21T11:24:40.884618250Z INFO 08-21 11:24:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1597b8084dbc45c8b65d26d83a4ed826 logical_start=7168 logical_end=7670 capped_end=7664 physical_query_tokens=496
2026-08-21T11:25:02.138703786Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:25:02.401601866Z INFO 08-21 11:25:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d4db3c58100c468a8cbb2736bbd49334 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T11:25:02.401646620Z INFO 08-21 11:25:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4db3c58100c468a8cbb2736bbd49334 logical_start=7168 logical_end=8192 capped_end=7616 physical_query_tokens=448
2026-08-21T11:25:05.793735899Z INFO 08-21 11:25:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4db3c58100c468a8cbb2736bbd49334 logical_start=7616 logical_end=8974 capped_end=8960 physical_query_tokens=1344
2026-08-21T11:25:34.220212572Z WARNING 08-21 11:25:34 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=17 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=34 tool_msgs=7 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:25:34.220471326Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:25:34.414708947Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:25:34.676735912Z INFO 08-21 11:25:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-73e2221c033e4187aa3c6792dfbdfdad checkpoint_tokens=7616 logical_tokens=7955 physical_query_tokens=339
2026-08-21T11:25:34.676778296Z INFO 08-21 11:25:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-73e2221c033e4187aa3c6792dfbdfdad logical_start=7616 logical_end=7955 capped_end=7952 physical_query_tokens=336
2026-08-21T11:25:57.512885122Z WARNING 08-21 11:25:57 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=4 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=22 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:25:57.513136951Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:25:57.700114382Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:25:57.958928967Z INFO 08-21 11:25:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f24b249ad04c4923b0f4c6e22b24a110 checkpoint_tokens=7424 logical_tokens=8108 physical_query_tokens=684
2026-08-21T11:25:57.958968197Z INFO 08-21 11:25:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f24b249ad04c4923b0f4c6e22b24a110 logical_start=7424 logical_end=8108 capped_end=8096 physical_query_tokens=672
2026-08-21T11:26:14.508945208Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:26:14.635796351Z INFO 08-21 11:26:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9259eba6dad541178ce0485fd9cbd0b6 logical_start=0 logical_end=665 capped_end=656 physical_query_tokens=656
2026-08-21T11:28:57.918561403Z WARNING 08-21 11:28:57 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=80 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=40 assistant_tool_msgs=38 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:28:57.918836488Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:28:58.117081668Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:28:58.382639574Z INFO 08-21 11:28:58 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-96febfdb5ab34b0bb6800b486e75d7d7 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T11:28:58.382676355Z INFO 08-21 11:28:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-96febfdb5ab34b0bb6800b486e75d7d7 logical_start=7424 logical_end=8192 capped_end=8064 physical_query_tokens=640
2026-08-21T11:29:02.161314273Z INFO 08-21 11:29:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-96febfdb5ab34b0bb6800b486e75d7d7 logical_start=8064 logical_end=8897 capped_end=8880 physical_query_tokens=816
2026-08-21T11:29:14.448665749Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:29:14.721297936Z INFO 08-21 11:29:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-791719ce835f494fb144929ce4ef5b58 checkpoint_tokens=16256 logical_tokens=16384 physical_query_tokens=128
2026-08-21T11:29:17.505854738Z INFO 08-21 11:29:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-791719ce835f494fb144929ce4ef5b58 logical_start=16384 logical_end=18180 capped_end=18176 physical_query_tokens=1792
2026-08-21T11:29:58.938391562Z WARNING 08-21 11:29:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=20 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=34 tool_msgs=9 assistant_tool_msgs=5 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:29:58.938624678Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:29:58.953974557Z WARNING 08-21 11:29:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=88 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=44 assistant_tool_msgs=42 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:29:58.954110478Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:29:58.966304531Z WARNING 08-21 11:29:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=84 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=42 assistant_tool_msgs=40 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:29:58.966435035Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:29:59.162435015Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:29:59.421549355Z INFO 08-21 11:29:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e51090547ff2481fb630d6a60f4e8cda checkpoint_tokens=8064 logical_tokens=8192 physical_query_tokens=128
2026-08-21T11:30:01.921784925Z INFO 08-21 11:30:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e51090547ff2481fb630d6a60f4e8cda logical_start=8192 logical_end=8582 capped_end=8576 physical_query_tokens=384
2026-08-21T11:30:22.790146036Z WARNING 08-21 11:30:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=20 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=34 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:30:22.790398240Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:30:22.966053953Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:30:23.090187020Z INFO 08-21 11:30:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-46fa20990f364b2287daa2319ab7711f logical_start=0 logical_end=100 capped_end=64 physical_query_tokens=64
2026-08-21T11:30:24.884055500Z INFO 08-21 11:30:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-46fa20990f364b2287daa2319ab7711f logical_start=64 logical_end=100 capped_end=96 physical_query_tokens=32
2026-08-21T11:30:26.855336791Z WARNING 08-21 11:30:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=90 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=45 assistant_tool_msgs=43 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:30:26.855493292Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:30:26.865275119Z WARNING 08-21 11:30:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=35 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:30:26.865428758Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:30:27.038956751Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:30:27.295022583Z INFO 08-21 11:30:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e49bde72ede94e609663ede060f9f9b6 checkpoint_tokens=7168 logical_tokens=7197 physical_query_tokens=29
2026-08-21T11:30:27.295056743Z INFO 08-21 11:30:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e49bde72ede94e609663ede060f9f9b6 logical_start=7168 logical_end=7197 capped_end=7184 physical_query_tokens=16
2026-08-21T11:30:42.016983838Z WARNING 08-21 11:30:42 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=94 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=47 assistant_tool_msgs=45 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:30:42.017219821Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:30:42.030045607Z WARNING 08-21 11:30:42 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=96 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=48 assistant_tool_msgs=46 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:30:42.030177058Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:30:42.213967040Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:30:42.471618452Z INFO 08-21 11:30:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c76d80099e064470bd3f63e787681f38 checkpoint_tokens=7168 logical_tokens=7656 physical_query_tokens=488
2026-08-21T11:30:42.471659329Z INFO 08-21 11:30:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c76d80099e064470bd3f63e787681f38 logical_start=7168 logical_end=7656 capped_end=7232 physical_query_tokens=64
2026-08-21T11:30:44.456919617Z INFO 08-21 11:30:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c76d80099e064470bd3f63e787681f38 logical_start=7232 logical_end=7656 capped_end=7648 physical_query_tokens=416
2026-08-21T11:30:50.885675617Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:30:51.142741363Z INFO 08-21 11:30:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c92fba923eca427a8749445a81c380f8 checkpoint_tokens=7232 logical_tokens=7767 physical_query_tokens=535
2026-08-21T11:30:51.142778657Z INFO 08-21 11:30:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c92fba923eca427a8749445a81c380f8 logical_start=7232 logical_end=7767 capped_end=7616 physical_query_tokens=384
2026-08-21T11:30:54.319684971Z INFO 08-21 11:30:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c92fba923eca427a8749445a81c380f8 logical_start=7616 logical_end=7767 capped_end=7760 physical_query_tokens=144
2026-08-21T11:31:00.306519962Z WARNING 08-21 11:31:00 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=98 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=49 assistant_tool_msgs=47 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:31:00.306698005Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:31:00.688294887Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:33:54.421395000Z INFO 08-21 11:33:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2aab9576e8004ef69603c670c4108436 logical_start=106496 logical_end=113398 capped_end=113392 physical_query_tokens=6896
2026-08-21T11:51:32.414040521Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:51:32.674295925Z INFO 08-21 11:51:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-06a3ba0d5a7e46a4a805e59ba9e77e20 checkpoint_tokens=8576 logical_tokens=9003 physical_query_tokens=427
2026-08-21T11:51:32.674337138Z INFO 08-21 11:51:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-06a3ba0d5a7e46a4a805e59ba9e77e20 logical_start=8576 logical_end=9003 capped_end=8896 physical_query_tokens=320
2026-08-21T11:51:35.837836253Z INFO 08-21 11:51:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-06a3ba0d5a7e46a4a805e59ba9e77e20 logical_start=8896 logical_end=9003 capped_end=8992 physical_query_tokens=96
2026-08-21T11:51:55.941306495Z WARNING 08-21 11:51:55 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=102 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=51 assistant_tool_msgs=49 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:51:55.941529343Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:51:55.969458486Z WARNING 08-21 11:51:55 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=106 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=53 assistant_tool_msgs=51 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:51:55.969592677Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:51:56.161381276Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:51:56.426608107Z INFO 08-21 11:51:56 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ad11cbe804844aa5835cab90d048c2dd checkpoint_tokens=8896 logical_tokens=9686 physical_query_tokens=790
2026-08-21T11:51:56.426647481Z INFO 08-21 11:51:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ad11cbe804844aa5835cab90d048c2dd logical_start=8896 logical_end=9686 capped_end=8960 physical_query_tokens=64
2026-08-21T11:51:58.571524011Z INFO 08-21 11:51:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ad11cbe804844aa5835cab90d048c2dd logical_start=8960 logical_end=9686 capped_end=9680 physical_query_tokens=720
2026-08-21T11:52:24.116099533Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:52:24.375380921Z INFO 08-21 11:52:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e5249d4c0ad14097997f28134a331ebd checkpoint_tokens=8960 logical_tokens=9216 physical_query_tokens=256
2026-08-21T11:52:24.375417518Z INFO 08-21 11:52:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5249d4c0ad14097997f28134a331ebd logical_start=8960 logical_end=9216 capped_end=9200 physical_query_tokens=240
2026-08-21T11:52:36.316568457Z WARNING 08-21 11:52:36 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=218 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=103 assistant_tool_msgs=99 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:52:36.316814772Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:52:36.551871395Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:52:36.855011709Z INFO 08-21 11:52:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4206d76826274aa6b8b732f2c608911c logical_start=0 logical_end=8192 capped_end=2048 physical_query_tokens=2048
2026-08-21T11:53:11.254836074Z INFO 08-21 11:53:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4206d76826274aa6b8b732f2c608911c logical_start=26624 logical_end=27697 capped_end=27680 physical_query_tokens=1056
2026-08-21T11:53:46.910105831Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:53:47.183448723Z INFO 08-21 11:53:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-180ed47821054f35826baa2dab6eb25a checkpoint_tokens=2048 logical_tokens=8192 physical_query_tokens=6144
2026-08-21T11:54:04.007188668Z INFO 08-21 11:54:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-180ed47821054f35826baa2dab6eb25a logical_start=16384 logical_end=23974 capped_end=23968 physical_query_tokens=7584
2026-08-21T11:54:35.460338166Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:54:35.719471151Z INFO 08-21 11:54:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9dd28ee769594a7bb6ea804bf167593c checkpoint_tokens=7168 logical_tokens=7229 physical_query_tokens=61
2026-08-21T11:54:35.719512684Z INFO 08-21 11:54:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9dd28ee769594a7bb6ea804bf167593c logical_start=7168 logical_end=7229 capped_end=7216 physical_query_tokens=48
2026-08-21T11:55:11.055606299Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:55:11.321847432Z INFO 08-21 11:55:11 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4ba51937e8f748f6a38ceffa56998752 checkpoint_tokens=8960 logical_tokens=11236 physical_query_tokens=2276
2026-08-21T11:55:11.321883943Z INFO 08-21 11:55:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4ba51937e8f748f6a38ceffa56998752 logical_start=8960 logical_end=11236 capped_end=9664 physical_query_tokens=704
2026-08-21T11:55:15.178425474Z INFO 08-21 11:55:15 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4ba51937e8f748f6a38ceffa56998752 logical_start=9664 logical_end=11236 capped_end=11232 physical_query_tokens=1568
2026-08-21T11:55:47.764630624Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:55:48.040602514Z INFO 08-21 11:55:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-815ba41006d74188ac8cea8f6e13a503 checkpoint_tokens=2048 logical_tokens=8192 physical_query_tokens=6144
2026-08-21T11:56:04.841912468Z INFO 08-21 11:56:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-815ba41006d74188ac8cea8f6e13a503 logical_start=16384 logical_end=24275 capped_end=24000 physical_query_tokens=7616
2026-08-21T11:56:14.588365762Z INFO 08-21 11:56:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-815ba41006d74188ac8cea8f6e13a503 logical_start=24000 logical_end=24275 capped_end=24272 physical_query_tokens=272
2026-08-21T11:56:28.548120748Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:56:28.829633541Z INFO 08-21 11:56:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-50bf08abb49b419bbf0da4ccd46d38d5 checkpoint_tokens=2048 logical_tokens=8192 physical_query_tokens=6144
2026-08-21T11:56:55.632985043Z INFO 08-21 11:56:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-50bf08abb49b419bbf0da4ccd46d38d5 logical_start=24576 logical_end=29279 capped_end=27648 physical_query_tokens=3072
2026-08-21T11:57:01.946358667Z INFO 08-21 11:57:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-50bf08abb49b419bbf0da4ccd46d38d5 logical_start=27648 logical_end=29279 capped_end=29264 physical_query_tokens=1616
2026-08-21T11:57:42.190825666Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:57:42.456502915Z INFO 08-21 11:57:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1f2e476a4e73450881a8ee657af15513 checkpoint_tokens=9664 logical_tokens=11866 physical_query_tokens=2202
2026-08-21T11:57:42.456536226Z INFO 08-21 11:57:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1f2e476a4e73450881a8ee657af15513 logical_start=9664 logical_end=11866 capped_end=11200 physical_query_tokens=1536
2026-08-21T11:57:47.018765903Z INFO 08-21 11:57:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1f2e476a4e73450881a8ee657af15513 logical_start=11200 logical_end=11866 capped_end=11856 physical_query_tokens=656
2026-08-21T11:58:05.192631650Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:58:05.452954836Z INFO 08-21 11:58:05 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3c965417456a4b5e9d3d153451fcb593 checkpoint_tokens=7168 logical_tokens=7689 physical_query_tokens=521
2026-08-21T11:58:05.452991547Z INFO 08-21 11:58:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3c965417456a4b5e9d3d153451fcb593 logical_start=7168 logical_end=7689 capped_end=7680 physical_query_tokens=512
2026-08-21T11:58:29.859204980Z WARNING 08-21 11:58:29 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=110 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=55 assistant_tool_msgs=53 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T11:58:29.859458854Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T11:58:30.203268199Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T11:58:30.587372603Z INFO 08-21 11:58:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a63cf6149bcf447e88b3a280ae544941 checkpoint_tokens=27648 logical_tokens=32768 physical_query_tokens=5120
2026-08-21T11:58:30.587417573Z INFO 08-21 11:58:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a63cf6149bcf447e88b3a280ae544941 logical_start=27648 logical_end=32768 capped_end=27712 physical_query_tokens=64
2026-08-21T11:59:39.044520224Z INFO 08-21 11:59:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a63cf6149bcf447e88b3a280ae544941 logical_start=68672 logical_end=73323 capped_end=73312 physical_query_tokens=4640
2026-08-21T12:01:08.963548479Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:01:17.764297025Z INFO 08-21 12:01:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c03b83f31fd14f13ae54f3f7309acf33 logical_start=8192 logical_end=16384 capped_end=15040 physical_query_tokens=6848
2026-08-21T12:01:36.409944205Z INFO 08-21 12:01:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c03b83f31fd14f13ae54f3f7309acf33 logical_start=23232 logical_end=28542 capped_end=28528 physical_query_tokens=5296
2026-08-21T12:01:54.762486062Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:01:55.167351679Z INFO 08-21 12:01:55 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9f1b7b06b53c45ee9f8c08ae21b15bcf checkpoint_tokens=27712 logical_tokens=32768 physical_query_tokens=5056
2026-08-21T12:02:27.974639818Z INFO 08-21 12:02:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9f1b7b06b53c45ee9f8c08ae21b15bcf logical_start=49152 logical_end=57344 capped_end=51072 physical_query_tokens=1920
2026-08-21T12:03:34.612121185Z INFO 08-21 12:03:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9f1b7b06b53c45ee9f8c08ae21b15bcf logical_start=83840 logical_end=89252 capped_end=89248 physical_query_tokens=5408
2026-08-21T12:05:48.056826798Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:05:48.320943100Z INFO 08-21 12:05:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3146654a2e7844f9b20551e205a6e30e checkpoint_tokens=11200 logical_tokens=11967 physical_query_tokens=767
2026-08-21T12:05:48.320988589Z INFO 08-21 12:05:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3146654a2e7844f9b20551e205a6e30e logical_start=11200 logical_end=11967 capped_end=11840 physical_query_tokens=640
2026-08-21T12:05:52.153025541Z INFO 08-21 12:05:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3146654a2e7844f9b20551e205a6e30e logical_start=11840 logical_end=11967 capped_end=11952 physical_query_tokens=112
2026-08-21T12:06:16.461432338Z WARNING 08-21 12:06:16 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=220 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=104 assistant_tool_msgs=100 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:06:16.461681963Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:06:16.747335548Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:06:17.073820476Z INFO 08-21 12:06:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-42e9a51e44fb460f92ea83e535140dd5 checkpoint_tokens=2048 logical_tokens=8192 physical_query_tokens=6144
2026-08-21T12:06:33.819279116Z INFO 08-21 12:06:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-42e9a51e44fb460f92ea83e535140dd5 logical_start=16384 logical_end=24576 capped_end=19904 physical_query_tokens=3520
2026-08-21T12:07:02.590766101Z INFO 08-21 12:07:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-42e9a51e44fb460f92ea83e535140dd5 logical_start=36288 logical_end=44013 capped_end=44000 physical_query_tokens=7712
2026-08-21T12:10:24.987988991Z WARNING 08-21 12:10:24 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=222 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=105 assistant_tool_msgs=101 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:10:24.988216171Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:10:25.236050266Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:10:25.518826802Z INFO 08-21 12:10:25 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-de3cd9dc74c24081946c6f0a4081cdde checkpoint_tokens=19904 logical_tokens=24576 physical_query_tokens=4672
2026-08-21T12:10:33.104375609Z INFO 08-21 12:10:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-de3cd9dc74c24081946c6f0a4081cdde logical_start=24576 logical_end=27642 capped_end=27632 physical_query_tokens=3056
2026-08-21T12:10:58.783643839Z ERROR 08-21 12:10:58 serving_chat.py:345] Error in applying chat template from request
2026-08-21T12:10:58.783659813Z ERROR 08-21 12:10:58 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T12:10:58.783662582Z ERROR 08-21 12:10:58 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T12:10:58.783665192Z ERROR 08-21 12:10:58 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T12:10:58.783667406Z ERROR 08-21 12:10:58 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T12:10:58.783669864Z ERROR 08-21 12:10:58 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T12:10:58.783671891Z ERROR 08-21 12:10:58 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T12:10:58.783673953Z ERROR 08-21 12:10:58 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T12:10:58.783684339Z ERROR 08-21 12:10:58 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T12:10:58.783686587Z ERROR 08-21 12:10:58 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T12:10:58.783688579Z ERROR 08-21 12:10:58 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T12:10:58.783690854Z ERROR 08-21 12:10:58 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T12:10:58.783692889Z ERROR 08-21 12:10:58 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T12:10:58.783695010Z ERROR 08-21 12:10:58 serving_chat.py:345] raise ValueError(
2026-08-21T12:10:58.783697016Z ERROR 08-21 12:10:58 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T12:10:58.783798015Z /usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py:346: RuntimeWarning: coroutine 'async_get_and_parse_image' was never awaited
2026-08-21T12:10:58.783809053Z return self.create_error_response(str(e))
2026-08-21T12:10:58.783812612Z RuntimeWarning: Enable tracemalloc to get the object allocation traceback
2026-08-21T12:10:58.783942480Z WARNING 08-21 12:10:58 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=15 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=5 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T12:10:58.784164439Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:10:59.076088273Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:10:59.386615371Z INFO 08-21 12:10:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4f0af8b2f8ea4924a1b09a3abd1192a7 checkpoint_tokens=19904 logical_tokens=24576 physical_query_tokens=4672
2026-08-21T12:11:29.693332808Z INFO 08-21 12:11:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4f0af8b2f8ea4924a1b09a3abd1192a7 logical_start=40960 logical_end=47563 capped_end=43968 physical_query_tokens=3008
2026-08-21T12:11:36.679756047Z INFO 08-21 12:11:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4f0af8b2f8ea4924a1b09a3abd1192a7 logical_start=43968 logical_end=47563 capped_end=47552 physical_query_tokens=3584
2026-08-21T12:17:39.760569636Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:17:40.045687196Z INFO 08-21 12:17:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b7edd427472440129767588ac09da682 checkpoint_tokens=15040 logical_tokens=16384 physical_query_tokens=1344
2026-08-21T12:17:54.549878920Z INFO 08-21 12:17:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b7edd427472440129767588ac09da682 logical_start=24576 logical_end=29042 capped_end=28480 physical_query_tokens=3904
2026-08-21T12:18:01.540109797Z INFO 08-21 12:18:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b7edd427472440129767588ac09da682 logical_start=28480 logical_end=29042 capped_end=29040 physical_query_tokens=560
2026-08-21T12:18:10.692676894Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:18:10.964607278Z INFO 08-21 12:18:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5f02e3503513413dafbcb5024ab105d2 checkpoint_tokens=11840 logical_tokens=15058 physical_query_tokens=3218
2026-08-21T12:18:10.964636785Z INFO 08-21 12:18:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5f02e3503513413dafbcb5024ab105d2 logical_start=11840 logical_end=15058 capped_end=11904 physical_query_tokens=64
2026-08-21T12:18:13.161946586Z INFO 08-21 12:18:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5f02e3503513413dafbcb5024ab105d2 logical_start=11904 logical_end=15058 capped_end=15056 physical_query_tokens=3152
2026-08-21T12:19:03.650124025Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:19:03.932966767Z INFO 08-21 12:19:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-618037d05bfc448c91cd372b1cb54410 checkpoint_tokens=28480 logical_tokens=29199 physical_query_tokens=719
2026-08-21T12:19:03.933010992Z INFO 08-21 12:19:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-618037d05bfc448c91cd372b1cb54410 logical_start=28480 logical_end=29199 capped_end=28992 physical_query_tokens=512
2026-08-21T12:19:07.722119536Z INFO 08-21 12:19:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-618037d05bfc448c91cd372b1cb54410 logical_start=28992 logical_end=29199 capped_end=29184 physical_query_tokens=192
2026-08-21T12:19:17.837748441Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:19:18.107561964Z INFO 08-21 12:19:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d4399cb5037742daad00dc6838ae6139 checkpoint_tokens=11904 logical_tokens=15965 physical_query_tokens=4061
2026-08-21T12:19:18.107603891Z INFO 08-21 12:19:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4399cb5037742daad00dc6838ae6139 logical_start=11904 logical_end=15965 capped_end=15040 physical_query_tokens=3136
2026-08-21T12:19:23.913582133Z INFO 08-21 12:19:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4399cb5037742daad00dc6838ae6139 logical_start=15040 logical_end=15965 capped_end=15952 physical_query_tokens=912
2026-08-21T12:19:54.197689876Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:19:54.578468474Z INFO 08-21 12:19:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8b8d1ece4ac24883b299de4585135f3a checkpoint_tokens=27712 logical_tokens=32768 physical_query_tokens=5056
2026-08-21T12:22:17.705906383Z INFO 08-21 12:22:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8b8d1ece4ac24883b299de4585135f3a logical_start=106496 logical_end=110846 capped_end=110720 physical_query_tokens=4224
2026-08-21T12:22:30.097477670Z INFO 08-21 12:22:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8b8d1ece4ac24883b299de4585135f3a logical_start=110720 logical_end=110846 capped_end=110832 physical_query_tokens=112
2026-08-21T12:29:47.674043960Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:29:47.947069775Z INFO 08-21 12:29:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a5c0c868c45d4e778bf0437d8718cc35 checkpoint_tokens=15040 logical_tokens=16384 physical_query_tokens=1344
2026-08-21T12:29:47.947105614Z INFO 08-21 12:29:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a5c0c868c45d4e778bf0437d8718cc35 logical_start=15040 logical_end=16384 capped_end=15936 physical_query_tokens=896
2026-08-21T12:29:52.057107282Z INFO 08-21 12:29:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a5c0c868c45d4e778bf0437d8718cc35 logical_start=15936 logical_end=18014 capped_end=18000 physical_query_tokens=2064
2026-08-21T12:30:27.445363905Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:30:27.571525740Z INFO 08-21 12:30:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-45525ddae0614243bc2f4dc22bda22a6 logical_start=0 logical_end=536 capped_end=64 physical_query_tokens=64
2026-08-21T12:30:29.398065304Z INFO 08-21 12:30:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-45525ddae0614243bc2f4dc22bda22a6 logical_start=64 logical_end=536 capped_end=528 physical_query_tokens=464
2026-08-21T12:37:01.762484820Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:37:02.047127556Z INFO 08-21 12:37:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a220a1de93e34edcbb27d37caf684658 checkpoint_tokens=15936 logical_tokens=16384 physical_query_tokens=448
2026-08-21T12:37:05.616148175Z INFO 08-21 12:37:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a220a1de93e34edcbb27d37caf684658 logical_start=16384 logical_end=19077 capped_end=17984 physical_query_tokens=1600
2026-08-21T12:37:10.175279307Z INFO 08-21 12:37:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a220a1de93e34edcbb27d37caf684658 logical_start=17984 logical_end=19077 capped_end=19072 physical_query_tokens=1088
2026-08-21T12:37:56.858923421Z WARNING 08-21 12:37:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=226 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=107 assistant_tool_msgs=103 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:37:56.859191234Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:37:56.901172664Z WARNING 08-21 12:37:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=236 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=112 assistant_tool_msgs=108 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:37:56.901306124Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:37:57.127126964Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:37:57.402323611Z INFO 08-21 12:37:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ca4ba730705a47548628c2f99b7d6a61 checkpoint_tokens=19072 logical_tokens=19748 physical_query_tokens=676
2026-08-21T12:37:57.402365719Z INFO 08-21 12:37:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ca4ba730705a47548628c2f99b7d6a61 logical_start=19072 logical_end=19748 capped_end=19744 physical_query_tokens=672
2026-08-21T12:38:32.794204940Z WARNING 08-21 12:38:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=228 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=108 assistant_tool_msgs=104 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:38:32.794450288Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:38:32.992589832Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:38:33.254615510Z INFO 08-21 12:38:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d95f41e0a5c5415e843576a3a4f922ab checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T12:38:33.254655303Z INFO 08-21 12:38:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d95f41e0a5c5415e843576a3a4f922ab logical_start=7168 logical_end=8192 capped_end=7360 physical_query_tokens=192
2026-08-21T12:38:36.104706543Z INFO 08-21 12:38:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d95f41e0a5c5415e843576a3a4f922ab logical_start=7360 logical_end=8693 capped_end=8688 physical_query_tokens=1328
2026-08-21T12:38:58.419249786Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:38:58.693493426Z INFO 08-21 12:38:58 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ee18d6ab7f064debb6786b0fc2ff68e0 checkpoint_tokens=19072 logical_tokens=20156 physical_query_tokens=1084
2026-08-21T12:38:58.693539247Z INFO 08-21 12:38:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ee18d6ab7f064debb6786b0fc2ff68e0 logical_start=19072 logical_end=20156 capped_end=19712 physical_query_tokens=640
2026-08-21T12:39:02.734562464Z INFO 08-21 12:39:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ee18d6ab7f064debb6786b0fc2ff68e0 logical_start=19712 logical_end=20156 capped_end=20144 physical_query_tokens=432
2026-08-21T12:39:43.816111909Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:39:44.091416633Z INFO 08-21 12:39:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-99d2ca4f1304408eba2a43bfc8880d71 checkpoint_tokens=19712 logical_tokens=20034 physical_query_tokens=322
2026-08-21T12:39:44.091456427Z INFO 08-21 12:39:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-99d2ca4f1304408eba2a43bfc8880d71 logical_start=19712 logical_end=20034 capped_end=20032 physical_query_tokens=320
2026-08-21T12:40:07.231013900Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:40:07.492231413Z INFO 08-21 12:40:07 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-aa107166f5a4424fbc7a81740cf9278c checkpoint_tokens=7360 logical_tokens=8192 physical_query_tokens=832
2026-08-21T12:40:11.263959853Z INFO 08-21 12:40:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aa107166f5a4424fbc7a81740cf9278c logical_start=8192 logical_end=9626 capped_end=8640 physical_query_tokens=448
2026-08-21T12:40:14.420549785Z INFO 08-21 12:40:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aa107166f5a4424fbc7a81740cf9278c logical_start=8640 logical_end=9626 capped_end=9616 physical_query_tokens=976
2026-08-21T12:41:05.396198800Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:41:05.670972333Z INFO 08-21 12:41:05 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-156fd23979b548eab7c3d0e669cfc6fe checkpoint_tokens=20032 logical_tokens=21261 physical_query_tokens=1229
2026-08-21T12:41:05.671014531Z INFO 08-21 12:41:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-156fd23979b548eab7c3d0e669cfc6fe logical_start=20032 logical_end=21261 capped_end=20096 physical_query_tokens=64
2026-08-21T12:41:07.956902662Z INFO 08-21 12:41:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-156fd23979b548eab7c3d0e669cfc6fe logical_start=20096 logical_end=21261 capped_end=21248 physical_query_tokens=1152
2026-08-21T12:41:26.030494584Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:41:26.155477038Z INFO 08-21 12:41:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b1b8f4fdcacf4f5f83baa6572b01d906 logical_start=0 logical_end=370 capped_end=64 physical_query_tokens=64
2026-08-21T12:41:27.957470134Z INFO 08-21 12:41:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b1b8f4fdcacf4f5f83baa6572b01d906 logical_start=64 logical_end=370 capped_end=368 physical_query_tokens=304
2026-08-21T12:43:50.358425580Z WARNING 08-21 12:43:50 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=232 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=110 assistant_tool_msgs=106 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:43:50.358710709Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:43:50.543405122Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:43:50.668582792Z INFO 08-21 12:43:50 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-157114febdf54ca19cffacd6a8bb56dd checkpoint_tokens=528 logical_tokens=536 physical_query_tokens=8
2026-08-21T12:51:21.722336626Z WARNING 08-21 12:51:21 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=234 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=111 assistant_tool_msgs=107 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:51:21.722622790Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:51:21.954842987Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:51:22.236628993Z INFO 08-21 12:51:22 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e1e0f11d41ae44a0b20e2117f38d42bc checkpoint_tokens=21248 logical_tokens=21583 physical_query_tokens=335
2026-08-21T12:51:22.236676007Z INFO 08-21 12:51:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e1e0f11d41ae44a0b20e2117f38d42bc logical_start=21248 logical_end=21583 capped_end=21568 physical_query_tokens=320
2026-08-21T12:51:46.555193219Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:51:46.837004915Z INFO 08-21 12:51:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3ca13d29a755492c97481841245764fb checkpoint_tokens=21568 logical_tokens=21832 physical_query_tokens=264
2026-08-21T12:51:46.837047753Z INFO 08-21 12:51:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3ca13d29a755492c97481841245764fb logical_start=21568 logical_end=21832 capped_end=21824 physical_query_tokens=256
2026-08-21T12:52:10.084344608Z WARNING 08-21 12:52:10 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=260 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=124 assistant_tool_msgs=120 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:52:10.084609186Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:52:10.274808227Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:52:10.531402785Z INFO 08-21 12:52:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-69eeead2b80f4071b6427dc7a6cc3a55 logical_start=0 logical_end=7390 capped_end=7232 physical_query_tokens=7232
2026-08-21T12:52:18.417534545Z INFO 08-21 12:52:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-69eeead2b80f4071b6427dc7a6cc3a55 logical_start=7232 logical_end=7390 capped_end=7376 physical_query_tokens=144
2026-08-21T12:52:24.546319564Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:52:24.803878996Z INFO 08-21 12:52:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cbce0a113a0346a3a19432a944e6d597 checkpoint_tokens=7232 logical_tokens=7479 physical_query_tokens=247
2026-08-21T12:52:24.803914709Z INFO 08-21 12:52:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cbce0a113a0346a3a19432a944e6d597 logical_start=7232 logical_end=7479 capped_end=7360 physical_query_tokens=128
2026-08-21T12:52:27.309705176Z INFO 08-21 12:52:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cbce0a113a0346a3a19432a944e6d597 logical_start=7360 logical_end=7479 capped_end=7472 physical_query_tokens=112
2026-08-21T12:52:32.722681611Z ERROR 08-21 12:52:32 serving_chat.py:345] Error in applying chat template from request
2026-08-21T12:52:32.722685695Z ERROR 08-21 12:52:32 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T12:52:32.722688068Z ERROR 08-21 12:52:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T12:52:32.722690506Z ERROR 08-21 12:52:32 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T12:52:32.722692487Z ERROR 08-21 12:52:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T12:52:32.722694757Z ERROR 08-21 12:52:32 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T12:52:32.722696657Z ERROR 08-21 12:52:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T12:52:32.722698714Z ERROR 08-21 12:52:32 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T12:52:32.722700602Z ERROR 08-21 12:52:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T12:52:32.722706509Z ERROR 08-21 12:52:32 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T12:52:32.722708675Z ERROR 08-21 12:52:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T12:52:32.722710783Z ERROR 08-21 12:52:32 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T12:52:32.722712744Z ERROR 08-21 12:52:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T12:52:32.722714777Z ERROR 08-21 12:52:32 serving_chat.py:345] raise ValueError(
2026-08-21T12:52:32.722716657Z ERROR 08-21 12:52:32 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T12:52:32.722869066Z WARNING 08-21 12:52:32 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=18 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=5 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T12:52:32.723045737Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:52:32.903001342Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:52:33.160808055Z INFO 08-21 12:52:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3b24f1f05559413ba30108209bb45b5a checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T12:53:00.330673168Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:53:00.456908138Z INFO 08-21 12:53:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5f2e1f02416f4fb79bb4bbc253beda9b logical_start=0 logical_end=674 capped_end=672 physical_query_tokens=672
2026-08-21T12:55:57.889202423Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:55:58.155772604Z INFO 08-21 12:55:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c47f3bd4a2894a399a9d3c87051f1637 logical_start=0 logical_end=7646 capped_end=7424 physical_query_tokens=7424
2026-08-21T12:56:06.190045453Z INFO 08-21 12:56:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c47f3bd4a2894a399a9d3c87051f1637 logical_start=7424 logical_end=7646 capped_end=7632 physical_query_tokens=208
2026-08-21T12:56:27.780781381Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:56:28.040576629Z INFO 08-21 12:56:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-71ccfc8b743d4308a8cf6f121e661e96 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T12:56:28.040613844Z INFO 08-21 12:56:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-71ccfc8b743d4308a8cf6f121e661e96 logical_start=7424 logical_end=8192 capped_end=7616 physical_query_tokens=192
2026-08-21T12:56:30.849626629Z INFO 08-21 12:56:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-71ccfc8b743d4308a8cf6f121e661e96 logical_start=7616 logical_end=8402 capped_end=8400 physical_query_tokens=784
2026-08-21T12:56:56.782771100Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:56:57.048587562Z INFO 08-21 12:56:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-564889f27acf45718e3901be3fe6e136 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T12:56:57.048628507Z INFO 08-21 12:56:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-564889f27acf45718e3901be3fe6e136 logical_start=7168 logical_end=8192 capped_end=7232 physical_query_tokens=64
2026-08-21T12:56:58.880931041Z INFO 08-21 12:56:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-564889f27acf45718e3901be3fe6e136 logical_start=7232 logical_end=11385 capped_end=11376 physical_query_tokens=4144
2026-08-21T12:57:35.671113538Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:57:35.930094249Z INFO 08-21 12:57:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-bc4f2bbdaa0d49de92522b06c59db3f4 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T12:57:39.826565309Z INFO 08-21 12:57:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-bc4f2bbdaa0d49de92522b06c59db3f4 logical_start=8192 logical_end=9348 capped_end=9344 physical_query_tokens=1152
2026-08-21T12:58:01.715306279Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:58:01.975755589Z INFO 08-21 12:58:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1eca557298434cabbb4d65510695786c checkpoint_tokens=9344 logical_tokens=9998 physical_query_tokens=654
2026-08-21T12:58:01.975793682Z INFO 08-21 12:58:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1eca557298434cabbb4d65510695786c logical_start=9344 logical_end=9998 capped_end=9984 physical_query_tokens=640
2026-08-21T12:58:24.431970431Z WARNING 08-21 12:58:24 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=238 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=113 assistant_tool_msgs=109 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T12:58:24.432253323Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T12:58:24.626869433Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:58:24.889007488Z INFO 08-21 12:58:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6ede8c1a698e4ae0a418492a39c5f0d3 logical_start=0 logical_end=8192 capped_end=7488 physical_query_tokens=7488
2026-08-21T12:58:32.922741133Z INFO 08-21 12:58:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6ede8c1a698e4ae0a418492a39c5f0d3 logical_start=7488 logical_end=9805 capped_end=9792 physical_query_tokens=2304
2026-08-21T12:58:54.587746481Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:58:54.851528361Z INFO 08-21 12:58:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-733316ba1f1047cd9e9ab61ea883a74d checkpoint_tokens=9792 logical_tokens=11629 physical_query_tokens=1837
2026-08-21T12:58:54.851560265Z INFO 08-21 12:58:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-733316ba1f1047cd9e9ab61ea883a74d logical_start=9792 logical_end=11629 capped_end=11616 physical_query_tokens=1824
2026-08-21T12:59:08.533300834Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:59:08.795965819Z INFO 08-21 12:59:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b0d3189a21b346e099787460eef055e0 checkpoint_tokens=7616 logical_tokens=8192 physical_query_tokens=576
2026-08-21T12:59:12.307042325Z INFO 08-21 12:59:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b0d3189a21b346e099787460eef055e0 logical_start=8192 logical_end=10021 capped_end=8384 physical_query_tokens=192
2026-08-21T12:59:14.948470905Z INFO 08-21 12:59:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b0d3189a21b346e099787460eef055e0 logical_start=8384 logical_end=10021 capped_end=10016 physical_query_tokens=1632
2026-08-21T12:59:45.372453269Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T12:59:45.630829826Z INFO 08-21 12:59:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b5bbaeba86194be7a4e746ca2bd82d91 logical_start=0 logical_end=7197 capped_end=7184 physical_query_tokens=7184
2026-08-21T13:00:05.408790628Z ERROR 08-21 13:00:05 serving_chat.py:345] Error in applying chat template from request
2026-08-21T13:00:05.408802754Z ERROR 08-21 13:00:05 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T13:00:05.408806124Z ERROR 08-21 13:00:05 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T13:00:05.408809632Z ERROR 08-21 13:00:05 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T13:00:05.408812977Z ERROR 08-21 13:00:05 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T13:00:05.408816768Z ERROR 08-21 13:00:05 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T13:00:05.408818858Z ERROR 08-21 13:00:05 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T13:00:05.408821045Z ERROR 08-21 13:00:05 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T13:00:05.408823160Z ERROR 08-21 13:00:05 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T13:00:05.408825643Z ERROR 08-21 13:00:05 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T13:00:05.408827752Z ERROR 08-21 13:00:05 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T13:00:05.408829852Z ERROR 08-21 13:00:05 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T13:00:05.408831899Z ERROR 08-21 13:00:05 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T13:00:05.408834104Z ERROR 08-21 13:00:05 serving_chat.py:345] raise ValueError(
2026-08-21T13:00:05.408836019Z ERROR 08-21 13:00:05 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T13:00:05.409000909Z WARNING 08-21 13:00:05 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=22 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=6 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T13:00:05.409229421Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T13:00:05.613606579Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:00:05.878950389Z INFO 08-21 13:00:05 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b3ad7fa1698d4c0fa5b97df8b196a9c9 checkpoint_tokens=9792 logical_tokens=11879 physical_query_tokens=2087
2026-08-21T13:00:05.878994321Z INFO 08-21 13:00:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b3ad7fa1698d4c0fa5b97df8b196a9c9 logical_start=9792 logical_end=11879 capped_end=11584 physical_query_tokens=1792
2026-08-21T13:00:10.453848107Z INFO 08-21 13:00:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b3ad7fa1698d4c0fa5b97df8b196a9c9 logical_start=11584 logical_end=11879 capped_end=11872 physical_query_tokens=288
2026-08-21T13:00:29.927659007Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:00:30.184911635Z INFO 08-21 13:00:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4ee60ab664ca40d3a009089eb88d0de2 checkpoint_tokens=7232 logical_tokens=7419 physical_query_tokens=187
2026-08-21T13:00:30.184955925Z INFO 08-21 13:00:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4ee60ab664ca40d3a009089eb88d0de2 logical_start=7232 logical_end=7419 capped_end=7296 physical_query_tokens=64
2026-08-21T13:00:32.307078267Z INFO 08-21 13:00:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4ee60ab664ca40d3a009089eb88d0de2 logical_start=7296 logical_end=7419 capped_end=7408 physical_query_tokens=112
2026-08-21T13:00:42.056503604Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:00:42.319855456Z INFO 08-21 13:00:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cea7d1338f804f2f9eb18f0bf5901ae0 checkpoint_tokens=11584 logical_tokens=12157 physical_query_tokens=573
2026-08-21T13:00:42.319889294Z INFO 08-21 13:00:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cea7d1338f804f2f9eb18f0bf5901ae0 logical_start=11584 logical_end=12157 capped_end=11840 physical_query_tokens=256
2026-08-21T13:00:45.332377665Z INFO 08-21 13:00:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cea7d1338f804f2f9eb18f0bf5901ae0 logical_start=11840 logical_end=12157 capped_end=12144 physical_query_tokens=304
2026-08-21T13:01:06.269665147Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:01:06.530398134Z INFO 08-21 13:01:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c12d6185977d4eb7907f8ad4312347b8 checkpoint_tokens=7296 logical_tokens=7703 physical_query_tokens=407
2026-08-21T13:01:06.530442869Z INFO 08-21 13:01:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c12d6185977d4eb7907f8ad4312347b8 logical_start=7296 logical_end=7703 capped_end=7360 physical_query_tokens=64
2026-08-21T13:01:08.609254155Z INFO 08-21 13:01:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c12d6185977d4eb7907f8ad4312347b8 logical_start=7360 logical_end=7703 capped_end=7696 physical_query_tokens=336
2026-08-21T13:01:22.069640811Z WARNING 08-21 13:01:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=244 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=116 assistant_tool_msgs=112 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T13:01:22.069839400Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T13:01:22.103588151Z WARNING 08-21 13:01:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=246 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=117 assistant_tool_msgs=113 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T13:01:22.103727789Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T13:01:22.285618066Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:01:22.542617601Z INFO 08-21 13:01:22 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3871cda90d384d4d97ceff5406397d36 checkpoint_tokens=7360 logical_tokens=7814 physical_query_tokens=454
2026-08-21T13:01:22.542654148Z INFO 08-21 13:01:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3871cda90d384d4d97ceff5406397d36 logical_start=7360 logical_end=7814 capped_end=7680 physical_query_tokens=320
2026-08-21T13:01:25.637145531Z INFO 08-21 13:01:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3871cda90d384d4d97ceff5406397d36 logical_start=7680 logical_end=7814 capped_end=7808 physical_query_tokens=128
2026-08-21T13:01:40.158380948Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:01:40.417062800Z INFO 08-21 13:01:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-637d81337a5f456599c770014e1a659c checkpoint_tokens=7808 logical_tokens=8074 physical_query_tokens=266
2026-08-21T13:01:40.417108278Z INFO 08-21 13:01:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-637d81337a5f456599c770014e1a659c logical_start=7808 logical_end=8074 capped_end=8064 physical_query_tokens=256
2026-08-21T13:01:46.469735636Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:01:46.731313731Z INFO 08-21 13:01:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-de9a09430cbf4b2b8132afc6cf42355b checkpoint_tokens=7808 logical_tokens=7944 physical_query_tokens=136
2026-08-21T13:01:46.731354825Z INFO 08-21 13:01:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-de9a09430cbf4b2b8132afc6cf42355b logical_start=7808 logical_end=7944 capped_end=7936 physical_query_tokens=128
2026-08-21T13:01:52.330050324Z WARNING 08-21 13:01:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=254 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=121 assistant_tool_msgs=117 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T13:01:52.330240526Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T13:01:52.514622643Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:01:52.776855610Z INFO 08-21 13:01:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-88cecce8e25244159262d838a1fe08ae checkpoint_tokens=11840 logical_tokens=12841 physical_query_tokens=1001
2026-08-21T13:01:52.776898724Z INFO 08-21 13:01:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-88cecce8e25244159262d838a1fe08ae logical_start=11840 logical_end=12841 capped_end=12096 physical_query_tokens=256
2026-08-21T13:01:55.843268221Z INFO 08-21 13:01:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-88cecce8e25244159262d838a1fe08ae logical_start=12096 logical_end=12841 capped_end=12832 physical_query_tokens=736
2026-08-21T13:02:27.007255893Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:02:27.270651636Z INFO 08-21 13:02:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-605a72e2bed240fe983d732890c17248 checkpoint_tokens=12096 logical_tokens=13182 physical_query_tokens=1086
2026-08-21T13:02:27.270694357Z INFO 08-21 13:02:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-605a72e2bed240fe983d732890c17248 logical_start=12096 logical_end=13182 capped_end=12800 physical_query_tokens=704
2026-08-21T13:02:31.075775012Z INFO 08-21 13:02:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-605a72e2bed240fe983d732890c17248 logical_start=12800 logical_end=13182 capped_end=13168 physical_query_tokens=368
2026-08-21T13:02:54.097533172Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:02:54.224192288Z INFO 08-21 13:02:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-17a15787e82743eab876d5b3f422c4bc logical_start=0 logical_end=571 capped_end=560 physical_query_tokens=560
2026-08-21T13:05:26.103219686Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:05:26.376289755Z INFO 08-21 13:05:26 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cdd9b6437e374fd6a68d5876b81ced52 checkpoint_tokens=12800 logical_tokens=13381 physical_query_tokens=581
2026-08-21T13:05:26.376322577Z INFO 08-21 13:05:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cdd9b6437e374fd6a68d5876b81ced52 logical_start=12800 logical_end=13381 capped_end=13120 physical_query_tokens=320
2026-08-21T13:05:29.763316300Z INFO 08-21 13:05:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cdd9b6437e374fd6a68d5876b81ced52 logical_start=13120 logical_end=13381 capped_end=13376 physical_query_tokens=256
2026-08-21T13:05:50.841857124Z WARNING 08-21 13:05:50 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=250 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=119 assistant_tool_msgs=115 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T13:05:50.842100645Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T13:05:51.022169639Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:05:51.155707580Z INFO 08-21 13:05:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-16cdcaf58148408889fbcca61c53b205 logical_start=0 logical_end=4570 capped_end=4560 physical_query_tokens=4560
2026-08-21T13:17:05.211349211Z WARNING 08-21 13:17:05 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=252 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=120 assistant_tool_msgs=116 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T13:17:05.211632996Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T13:17:05.414840740Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:17:05.550497452Z INFO 08-21 13:17:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e43bf282b3c84638bd28429c6f2264c5 logical_start=0 logical_end=7026 capped_end=3072 physical_query_tokens=3072
2026-08-21T13:17:10.590227347Z INFO 08-21 13:17:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e43bf282b3c84638bd28429c6f2264c5 logical_start=3072 logical_end=7026 capped_end=7024 physical_query_tokens=3952
2026-08-21T13:32:44.962529805Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:32:45.254295651Z INFO 08-21 13:32:45 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e1e7d437535b4d5a8745660eac6ba8b1 checkpoint_tokens=13376 logical_tokens=14926 physical_query_tokens=1550
2026-08-21T13:32:45.254338003Z INFO 08-21 13:32:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e1e7d437535b4d5a8745660eac6ba8b1 logical_start=13376 logical_end=14926 capped_end=14912 physical_query_tokens=1536
2026-08-21T13:33:28.662111873Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:33:28.936372897Z INFO 08-21 13:33:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0e8881cfe80047cbafdfb0f86a57a2de checkpoint_tokens=14912 logical_tokens=15858 physical_query_tokens=946
2026-08-21T13:33:28.936410865Z INFO 08-21 13:33:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0e8881cfe80047cbafdfb0f86a57a2de logical_start=14912 logical_end=15858 capped_end=15856 physical_query_tokens=944
2026-08-21T13:33:56.331971088Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T13:33:56.757299265Z INFO 08-21 13:33:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8d8fdb82a52443f980cc3b6525aff2fa logical_start=0 logical_end=8192 capped_end=1216 physical_query_tokens=1216
2026-08-21T13:35:51.156925242Z INFO 08-21 13:35:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8d8fdb82a52443f980cc3b6525aff2fa logical_start=74944 logical_end=78545 capped_end=78528 physical_query_tokens=3584
2026-08-21T14:06:15.182870394Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:06:15.308665471Z INFO 08-21 14:06:15 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a4919a001b1d44478bbd946886a13c1c logical_start=0 logical_end=620 capped_end=608 physical_query_tokens=608
2026-08-21T14:08:31.219777318Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:08:31.501959322Z INFO 08-21 14:08:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-782b40c4dbd34f51b93a5b0729e74809 checkpoint_tokens=14912 logical_tokens=16384 physical_query_tokens=1472
2026-08-21T14:08:31.502002968Z INFO 08-21 14:08:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-782b40c4dbd34f51b93a5b0729e74809 logical_start=14912 logical_end=16384 capped_end=15808 physical_query_tokens=896
2026-08-21T14:08:35.527277547Z INFO 08-21 14:08:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-782b40c4dbd34f51b93a5b0729e74809 logical_start=15808 logical_end=16471 capped_end=16464 physical_query_tokens=656
2026-08-21T14:08:59.275503180Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:08:59.555934022Z INFO 08-21 14:08:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-369549ee6aff4ef19d41dcaf19e348da checkpoint_tokens=15808 logical_tokens=16384 physical_query_tokens=576
2026-08-21T14:09:03.308888062Z INFO 08-21 14:09:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-369549ee6aff4ef19d41dcaf19e348da logical_start=16384 logical_end=16668 capped_end=16448 physical_query_tokens=64
2026-08-21T14:09:05.595196848Z INFO 08-21 14:09:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-369549ee6aff4ef19d41dcaf19e348da logical_start=16448 logical_end=16668 capped_end=16656 physical_query_tokens=208
2026-08-21T14:09:35.703081410Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:09:35.830002394Z INFO 08-21 14:09:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4e11114707e14d178cdf0b9cd9c1f382 logical_start=0 logical_end=365 capped_end=352 physical_query_tokens=352
2026-08-21T14:13:19.625026738Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:13:19.751851894Z INFO 08-21 14:13:19 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-da3751bb4d664c6a9f4df50f6991e8fd logical_start=0 logical_end=347 capped_end=336 physical_query_tokens=336
2026-08-21T14:16:14.649455773Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:16:14.923179157Z INFO 08-21 14:16:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8bb0568830574eb9be6f2551a25bd2a7 checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T14:16:53.943700789Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:16:54.203584979Z INFO 08-21 14:16:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9d7a00898c9d47f0843f1122ebfb4675 checkpoint_tokens=7184 logical_tokens=7197 physical_query_tokens=13
2026-08-21T14:17:02.845017892Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:17:03.102643067Z INFO 08-21 14:17:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91970f99e9084831aaa4d91d8d07b5d4 logical_start=0 logical_end=7307 capped_end=7168 physical_query_tokens=7168
2026-08-21T14:17:10.961827528Z INFO 08-21 14:17:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91970f99e9084831aaa4d91d8d07b5d4 logical_start=7168 logical_end=7307 capped_end=7296 physical_query_tokens=128
2026-08-21T14:17:20.949003577Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:17:21.207829342Z INFO 08-21 14:17:21 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f641a6c7f1f849b586c1582aba569b53 checkpoint_tokens=7296 logical_tokens=7759 physical_query_tokens=463
2026-08-21T14:17:21.207865180Z INFO 08-21 14:17:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f641a6c7f1f849b586c1582aba569b53 logical_start=7296 logical_end=7759 capped_end=7744 physical_query_tokens=448
2026-08-21T14:17:32.520033371Z WARNING 08-21 14:17:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=256 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=122 assistant_tool_msgs=118 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T14:17:32.520288370Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T14:17:32.701196462Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:17:32.959204542Z INFO 08-21 14:17:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4c17003c44ba463991c58e3e156333ff checkpoint_tokens=7744 logical_tokens=8029 physical_query_tokens=285
2026-08-21T14:17:32.959239030Z INFO 08-21 14:17:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4c17003c44ba463991c58e3e156333ff logical_start=7744 logical_end=8029 capped_end=8016 physical_query_tokens=272
2026-08-21T14:17:44.042815420Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:17:44.305504868Z INFO 08-21 14:17:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4681a2e31d144c629945e84467137bce checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T14:17:44.305545024Z INFO 08-21 14:17:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4681a2e31d144c629945e84467137bce logical_start=7168 logical_end=8192 capped_end=7360 physical_query_tokens=192
2026-08-21T14:17:47.164820511Z INFO 08-21 14:17:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4681a2e31d144c629945e84467137bce logical_start=7360 logical_end=9450 capped_end=9440 physical_query_tokens=2080
2026-08-21T14:18:16.741331231Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:18:17.002672990Z INFO 08-21 14:18:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-aa20efe4f9594e3f8f1bbf921124dd78 checkpoint_tokens=7360 logical_tokens=8192 physical_query_tokens=832
2026-08-21T14:18:20.839399096Z INFO 08-21 14:18:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aa20efe4f9594e3f8f1bbf921124dd78 logical_start=8192 logical_end=9787 capped_end=9408 physical_query_tokens=1216
2026-08-21T14:18:25.074601801Z INFO 08-21 14:18:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aa20efe4f9594e3f8f1bbf921124dd78 logical_start=9408 logical_end=9787 capped_end=9776 physical_query_tokens=368
2026-08-21T14:18:46.589383116Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:18:46.850355071Z INFO 08-21 14:18:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3a89983ec0534dbcb9d83269aa584512 checkpoint_tokens=7744 logical_tokens=8192 physical_query_tokens=448
2026-08-21T14:18:46.850394309Z INFO 08-21 14:18:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3a89983ec0534dbcb9d83269aa584512 logical_start=7744 logical_end=8192 capped_end=8000 physical_query_tokens=256
2026-08-21T14:18:49.853912944Z INFO 08-21 14:18:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3a89983ec0534dbcb9d83269aa584512 logical_start=8000 logical_end=8386 capped_end=8384 physical_query_tokens=384
2026-08-21T14:19:00.052206231Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:19:00.311503846Z INFO 08-21 14:19:00 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8a0a3d81107248c0b7bdbf8c181cb839 checkpoint_tokens=8384 logical_tokens=8608 physical_query_tokens=224
2026-08-21T14:19:00.311546831Z INFO 08-21 14:19:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8a0a3d81107248c0b7bdbf8c181cb839 logical_start=8384 logical_end=8608 capped_end=8592 physical_query_tokens=208
2026-08-21T14:19:08.710486720Z WARNING 08-21 14:19:08 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=258 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=123 assistant_tool_msgs=119 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T14:19:08.710708064Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T14:19:08.883184568Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:19:09.143414307Z INFO 08-21 14:19:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-db0bf313a7ad4dc5b6096c973411f737 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T14:19:13.110564053Z INFO 08-21 14:19:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-db0bf313a7ad4dc5b6096c973411f737 logical_start=8192 logical_end=8615 capped_end=8608 physical_query_tokens=416
2026-08-21T14:19:38.098602017Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:19:38.361631354Z INFO 08-21 14:19:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2a83a0dbefdb4d7ba869ed8453d88552 checkpoint_tokens=9408 logical_tokens=10916 physical_query_tokens=1508
2026-08-21T14:19:38.361670560Z INFO 08-21 14:19:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2a83a0dbefdb4d7ba869ed8453d88552 logical_start=9408 logical_end=10916 capped_end=9728 physical_query_tokens=320
2026-08-21T14:19:41.619331266Z INFO 08-21 14:19:41 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2a83a0dbefdb4d7ba869ed8453d88552 logical_start=9728 logical_end=10916 capped_end=10912 physical_query_tokens=1184
2026-08-21T14:19:52.499967282Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:19:52.767106405Z INFO 08-21 14:19:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8a980157b1154cd9b4c75ec95715a5ff checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T14:19:56.735073988Z INFO 08-21 14:19:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8a980157b1154cd9b4c75ec95715a5ff logical_start=8192 logical_end=8831 capped_end=8576 physical_query_tokens=384
2026-08-21T14:19:59.971729933Z INFO 08-21 14:19:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8a980157b1154cd9b4c75ec95715a5ff logical_start=8576 logical_end=8831 capped_end=8816 physical_query_tokens=240
2026-08-21T14:20:11.736677870Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:20:11.861524019Z INFO 08-21 14:20:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-dbeddef4c40d4b669ccba6f8e541b1b1 logical_start=0 logical_end=392 capped_end=384 physical_query_tokens=384
2026-08-21T14:22:57.210841742Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:22:57.335952890Z INFO 08-21 14:22:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e3ae1f5edb7d4929b8dd371a48f873dd checkpoint_tokens=384 logical_tokens=392 physical_query_tokens=8
2026-08-21T14:25:49.634198454Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:28:43.900831869Z INFO 08-21 14:28:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5309475a7d04dd29480489c501662cd logical_start=106496 logical_end=114688 capped_end=110656 physical_query_tokens=4160
2026-08-21T14:29:15.981610902Z INFO 08-21 14:29:15 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5309475a7d04dd29480489c501662cd logical_start=118848 logical_end=125231 capped_end=125216 physical_query_tokens=6368
2026-08-21T14:37:00.998383837Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:37:01.288092064Z INFO 08-21 14:37:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f9c385818a284358924bf6a911325893 checkpoint_tokens=1216 logical_tokens=8192 physical_query_tokens=6976
2026-08-21T14:37:28.650914074Z INFO 08-21 14:37:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f9c385818a284358924bf6a911325893 logical_start=24576 logical_end=31595 capped_end=31584 physical_query_tokens=7008
2026-08-21T14:37:49.313603307Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:37:49.572467656Z INFO 08-21 14:37:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e9a1b0b5d64749e09512a4e7b00fb192 logical_start=0 logical_end=8030 capped_end=7424 physical_query_tokens=7424
2026-08-21T14:37:57.598140602Z INFO 08-21 14:37:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e9a1b0b5d64749e09512a4e7b00fb192 logical_start=7424 logical_end=8030 capped_end=8016 physical_query_tokens=592
2026-08-21T14:38:20.784394574Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:38:21.072561261Z INFO 08-21 14:38:21 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0de995bdbda445fea26ffb6ffacf01bc checkpoint_tokens=1216 logical_tokens=8192 physical_query_tokens=6976
2026-08-21T14:38:59.262664325Z INFO 08-21 14:38:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0de995bdbda445fea26ffb6ffacf01bc logical_start=32768 logical_end=34100 capped_end=34096 physical_query_tokens=1328
2026-08-21T14:39:55.170707086Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:39:55.433917549Z INFO 08-21 14:39:55 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6631aa3a5bf84e1eaeedf78c06b1264a checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T14:39:55.433955360Z INFO 08-21 14:39:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6631aa3a5bf84e1eaeedf78c06b1264a logical_start=7424 logical_end=8192 capped_end=8000 physical_query_tokens=576
2026-08-21T14:39:59.177162081Z INFO 08-21 14:39:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6631aa3a5bf84e1eaeedf78c06b1264a logical_start=8000 logical_end=10219 capped_end=10208 physical_query_tokens=2208
2026-08-21T14:40:19.945830893Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:40:20.206732268Z INFO 08-21 14:40:20 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ca34e09d4c1e41148b80bbec1a11d2ab checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T14:40:23.005429920Z INFO 08-21 14:40:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ca34e09d4c1e41148b80bbec1a11d2ab logical_start=8192 logical_end=10116 capped_end=10112 physical_query_tokens=1920
2026-08-21T14:40:41.997952182Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:40:42.322193058Z INFO 08-21 14:40:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-de49f7e6f4194a0abdf7cf80123e35ff checkpoint_tokens=1216 logical_tokens=8192 physical_query_tokens=6976
2026-08-21T14:41:58.061738923Z INFO 08-21 14:41:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-de49f7e6f4194a0abdf7cf80123e35ff logical_start=57344 logical_end=62737 capped_end=62720 physical_query_tokens=5376
2026-08-21T14:43:23.700813481Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:43:24.024158801Z INFO 08-21 14:43:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2f7547e8ef5349948ea8e3a4f3f6a8b7 checkpoint_tokens=62720 logical_tokens=65536 physical_query_tokens=2816
2026-08-21T14:43:31.688653074Z INFO 08-21 14:43:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f7547e8ef5349948ea8e3a4f3f6a8b7 logical_start=65536 logical_end=65629 capped_end=65616 physical_query_tokens=80
2026-08-21T14:45:36.137800672Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:45:36.402074227Z INFO 08-21 14:45:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5163822fe5354fdb850da54451bbf2a4 checkpoint_tokens=10112 logical_tokens=10728 physical_query_tokens=616
2026-08-21T14:45:36.402117291Z INFO 08-21 14:45:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5163822fe5354fdb850da54451bbf2a4 logical_start=10112 logical_end=10728 capped_end=10176 physical_query_tokens=64
2026-08-21T14:45:38.593334610Z INFO 08-21 14:45:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5163822fe5354fdb850da54451bbf2a4 logical_start=10176 logical_end=10728 capped_end=10720 physical_query_tokens=544
2026-08-21T14:46:04.618532353Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:46:04.875720814Z INFO 08-21 14:46:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ca6f18e6cb044fb89778028fce5247bb logical_start=0 logical_end=7438 capped_end=7424 physical_query_tokens=7424
2026-08-21T14:46:39.848711232Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:46:40.106127592Z INFO 08-21 14:46:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fc5c4e5c61f64e44aad6d0fa97b867c7 checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T14:47:09.938990926Z WARNING 08-21 14:47:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=68 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=56 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T14:47:09.939248175Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T14:47:10.142327942Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:47:10.405980694Z INFO 08-21 14:47:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e007dfc00870494ca98c490e95b869d8 checkpoint_tokens=10176 logical_tokens=11769 physical_query_tokens=1593
2026-08-21T14:47:10.406020135Z INFO 08-21 14:47:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e007dfc00870494ca98c490e95b869d8 logical_start=10176 logical_end=11769 capped_end=10688 physical_query_tokens=512
2026-08-21T14:47:14.111596059Z INFO 08-21 14:47:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e007dfc00870494ca98c490e95b869d8 logical_start=10688 logical_end=11769 capped_end=11760 physical_query_tokens=1072
2026-08-21T14:47:36.334859250Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:47:36.595537078Z INFO 08-21 14:47:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0a070ad798a04b87aa56ab7e9215265f checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T14:47:36.595578309Z INFO 08-21 14:47:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0a070ad798a04b87aa56ab7e9215265f logical_start=7168 logical_end=8192 capped_end=7232 physical_query_tokens=64
2026-08-21T14:47:38.434927457Z INFO 08-21 14:47:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0a070ad798a04b87aa56ab7e9215265f logical_start=7232 logical_end=8405 capped_end=8400 physical_query_tokens=1168
2026-08-21T14:48:04.119853725Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T14:50:06.104973704Z INFO 08-21 14:50:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ff15076725c94ae6af97e299174abb2f logical_start=81920 logical_end=90112 capped_end=89216 physical_query_tokens=7296
2026-08-21T14:51:37.020990937Z INFO 08-21 14:51:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ff15076725c94ae6af97e299174abb2f logical_start=121984 logical_end=127840 capped_end=127824 physical_query_tokens=5840
2026-08-21T15:06:23.073803887Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:06:23.339607213Z INFO 08-21 15:06:23 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1981bd446d194c09bcb6d03c58d117ab checkpoint_tokens=7168 logical_tokens=7530 physical_query_tokens=362
2026-08-21T15:06:23.339646156Z INFO 08-21 15:06:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1981bd446d194c09bcb6d03c58d117ab logical_start=7168 logical_end=7530 capped_end=7232 physical_query_tokens=64
2026-08-21T15:06:25.312774493Z INFO 08-21 15:06:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1981bd446d194c09bcb6d03c58d117ab logical_start=7232 logical_end=7530 capped_end=7520 physical_query_tokens=288
2026-08-21T15:06:35.849633445Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:06:36.107130180Z INFO 08-21 15:06:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-35b7201b0b6544d9b925c6abba3c9fd4 checkpoint_tokens=7232 logical_tokens=7706 physical_query_tokens=474
2026-08-21T15:06:36.107164303Z INFO 08-21 15:06:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-35b7201b0b6544d9b925c6abba3c9fd4 logical_start=7232 logical_end=7706 capped_end=7488 physical_query_tokens=256
2026-08-21T15:06:39.032529626Z INFO 08-21 15:06:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-35b7201b0b6544d9b925c6abba3c9fd4 logical_start=7488 logical_end=7706 capped_end=7696 physical_query_tokens=208
2026-08-21T15:06:46.641800015Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:06:46.904659886Z INFO 08-21 15:06:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7ceab9ce88644689b68e79ee8c871c50 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T15:06:50.804047619Z INFO 08-21 15:06:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7ceab9ce88644689b68e79ee8c871c50 logical_start=8192 logical_end=10844 capped_end=8384 physical_query_tokens=192
2026-08-21T15:06:53.410854498Z INFO 08-21 15:06:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7ceab9ce88644689b68e79ee8c871c50 logical_start=8384 logical_end=10844 capped_end=10832 physical_query_tokens=2448
2026-08-21T15:07:31.973372140Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:07:32.239932495Z INFO 08-21 15:07:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a42f5f0464fd49ceaa4fa825e5079e25 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T15:07:36.009579798Z INFO 08-21 15:07:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a42f5f0464fd49ceaa4fa825e5079e25 logical_start=8192 logical_end=9718 capped_end=9712 physical_query_tokens=1520
2026-08-21T15:08:13.884669543Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:08:14.153675422Z INFO 08-21 15:08:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-eb44d0d03bb9423788a96b529862c69e checkpoint_tokens=10688 logical_tokens=12369 physical_query_tokens=1681
2026-08-21T15:08:14.153720694Z INFO 08-21 15:08:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eb44d0d03bb9423788a96b529862c69e logical_start=10688 logical_end=12369 capped_end=11712 physical_query_tokens=1024
2026-08-21T15:08:18.333163690Z INFO 08-21 15:08:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eb44d0d03bb9423788a96b529862c69e logical_start=11712 logical_end=12369 capped_end=12352 physical_query_tokens=640
2026-08-21T15:08:34.909126248Z WARNING 08-21 15:08:34 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=59 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T15:08:34.909401581Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T15:08:34.934281520Z ERROR 08-21 15:08:34 serving_chat.py:345] Error in applying chat template from request
2026-08-21T15:08:34.934286829Z ERROR 08-21 15:08:34 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T15:08:34.934289184Z ERROR 08-21 15:08:34 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T15:08:34.934291647Z ERROR 08-21 15:08:34 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T15:08:34.934295119Z ERROR 08-21 15:08:34 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T15:08:34.934297530Z ERROR 08-21 15:08:34 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T15:08:34.934299675Z ERROR 08-21 15:08:34 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T15:08:34.934301713Z ERROR 08-21 15:08:34 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T15:08:34.934303896Z ERROR 08-21 15:08:34 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T15:08:34.934306589Z ERROR 08-21 15:08:34 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T15:08:34.934308799Z ERROR 08-21 15:08:34 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T15:08:34.934311171Z ERROR 08-21 15:08:34 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T15:08:34.934313276Z ERROR 08-21 15:08:34 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T15:08:34.934316393Z ERROR 08-21 15:08:34 serving_chat.py:345] raise ValueError(
2026-08-21T15:08:34.934318441Z ERROR 08-21 15:08:34 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T15:08:34.934462401Z WARNING 08-21 15:08:34 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=24 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=6 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T15:08:34.934592631Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T15:08:35.134861650Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:08:35.403342564Z INFO 08-21 15:08:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ddaa6b713b9540efbad19ca39d034440 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T15:08:39.171937613Z INFO 08-21 15:08:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ddaa6b713b9540efbad19ca39d034440 logical_start=8192 logical_end=11114 capped_end=9664 physical_query_tokens=1472
2026-08-21T15:08:43.363927930Z INFO 08-21 15:08:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ddaa6b713b9540efbad19ca39d034440 logical_start=9664 logical_end=11114 capped_end=11104 physical_query_tokens=1440
2026-08-21T15:09:12.849853881Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:09:13.123623691Z INFO 08-21 15:09:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-96927d8abc7d48b1854600a995eae7cc checkpoint_tokens=12352 logical_tokens=14186 physical_query_tokens=1834
2026-08-21T15:09:13.123656464Z INFO 08-21 15:09:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-96927d8abc7d48b1854600a995eae7cc logical_start=12352 logical_end=14186 capped_end=14176 physical_query_tokens=1824
2026-08-21T15:09:35.758738403Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:09:36.097187101Z INFO 08-21 15:09:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9dd6c415df7d4ee3aa8320a255a5b69e checkpoint_tokens=62720 logical_tokens=65536 physical_query_tokens=2816
2026-08-21T15:09:43.762020712Z INFO 08-21 15:09:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9dd6c415df7d4ee3aa8320a255a5b69e logical_start=65536 logical_end=69897 capped_end=69888 physical_query_tokens=4352
2026-08-21T15:11:23.211595131Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:11:23.484839361Z INFO 08-21 15:11:23 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7ef0af25a3374535962a6f709844366e checkpoint_tokens=12352 logical_tokens=15755 physical_query_tokens=3403
2026-08-21T15:11:23.484872789Z INFO 08-21 15:11:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7ef0af25a3374535962a6f709844366e logical_start=12352 logical_end=15755 capped_end=14144 physical_query_tokens=1792
2026-08-21T15:11:28.165546687Z INFO 08-21 15:11:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7ef0af25a3374535962a6f709844366e logical_start=14144 logical_end=15755 capped_end=15744 physical_query_tokens=1600
2026-08-21T15:11:54.691368063Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:11:54.962840056Z INFO 08-21 15:11:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9f231465ecb74f9e84bc2c9d1364b488 checkpoint_tokens=15744 logical_tokens=15885 physical_query_tokens=141
2026-08-21T15:11:54.962879647Z INFO 08-21 15:11:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9f231465ecb74f9e84bc2c9d1364b488 logical_start=15744 logical_end=15885 capped_end=15872 physical_query_tokens=128
2026-08-21T15:12:08.454295523Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:12:08.722282639Z INFO 08-21 15:12:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4f30e9bf574147e88d2192955abc89d9 checkpoint_tokens=9664 logical_tokens=11557 physical_query_tokens=1893
2026-08-21T15:12:08.722318785Z INFO 08-21 15:12:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4f30e9bf574147e88d2192955abc89d9 logical_start=9664 logical_end=11557 capped_end=11072 physical_query_tokens=1408
2026-08-21T15:12:13.172743363Z INFO 08-21 15:12:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4f30e9bf574147e88d2192955abc89d9 logical_start=11072 logical_end=11557 capped_end=11552 physical_query_tokens=480
2026-08-21T15:12:43.026664111Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:12:43.360291730Z INFO 08-21 15:12:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b7ca741b775d40a684e748d3d606d832 checkpoint_tokens=69888 logical_tokens=70311 physical_query_tokens=423
2026-08-21T15:12:43.360337441Z INFO 08-21 15:12:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b7ca741b775d40a684e748d3d606d832 logical_start=69888 logical_end=70311 capped_end=70304 physical_query_tokens=416
2026-08-21T15:13:08.360817875Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:13:08.630343193Z INFO 08-21 15:13:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8eb3e8a94a4e4fc89cffabff003159ef checkpoint_tokens=15872 logical_tokens=16384 physical_query_tokens=512
2026-08-21T15:13:12.212324376Z INFO 08-21 15:13:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8eb3e8a94a4e4fc89cffabff003159ef logical_start=16384 logical_end=16409 capped_end=16400 physical_query_tokens=16
2026-08-21T15:13:31.348702822Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:13:31.617847669Z INFO 08-21 15:13:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2f419f7d34ae44ca9252e8236b6027bc checkpoint_tokens=15872 logical_tokens=16259 physical_query_tokens=387
2026-08-21T15:13:31.617889268Z INFO 08-21 15:13:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f419f7d34ae44ca9252e8236b6027bc logical_start=15872 logical_end=16259 capped_end=16256 physical_query_tokens=384
2026-08-21T15:13:48.215633518Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:13:48.483973017Z INFO 08-21 15:13:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-184b05fb53f34924b98c68be18d8e0aa checkpoint_tokens=16256 logical_tokens=16384 physical_query_tokens=128
2026-08-21T15:13:51.201621351Z INFO 08-21 15:13:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-184b05fb53f34924b98c68be18d8e0aa logical_start=16384 logical_end=16899 capped_end=16896 physical_query_tokens=512
2026-08-21T15:14:27.481216514Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:14:27.746091964Z INFO 08-21 15:14:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-34fd11ca622f4f178f024ae90a66f3f4 checkpoint_tokens=11072 logical_tokens=11829 physical_query_tokens=757
2026-08-21T15:14:27.746135015Z INFO 08-21 15:14:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-34fd11ca622f4f178f024ae90a66f3f4 logical_start=11072 logical_end=11829 capped_end=11520 physical_query_tokens=448
2026-08-21T15:14:31.251053111Z INFO 08-21 15:14:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-34fd11ca622f4f178f024ae90a66f3f4 logical_start=11520 logical_end=11829 capped_end=11824 physical_query_tokens=304
2026-08-21T15:14:56.129158318Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:14:56.394728612Z INFO 08-21 15:14:56 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f9999df2ddc744008ad7f53fffe920da checkpoint_tokens=11520 logical_tokens=12338 physical_query_tokens=818
2026-08-21T15:14:56.394764533Z INFO 08-21 15:14:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f9999df2ddc744008ad7f53fffe920da logical_start=11520 logical_end=12338 capped_end=11776 physical_query_tokens=256
2026-08-21T15:14:59.353297281Z INFO 08-21 15:14:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f9999df2ddc744008ad7f53fffe920da logical_start=11776 logical_end=12338 capped_end=12336 physical_query_tokens=560
2026-08-21T15:15:24.141776062Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:15:24.408434237Z INFO 08-21 15:15:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7084e3adbe5e40b78fefb532439c5044 checkpoint_tokens=11776 logical_tokens=13434 physical_query_tokens=1658
2026-08-21T15:15:24.408474756Z INFO 08-21 15:15:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7084e3adbe5e40b78fefb532439c5044 logical_start=11776 logical_end=13434 capped_end=12288 physical_query_tokens=512
2026-08-21T15:15:28.040453627Z INFO 08-21 15:15:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7084e3adbe5e40b78fefb532439c5044 logical_start=12288 logical_end=13434 capped_end=13424 physical_query_tokens=1136
2026-08-21T15:15:55.992644913Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:15:56.261010424Z INFO 08-21 15:15:56 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b60861b0ea0e4a3dbeaeabecf39e455a checkpoint_tokens=12288 logical_tokens=14844 physical_query_tokens=2556
2026-08-21T15:15:56.261053716Z INFO 08-21 15:15:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b60861b0ea0e4a3dbeaeabecf39e455a logical_start=12288 logical_end=14844 capped_end=13376 physical_query_tokens=1088
2026-08-21T15:16:00.489895377Z INFO 08-21 15:16:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b60861b0ea0e4a3dbeaeabecf39e455a logical_start=13376 logical_end=14844 capped_end=14832 physical_query_tokens=1456
2026-08-21T15:16:29.714958509Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:16:29.976308439Z INFO 08-21 15:16:29 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-27d583902d9a4584b0b1e26ff7dca311 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T15:16:29.976349214Z INFO 08-21 15:16:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-27d583902d9a4584b0b1e26ff7dca311 logical_start=7168 logical_end=8192 capped_end=7296 physical_query_tokens=128
2026-08-21T15:16:32.523278779Z INFO 08-21 15:16:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-27d583902d9a4584b0b1e26ff7dca311 logical_start=7296 logical_end=8563 capped_end=8560 physical_query_tokens=1264
2026-08-21T15:16:41.811334532Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:16:42.069338228Z INFO 08-21 15:16:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6a8734a2098e4920a184e0a731a190db checkpoint_tokens=7296 logical_tokens=8192 physical_query_tokens=896
2026-08-21T15:16:45.965279104Z INFO 08-21 15:16:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6a8734a2098e4920a184e0a731a190db logical_start=8192 logical_end=8220 capped_end=8208 physical_query_tokens=16
2026-08-21T15:17:03.765136613Z WARNING 08-21 15:17:03 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=59 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T15:17:03.765385614Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T15:17:03.971553773Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:17:04.240676841Z INFO 08-21 15:17:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-587d58dca38b48189d5d9ecf8c1e0fb5 checkpoint_tokens=13376 logical_tokens=15361 physical_query_tokens=1985
2026-08-21T15:17:04.240716839Z INFO 08-21 15:17:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-587d58dca38b48189d5d9ecf8c1e0fb5 logical_start=13376 logical_end=15361 capped_end=14784 physical_query_tokens=1408
2026-08-21T15:17:08.775172875Z INFO 08-21 15:17:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-587d58dca38b48189d5d9ecf8c1e0fb5 logical_start=14784 logical_end=15361 capped_end=15344 physical_query_tokens=560
2026-08-21T15:17:32.717056882Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:17:32.977197563Z INFO 08-21 15:17:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fbf9103b5ef24f18a4f9941e6ed97c7d checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T15:17:32.977236205Z INFO 08-21 15:17:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fbf9103b5ef24f18a4f9941e6ed97c7d logical_start=7424 logical_end=8192 capped_end=7680 physical_query_tokens=256
2026-08-21T15:17:35.970850191Z INFO 08-21 15:17:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fbf9103b5ef24f18a4f9941e6ed97c7d logical_start=7680 logical_end=8705 capped_end=8688 physical_query_tokens=1008
2026-08-21T15:17:53.250190311Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:17:53.514635929Z INFO 08-21 15:17:53 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-405212daed1c4d82a16c33302e5f3001 checkpoint_tokens=7296 logical_tokens=8192 physical_query_tokens=896
2026-08-21T15:17:57.410095348Z INFO 08-21 15:17:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-405212daed1c4d82a16c33302e5f3001 logical_start=8192 logical_end=8770 capped_end=8512 physical_query_tokens=320
2026-08-21T15:18:00.684089277Z INFO 08-21 15:18:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-405212daed1c4d82a16c33302e5f3001 logical_start=8512 logical_end=8770 capped_end=8768 physical_query_tokens=256
2026-08-21T15:18:06.890999117Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:18:07.154228892Z INFO 08-21 15:18:07 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-64d684e37fcd49b0bf4cb68b74acc48f checkpoint_tokens=7680 logical_tokens=8192 physical_query_tokens=512
2026-08-21T15:18:10.781745119Z INFO 08-21 15:18:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-64d684e37fcd49b0bf4cb68b74acc48f logical_start=8192 logical_end=9005 capped_end=8704 physical_query_tokens=512
2026-08-21T15:18:14.346942230Z INFO 08-21 15:18:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-64d684e37fcd49b0bf4cb68b74acc48f logical_start=8704 logical_end=9005 capped_end=8992 physical_query_tokens=288
2026-08-21T15:18:25.711743127Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:18:25.976568141Z INFO 08-21 15:18:25 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-00aa897df82148ebb70dd3bdf66e2384 checkpoint_tokens=8704 logical_tokens=9181 physical_query_tokens=477
2026-08-21T15:18:25.976608215Z INFO 08-21 15:18:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-00aa897df82148ebb70dd3bdf66e2384 logical_start=8704 logical_end=9181 capped_end=8960 physical_query_tokens=256
2026-08-21T15:18:29.031574686Z INFO 08-21 15:18:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-00aa897df82148ebb70dd3bdf66e2384 logical_start=8960 logical_end=9181 capped_end=9168 physical_query_tokens=208
2026-08-21T15:18:38.492039540Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:18:38.755075114Z INFO 08-21 15:18:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5797e537173c45e1b7c8c91676e76fd1 checkpoint_tokens=8768 logical_tokens=9032 physical_query_tokens=264
2026-08-21T15:18:38.755116227Z INFO 08-21 15:18:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5797e537173c45e1b7c8c91676e76fd1 logical_start=8768 logical_end=9032 capped_end=9024 physical_query_tokens=256
2026-08-21T15:18:47.584104229Z WARNING 08-21 15:18:47 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=10 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=59 tool_msgs=4 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T15:18:47.584297262Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T15:18:47.753727438Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:18:48.017164484Z INFO 08-21 15:18:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-aea1a76062584243b9ef0ea125624281 checkpoint_tokens=8960 logical_tokens=9840 physical_query_tokens=880
2026-08-21T15:18:48.017204159Z INFO 08-21 15:18:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aea1a76062584243b9ef0ea125624281 logical_start=8960 logical_end=9840 capped_end=9152 physical_query_tokens=192
2026-08-21T15:18:50.831602769Z INFO 08-21 15:18:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aea1a76062584243b9ef0ea125624281 logical_start=9152 logical_end=9840 capped_end=9824 physical_query_tokens=672
2026-08-21T15:19:04.580340126Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:19:04.844255983Z INFO 08-21 15:19:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-78ebcf3205f74fe7ac0ebeb14c89d319 checkpoint_tokens=9024 logical_tokens=9699 physical_query_tokens=675
2026-08-21T15:19:04.844288806Z INFO 08-21 15:19:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-78ebcf3205f74fe7ac0ebeb14c89d319 logical_start=9024 logical_end=9699 capped_end=9696 physical_query_tokens=672
2026-08-21T15:19:12.248407028Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:19:12.511472575Z INFO 08-21 15:19:12 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2f79c853849740fbbc3b74345797e782 checkpoint_tokens=9024 logical_tokens=9801 physical_query_tokens=777
2026-08-21T15:19:12.511511299Z INFO 08-21 15:19:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f79c853849740fbbc3b74345797e782 logical_start=9024 logical_end=9801 capped_end=9664 physical_query_tokens=640
2026-08-21T15:19:16.259272270Z INFO 08-21 15:19:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f79c853849740fbbc3b74345797e782 logical_start=9664 logical_end=9801 capped_end=9792 physical_query_tokens=128
2026-08-21T15:19:23.214102357Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:19:23.477059509Z INFO 08-21 15:19:23 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5fab716e6e8a4b1d8f7d8df04187e58c checkpoint_tokens=9792 logical_tokens=9902 physical_query_tokens=110
2026-08-21T15:19:23.477099012Z INFO 08-21 15:19:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5fab716e6e8a4b1d8f7d8df04187e58c logical_start=9792 logical_end=9902 capped_end=9888 physical_query_tokens=96
2026-08-21T15:19:30.344314012Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:19:30.605251606Z INFO 08-21 15:19:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-60c7aaeeae234a638a3f1c5bafd9cd4f checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T15:19:52.617576038Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:19:52.882679837Z INFO 08-21 15:19:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e98e5a5fd02e46c4a0e2771aab41124b checkpoint_tokens=9152 logical_tokens=10399 physical_query_tokens=1247
2026-08-21T15:19:52.882723311Z INFO 08-21 15:19:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e98e5a5fd02e46c4a0e2771aab41124b logical_start=9152 logical_end=10399 capped_end=9792 physical_query_tokens=640
2026-08-21T15:19:56.587483548Z INFO 08-21 15:19:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e98e5a5fd02e46c4a0e2771aab41124b logical_start=9792 logical_end=10399 capped_end=10384 physical_query_tokens=592
2026-08-21T15:20:10.381629228Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:20:10.647354593Z INFO 08-21 15:20:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-225e3d77ffd0475ab2ac15bd7f4770ad checkpoint_tokens=9792 logical_tokens=10762 physical_query_tokens=970
2026-08-21T15:20:10.647395443Z INFO 08-21 15:20:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-225e3d77ffd0475ab2ac15bd7f4770ad logical_start=9792 logical_end=10762 capped_end=10368 physical_query_tokens=576
2026-08-21T15:20:14.287602180Z INFO 08-21 15:20:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-225e3d77ffd0475ab2ac15bd7f4770ad logical_start=10368 logical_end=10762 capped_end=10752 physical_query_tokens=384
2026-08-21T15:20:25.191959978Z WARNING 08-21 15:20:25 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=unset images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T15:20:25.192131410Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T15:20:25.364395991Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:20:25.624942427Z INFO 08-21 15:20:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8014825c70c34b2f89881f97b2244e90 logical_start=0 logical_end=7626 capped_end=7232 physical_query_tokens=7232
2026-08-21T15:20:33.528820276Z INFO 08-21 15:20:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8014825c70c34b2f89881f97b2244e90 logical_start=7232 logical_end=7626 capped_end=7616 physical_query_tokens=384
2026-08-21T15:20:53.591478519Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:21:02.398772670Z INFO 08-21 15:21:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9a9f132bb4b940b689caa3c707e33587 logical_start=8192 logical_end=16384 capped_end=13312 physical_query_tokens=5120
2026-08-21T15:21:19.772739256Z INFO 08-21 15:21:19 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9a9f132bb4b940b689caa3c707e33587 logical_start=21504 logical_end=24820 capped_end=24816 physical_query_tokens=3312
2026-08-21T15:21:29.959481585Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:21:30.223653326Z INFO 08-21 15:21:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-587c2d628f4c4825a57355320457b3f6 checkpoint_tokens=7616 logical_tokens=8192 physical_query_tokens=576
2026-08-21T15:21:33.750473560Z INFO 08-21 15:21:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-587c2d628f4c4825a57355320457b3f6 logical_start=8192 logical_end=10073 capped_end=10064 physical_query_tokens=1872
2026-08-21T15:22:17.651329267Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:22:17.775968058Z INFO 08-21 15:22:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2c309644f43147139297bcf1b4854225 logical_start=0 logical_end=126 capped_end=112 physical_query_tokens=112
2026-08-21T15:24:25.226488451Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:24:25.352698749Z INFO 08-21 15:24:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-98c5a473a99a4cfbbad40363de84734f logical_start=0 logical_end=122 capped_end=112 physical_query_tokens=112
2026-08-21T15:27:52.820681627Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:27:53.230155679Z INFO 08-21 15:27:53 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a5c649d0b23b499c8cd65ac0d15573a1 checkpoint_tokens=69888 logical_tokens=73728 physical_query_tokens=3840
2026-08-21T15:28:02.601634231Z INFO 08-21 15:28:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a5c649d0b23b499c8cd65ac0d15573a1 logical_start=73728 logical_end=81920 capped_end=78528 physical_query_tokens=4800
2026-08-21T15:28:30.255017536Z INFO 08-21 15:28:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a5c649d0b23b499c8cd65ac0d15573a1 logical_start=86720 logical_end=93943 capped_end=93936 physical_query_tokens=7216
2026-08-21T15:35:43.424023011Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:35:43.693113858Z INFO 08-21 15:35:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f1bf5a6244874cd3bd42744f017b4a59 checkpoint_tokens=10752 logical_tokens=11589 physical_query_tokens=837
2026-08-21T15:35:43.693153855Z INFO 08-21 15:35:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f1bf5a6244874cd3bd42744f017b4a59 logical_start=10752 logical_end=11589 capped_end=11584 physical_query_tokens=832
2026-08-21T15:36:12.884063840Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:36:13.011452571Z INFO 08-21 15:36:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-347763e67f2747c7b4a2e1f26e8f48f6 logical_start=0 logical_end=310 capped_end=304 physical_query_tokens=304
2026-08-21T15:40:08.762066151Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:40:09.313073714Z INFO 08-21 15:40:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-48e2681d45024d0187140f1da68ac1cb checkpoint_tokens=13312 logical_tokens=16384 physical_query_tokens=3072
2026-08-21T15:42:51.268406200Z INFO 08-21 15:42:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-48e2681d45024d0187140f1da68ac1cb logical_start=106496 logical_end=114688 capped_end=110720 physical_query_tokens=4224
2026-08-21T15:43:44.024490660Z INFO 08-21 15:43:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-48e2681d45024d0187140f1da68ac1cb logical_start=127104 logical_end=134404 capped_end=134400 physical_query_tokens=7296
2026-08-21T15:52:13.994274910Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:52:14.285428106Z INFO 08-21 15:52:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1b21ec72d72245bcbd52aaf2028b6595 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T15:52:18.194675930Z INFO 08-21 15:52:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1b21ec72d72245bcbd52aaf2028b6595 logical_start=8192 logical_end=11572 capped_end=11568 physical_query_tokens=3376
2026-08-21T15:52:36.212277465Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:52:36.472533160Z INFO 08-21 15:52:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fb67c0a6532a45bcb8116b735daaf933 checkpoint_tokens=7168 logical_tokens=7319 physical_query_tokens=151
2026-08-21T15:52:36.472577976Z INFO 08-21 15:52:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fb67c0a6532a45bcb8116b735daaf933 logical_start=7168 logical_end=7319 capped_end=7312 physical_query_tokens=144
2026-08-21T15:52:45.948347836Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:52:46.212508778Z INFO 08-21 15:52:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cac514f083d54ad3863e87db391eb1ca checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T15:52:50.114331585Z INFO 08-21 15:52:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cac514f083d54ad3863e87db391eb1ca logical_start=8192 logical_end=11674 capped_end=11520 physical_query_tokens=3328
2026-08-21T15:52:55.876610027Z INFO 08-21 15:52:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cac514f083d54ad3863e87db391eb1ca logical_start=11520 logical_end=11674 capped_end=11664 physical_query_tokens=144
2026-08-21T15:53:06.575016935Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:53:06.839251295Z INFO 08-21 15:53:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7481d10dc9d843a0b52f68ed4926d48f checkpoint_tokens=11520 logical_tokens=11705 physical_query_tokens=185
2026-08-21T15:53:06.839285697Z INFO 08-21 15:53:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7481d10dc9d843a0b52f68ed4926d48f logical_start=11520 logical_end=11705 capped_end=11696 physical_query_tokens=176
2026-08-21T15:53:34.547469519Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:53:34.808550594Z INFO 08-21 15:53:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8c7ff18a74254dff83b627afb17e28a7 checkpoint_tokens=7168 logical_tokens=8093 physical_query_tokens=925
2026-08-21T15:53:34.808588288Z INFO 08-21 15:53:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c7ff18a74254dff83b627afb17e28a7 logical_start=7168 logical_end=8093 capped_end=7296 physical_query_tokens=128
2026-08-21T15:53:37.320948812Z INFO 08-21 15:53:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8c7ff18a74254dff83b627afb17e28a7 logical_start=7296 logical_end=8093 capped_end=8080 physical_query_tokens=784
2026-08-21T15:53:45.480444990Z WARNING 08-21 15:53:45 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=25 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T15:53:45.480620105Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T15:53:45.646589443Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:53:45.909500594Z INFO 08-21 15:53:45 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e9c85396b08f4acfb9f4091086bc8ebd checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T15:53:49.899778132Z INFO 08-21 15:53:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e9c85396b08f4acfb9f4091086bc8ebd logical_start=8192 logical_end=8382 capped_end=8368 physical_query_tokens=176
2026-08-21T15:54:15.803559028Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T15:54:16.311910321Z INFO 08-21 15:54:16 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-aff81a87f0df46e3aa463228efd0e2e3 checkpoint_tokens=110720 logical_tokens=114688 physical_query_tokens=3968
2026-08-21T15:54:16.311962185Z INFO 08-21 15:54:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aff81a87f0df46e3aa463228efd0e2e3 logical_start=110720 logical_end=114688 capped_end=110784 physical_query_tokens=64
2026-08-21T15:55:21.563248932Z INFO 08-21 15:55:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aff81a87f0df46e3aa463228efd0e2e3 logical_start=135360 logical_end=137134 capped_end=137120 physical_query_tokens=1760
2026-08-21T16:10:42.041079037Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:10:42.305745656Z INFO 08-21 16:10:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-08a3a7b1abed46458f0d02d643689a70 checkpoint_tokens=7296 logical_tokens=8192 physical_query_tokens=896
2026-08-21T16:10:42.305783154Z INFO 08-21 16:10:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-08a3a7b1abed46458f0d02d643689a70 logical_start=7296 logical_end=8192 capped_end=8064 physical_query_tokens=768
2026-08-21T16:10:46.064099204Z INFO 08-21 16:10:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-08a3a7b1abed46458f0d02d643689a70 logical_start=8064 logical_end=8363 capped_end=8352 physical_query_tokens=288
2026-08-21T16:10:55.329875739Z WARNING 08-21 16:10:55 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=0 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=unset images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:10:55.330079662Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:10:55.543109222Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:11:04.040368130Z INFO 08-21 16:11:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1c575c3b2a40453baa85b7d4f93d6dd6 logical_start=8192 logical_end=16384 capped_end=15424 physical_query_tokens=7232
2026-08-21T16:11:12.565414884Z INFO 08-21 16:11:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1c575c3b2a40453baa85b7d4f93d6dd6 logical_start=15424 logical_end=19541 capped_end=19536 physical_query_tokens=4112
2026-08-21T16:11:20.901216214Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:11:49.211497755Z INFO 08-21 16:11:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6f158ff4684b459ba704400253f7383d logical_start=24576 logical_end=27365 capped_end=27360 physical_query_tokens=2784
2026-08-21T16:12:26.747851636Z WARNING 08-21 16:12:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=166 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=56 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:12:26.748086486Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:12:26.947859163Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:12:27.211000082Z INFO 08-21 16:12:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f94208896f1842e3a0d19ca4a0862a99 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T16:12:31.200109883Z INFO 08-21 16:12:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f94208896f1842e3a0d19ca4a0862a99 logical_start=8192 logical_end=8747 capped_end=8320 physical_query_tokens=128
2026-08-21T16:12:33.662296901Z INFO 08-21 16:12:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f94208896f1842e3a0d19ca4a0862a99 logical_start=8320 logical_end=8747 capped_end=8736 physical_query_tokens=416
2026-08-21T16:12:40.758240574Z WARNING 08-21 16:12:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:12:40.758490300Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:12:40.953804078Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:12:59.043870820Z INFO 08-21 16:12:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d207f0c679224859869957e40a9bc2e8 logical_start=16384 logical_end=20282 capped_end=20272 physical_query_tokens=3888
2026-08-21T16:13:17.275791805Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:13:45.477178727Z INFO 08-21 16:13:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3cc411bbb6bd46abab62122870a1def5 logical_start=24576 logical_end=27038 capped_end=27024 physical_query_tokens=2448
2026-08-21T16:14:02.310036801Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:14:02.568319810Z INFO 08-21 16:14:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2b18c573565049e881182239dd6234dd logical_start=0 logical_end=7438 capped_end=7424 physical_query_tokens=7424
2026-08-21T16:14:37.487691382Z WARNING 08-21 16:14:37 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=10 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=25 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=reasoning_effort validation_type=extra_forbidden
2026-08-21T16:14:37.487884585Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:14:37.496875760Z WARNING 08-21 16:14:37 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=36 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=22 tool_msgs=10 assistant_tool_msgs=10 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:14:37.497006237Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:14:37.921218384Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:14:38.680062435Z INFO 08-21 16:14:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-14c7a9c033cd4495be192ad6078405aa checkpoint_tokens=13312 logical_tokens=16384 physical_query_tokens=3072
2026-08-21T16:17:20.580732087Z INFO 08-21 16:17:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-14c7a9c033cd4495be192ad6078405aa logical_start=106496 logical_end=114688 capped_end=110656 physical_query_tokens=4160
2026-08-21T16:18:13.227248376Z INFO 08-21 16:18:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-14c7a9c033cd4495be192ad6078405aa logical_start=127040 logical_end=134170 capped_end=134160 physical_query_tokens=7120
2026-08-21T16:19:07.905705490Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:19:08.173457962Z INFO 08-21 16:19:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f17aa5351db9496782205191eb1318c9 checkpoint_tokens=7424 logical_tokens=7865 physical_query_tokens=441
2026-08-21T16:19:08.173494277Z INFO 08-21 16:19:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f17aa5351db9496782205191eb1318c9 logical_start=7424 logical_end=7865 capped_end=7856 physical_query_tokens=432
2026-08-21T16:19:30.865694551Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:19:31.148508097Z INFO 08-21 16:19:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b6744c8a99f24ea8ba84d87275b2a5d9 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T16:19:31.148554037Z INFO 08-21 16:19:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b6744c8a99f24ea8ba84d87275b2a5d9 logical_start=7424 logical_end=8192 capped_end=7808 physical_query_tokens=384
2026-08-21T16:19:34.385552337Z INFO 08-21 16:19:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b6744c8a99f24ea8ba84d87275b2a5d9 logical_start=7808 logical_end=9570 capped_end=9568 physical_query_tokens=1760
2026-08-21T16:20:03.498853787Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:20:03.771796882Z INFO 08-21 16:20:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5037f361ba3a4749a1daa15d05d953d6 checkpoint_tokens=7680 logical_tokens=8192 physical_query_tokens=512
2026-08-21T16:20:03.771837054Z INFO 08-21 16:20:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5037f361ba3a4749a1daa15d05d953d6 logical_start=7680 logical_end=8192 capped_end=8000 physical_query_tokens=320
2026-08-21T16:20:07.090410653Z INFO 08-21 16:20:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5037f361ba3a4749a1daa15d05d953d6 logical_start=8000 logical_end=9201 capped_end=9184 physical_query_tokens=1184
2026-08-21T16:20:24.622773503Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:20:24.892360871Z INFO 08-21 16:20:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7deda37a0a9348dfab11ac3e32eb6084 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T16:20:27.694299790Z INFO 08-21 16:20:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7deda37a0a9348dfab11ac3e32eb6084 logical_start=8192 logical_end=9937 capped_end=9152 physical_query_tokens=960
2026-08-21T16:20:31.618921065Z INFO 08-21 16:20:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7deda37a0a9348dfab11ac3e32eb6084 logical_start=9152 logical_end=9937 capped_end=9920 physical_query_tokens=768
2026-08-21T16:20:57.778132992Z ERROR 08-21 16:20:57 serving_chat.py:345] Error in applying chat template from request
2026-08-21T16:20:57.778141886Z ERROR 08-21 16:20:57 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T16:20:57.778145320Z ERROR 08-21 16:20:57 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T16:20:57.778149251Z ERROR 08-21 16:20:57 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T16:20:57.778152692Z ERROR 08-21 16:20:57 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T16:20:57.778154958Z ERROR 08-21 16:20:57 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T16:20:57.778156891Z ERROR 08-21 16:20:57 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T16:20:57.778158993Z ERROR 08-21 16:20:57 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T16:20:57.778160975Z ERROR 08-21 16:20:57 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T16:20:57.778163077Z ERROR 08-21 16:20:57 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T16:20:57.778165107Z ERROR 08-21 16:20:57 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T16:20:57.778167314Z ERROR 08-21 16:20:57 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T16:20:57.778169387Z ERROR 08-21 16:20:57 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T16:20:57.778171481Z ERROR 08-21 16:20:57 serving_chat.py:345] raise ValueError(
2026-08-21T16:20:57.778173360Z ERROR 08-21 16:20:57 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T16:20:57.778361708Z WARNING 08-21 16:20:57 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=24 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=6 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T16:20:57.778533344Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:20:57.946460011Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:20:58.204444750Z INFO 08-21 16:20:58 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b8deeec80b954cf6ab58c79e25cdc906 checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T16:21:26.434085292Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:21:54.680158769Z INFO 08-21 16:21:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1288a7e0dd3045d6843643436ced6d0d logical_start=24576 logical_end=29749 capped_end=27328 physical_query_tokens=2752
2026-08-21T16:22:00.642938345Z INFO 08-21 16:22:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1288a7e0dd3045d6843643436ced6d0d logical_start=27328 logical_end=29749 capped_end=29744 physical_query_tokens=2416
2026-08-21T16:24:27.088390291Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:24:27.349527754Z INFO 08-21 16:24:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-29e6b94749654b0bb50e5615e69208de checkpoint_tokens=7168 logical_tokens=7197 physical_query_tokens=29
2026-08-21T16:24:27.349560712Z INFO 08-21 16:24:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-29e6b94749654b0bb50e5615e69208de logical_start=7168 logical_end=7197 capped_end=7184 physical_query_tokens=16
2026-08-21T16:24:46.575909517Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:24:46.729832410Z INFO 08-21 16:24:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e935a266442346baa997ca850effba79 checkpoint_tokens=15424 logical_tokens=16384 physical_query_tokens=960
2026-08-21T16:24:50.824471293Z INFO 08-21 16:24:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e935a266442346baa997ca850effba79 logical_start=16384 logical_end=19894 capped_end=19456 physical_query_tokens=3072
2026-08-21T16:24:56.664553512Z INFO 08-21 16:24:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e935a266442346baa997ca850effba79 logical_start=19456 logical_end=19894 capped_end=19888 physical_query_tokens=432
2026-08-21T16:25:01.561606944Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:25:01.825291933Z INFO 08-21 16:25:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1953c93bded74af68195582ad529c44c checkpoint_tokens=7168 logical_tokens=7294 physical_query_tokens=126
2026-08-21T16:25:01.825331655Z INFO 08-21 16:25:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1953c93bded74af68195582ad529c44c logical_start=7168 logical_end=7294 capped_end=7232 physical_query_tokens=64
2026-08-21T16:25:03.830750606Z INFO 08-21 16:25:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1953c93bded74af68195582ad529c44c logical_start=7232 logical_end=7294 capped_end=7280 physical_query_tokens=48
2026-08-21T16:25:12.856897976Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:25:13.133371676Z INFO 08-21 16:25:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f994f8a5e305452d839b2f7eba3f7f2a logical_start=0 logical_end=8192 capped_end=7232 physical_query_tokens=7232
2026-08-21T16:25:21.046144889Z INFO 08-21 16:25:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f994f8a5e305452d839b2f7eba3f7f2a logical_start=7232 logical_end=8599 capped_end=8592 physical_query_tokens=1360
2026-08-21T16:25:53.348096651Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:25:53.617681675Z INFO 08-21 16:25:53 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9a6d51bdb9ab44368480e2fece604b87 checkpoint_tokens=9920 logical_tokens=10928 physical_query_tokens=1008
2026-08-21T16:25:53.617727068Z INFO 08-21 16:25:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9a6d51bdb9ab44368480e2fece604b87 logical_start=9920 logical_end=10928 capped_end=10912 physical_query_tokens=992
2026-08-21T16:26:06.130929268Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:26:06.283235216Z INFO 08-21 16:26:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-66be66e94b264420b60158766f8d6407 checkpoint_tokens=19456 logical_tokens=20050 physical_query_tokens=594
2026-08-21T16:26:06.283274975Z INFO 08-21 16:26:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-66be66e94b264420b60158766f8d6407 logical_start=19456 logical_end=20050 capped_end=19776 physical_query_tokens=320
2026-08-21T16:26:09.526265108Z INFO 08-21 16:26:09 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-66be66e94b264420b60158766f8d6407 logical_start=19776 logical_end=20050 capped_end=20048 physical_query_tokens=272
2026-08-21T16:26:13.908756462Z ERROR 08-21 16:26:13 serving_chat.py:345] Error in applying chat template from request
2026-08-21T16:26:13.908762066Z ERROR 08-21 16:26:13 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T16:26:13.908764415Z ERROR 08-21 16:26:13 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T16:26:13.908766755Z ERROR 08-21 16:26:13 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T16:26:13.908768748Z ERROR 08-21 16:26:13 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T16:26:13.908770930Z ERROR 08-21 16:26:13 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T16:26:13.908772869Z ERROR 08-21 16:26:13 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T16:26:13.908774942Z ERROR 08-21 16:26:13 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T16:26:13.908776820Z ERROR 08-21 16:26:13 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T16:26:13.908786270Z ERROR 08-21 16:26:13 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T16:26:13.908788482Z ERROR 08-21 16:26:13 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T16:26:13.908790624Z ERROR 08-21 16:26:13 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T16:26:13.908792647Z ERROR 08-21 16:26:13 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T16:26:13.908794693Z ERROR 08-21 16:26:13 serving_chat.py:345] raise ValueError(
2026-08-21T16:26:13.908796614Z ERROR 08-21 16:26:13 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T16:26:13.908954416Z WARNING 08-21 16:26:13 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=28 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=7 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T16:26:13.909121700Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:26:14.085281877Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:26:14.351546602Z INFO 08-21 16:26:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-087a0db8e892453094bf58a82d174ac3 checkpoint_tokens=9920 logical_tokens=11163 physical_query_tokens=1243
2026-08-21T16:26:14.351587253Z INFO 08-21 16:26:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-087a0db8e892453094bf58a82d174ac3 logical_start=9920 logical_end=11163 capped_end=10880 physical_query_tokens=960
2026-08-21T16:26:18.427629872Z INFO 08-21 16:26:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-087a0db8e892453094bf58a82d174ac3 logical_start=10880 logical_end=11163 capped_end=11152 physical_query_tokens=272
2026-08-21T16:26:36.433612556Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:26:36.698214746Z INFO 08-21 16:26:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-28a1f61e660f4f8d847897cdd3e1a46f checkpoint_tokens=10880 logical_tokens=11354 physical_query_tokens=474
2026-08-21T16:26:36.698243504Z INFO 08-21 16:26:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-28a1f61e660f4f8d847897cdd3e1a46f logical_start=10880 logical_end=11354 capped_end=11136 physical_query_tokens=256
2026-08-21T16:26:39.890835723Z INFO 08-21 16:26:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-28a1f61e660f4f8d847897cdd3e1a46f logical_start=11136 logical_end=11354 capped_end=11344 physical_query_tokens=208
2026-08-21T16:27:09.037033222Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:27:09.305682937Z INFO 08-21 16:27:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-884a978068db4926b49ab17a6d14f7fc checkpoint_tokens=7808 logical_tokens=8192 physical_query_tokens=384
2026-08-21T16:27:12.480930994Z INFO 08-21 16:27:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-884a978068db4926b49ab17a6d14f7fc logical_start=8192 logical_end=10488 capped_end=9536 physical_query_tokens=1344
2026-08-21T16:27:16.779809566Z INFO 08-21 16:27:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-884a978068db4926b49ab17a6d14f7fc logical_start=9536 logical_end=10488 capped_end=10480 physical_query_tokens=944
2026-08-21T16:27:35.323515201Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:27:35.596230822Z INFO 08-21 16:27:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-36ce7de6ef0447d2b1669a7ac558b554 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T16:27:39.510376311Z INFO 08-21 16:27:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-36ce7de6ef0447d2b1669a7ac558b554 logical_start=8192 logical_end=10895 capped_end=8576 physical_query_tokens=384
2026-08-21T16:27:42.508961950Z INFO 08-21 16:27:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-36ce7de6ef0447d2b1669a7ac558b554 logical_start=8576 logical_end=10895 capped_end=10880 physical_query_tokens=2304
2026-08-21T16:28:10.802863397Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:28:11.068438964Z INFO 08-21 16:28:11 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-79d4a5f6325944dc8be9edcff3efaf4d checkpoint_tokens=11136 logical_tokens=11738 physical_query_tokens=602
2026-08-21T16:28:11.068473609Z INFO 08-21 16:28:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-79d4a5f6325944dc8be9edcff3efaf4d logical_start=11136 logical_end=11738 capped_end=11328 physical_query_tokens=192
2026-08-21T16:28:14.025322007Z INFO 08-21 16:28:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-79d4a5f6325944dc8be9edcff3efaf4d logical_start=11328 logical_end=11738 capped_end=11728 physical_query_tokens=400
2026-08-21T16:28:39.152329291Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:28:39.416662976Z INFO 08-21 16:28:39 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-38833eb2c67743cd8d959c5c4eaba5d3 checkpoint_tokens=9536 logical_tokens=10885 physical_query_tokens=1349
2026-08-21T16:28:39.416698400Z INFO 08-21 16:28:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-38833eb2c67743cd8d959c5c4eaba5d3 logical_start=9536 logical_end=10885 capped_end=10432 physical_query_tokens=896
2026-08-21T16:28:43.392105746Z INFO 08-21 16:28:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-38833eb2c67743cd8d959c5c4eaba5d3 logical_start=10432 logical_end=10885 capped_end=10880 physical_query_tokens=448
2026-08-21T16:29:13.378057165Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:29:13.644406794Z INFO 08-21 16:29:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2846b9e3e2034041bf224e6db07ff498 checkpoint_tokens=10880 logical_tokens=11236 physical_query_tokens=356
2026-08-21T16:29:13.644447274Z INFO 08-21 16:29:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2846b9e3e2034041bf224e6db07ff498 logical_start=10880 logical_end=11236 capped_end=11232 physical_query_tokens=352
2026-08-21T16:29:32.154267248Z ERROR 08-21 16:29:32 serving_chat.py:345] Error in applying chat template from request
2026-08-21T16:29:32.154285868Z ERROR 08-21 16:29:32 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T16:29:32.154288967Z ERROR 08-21 16:29:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T16:29:32.154300639Z ERROR 08-21 16:29:32 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T16:29:32.154304126Z ERROR 08-21 16:29:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T16:29:32.154306983Z ERROR 08-21 16:29:32 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T16:29:32.154308976Z ERROR 08-21 16:29:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T16:29:32.154311010Z ERROR 08-21 16:29:32 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T16:29:32.154313146Z ERROR 08-21 16:29:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T16:29:32.154315476Z ERROR 08-21 16:29:32 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T16:29:32.154318159Z ERROR 08-21 16:29:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T16:29:32.154320268Z ERROR 08-21 16:29:32 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T16:29:32.154322403Z ERROR 08-21 16:29:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T16:29:32.154324721Z ERROR 08-21 16:29:32 serving_chat.py:345] raise ValueError(
2026-08-21T16:29:32.154326861Z ERROR 08-21 16:29:32 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T16:29:32.154451430Z WARNING 08-21 16:29:32 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=30 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=29 tool_msgs=7 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=3 image_data=3 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T16:29:32.154611417Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:29:32.175933316Z WARNING 08-21 16:29:32 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=218 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=56 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:29:32.176070163Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:29:32.351758439Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:29:32.617120715Z INFO 08-21 16:29:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0c339822da6640088e2523ac044949a4 checkpoint_tokens=10880 logical_tokens=11582 physical_query_tokens=702
2026-08-21T16:29:32.617161812Z INFO 08-21 16:29:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0c339822da6640088e2523ac044949a4 logical_start=10880 logical_end=11582 capped_end=11200 physical_query_tokens=320
2026-08-21T16:29:35.938005935Z INFO 08-21 16:29:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0c339822da6640088e2523ac044949a4 logical_start=11200 logical_end=11582 capped_end=11568 physical_query_tokens=368
2026-08-21T16:29:58.938920104Z WARNING 08-21 16:29:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=202 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=56 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:29:58.939142407Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:29:59.130078348Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:29:59.398220492Z INFO 08-21 16:29:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-19b6e1ea943c44b0b3aba11b7e5236b4 checkpoint_tokens=11200 logical_tokens=13139 physical_query_tokens=1939
2026-08-21T16:29:59.398254781Z INFO 08-21 16:29:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-19b6e1ea943c44b0b3aba11b7e5236b4 logical_start=11200 logical_end=13139 capped_end=11520 physical_query_tokens=320
2026-08-21T16:30:02.636270962Z INFO 08-21 16:30:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-19b6e1ea943c44b0b3aba11b7e5236b4 logical_start=11520 logical_end=13139 capped_end=13136 physical_query_tokens=1616
2026-08-21T16:30:33.536216043Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:30:33.829616773Z INFO 08-21 16:30:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7a1aa0a0dd384daba5a6049275a6d4e4 checkpoint_tokens=27328 logical_tokens=30912 physical_query_tokens=3584
2026-08-21T16:30:33.829651158Z INFO 08-21 16:30:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7a1aa0a0dd384daba5a6049275a6d4e4 logical_start=27328 logical_end=30912 capped_end=29696 physical_query_tokens=2368
2026-08-21T16:30:39.589703961Z INFO 08-21 16:30:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7a1aa0a0dd384daba5a6049275a6d4e4 logical_start=29696 logical_end=30912 capped_end=30896 physical_query_tokens=1200
2026-08-21T16:30:51.311975743Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:30:51.579325420Z INFO 08-21 16:30:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c3144dba564b454582fcdd853ebed99e checkpoint_tokens=11520 logical_tokens=13720 physical_query_tokens=2200
2026-08-21T16:30:51.579364715Z INFO 08-21 16:30:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c3144dba564b454582fcdd853ebed99e logical_start=11520 logical_end=13720 capped_end=13120 physical_query_tokens=1600
2026-08-21T16:30:56.130659922Z INFO 08-21 16:30:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c3144dba564b454582fcdd853ebed99e logical_start=13120 logical_end=13720 capped_end=13712 physical_query_tokens=592
2026-08-21T16:31:23.140748253Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:31:23.275542193Z INFO 08-21 16:31:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-98736909c7d24efca43fba6f4589c119 logical_start=0 logical_end=790 capped_end=784 physical_query_tokens=784
2026-08-21T16:35:54.792088096Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:35:54.917767643Z INFO 08-21 16:35:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-12325f7efea94bfcbe1d46992d07a9e3 logical_start=0 logical_end=251 capped_end=64 physical_query_tokens=64
2026-08-21T16:35:56.708868961Z INFO 08-21 16:35:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-12325f7efea94bfcbe1d46992d07a9e3 logical_start=64 logical_end=251 capped_end=240 physical_query_tokens=176
2026-08-21T16:38:34.175505076Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:38:34.447869355Z INFO 08-21 16:38:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-17649ff4266c45639afbd2d7116145fc logical_start=0 logical_end=7433 capped_end=7424 physical_query_tokens=7424
2026-08-21T16:39:11.633456896Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:39:11.926914727Z INFO 08-21 16:39:11 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d713c434e0994647b48ace1a827bf81d checkpoint_tokens=29696 logical_tokens=32060 physical_query_tokens=2364
2026-08-21T16:39:11.926954042Z INFO 08-21 16:39:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d713c434e0994647b48ace1a827bf81d logical_start=29696 logical_end=32060 capped_end=30912 physical_query_tokens=1216
2026-08-21T16:39:16.739083090Z INFO 08-21 16:39:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d713c434e0994647b48ace1a827bf81d logical_start=30912 logical_end=32060 capped_end=32048 physical_query_tokens=1136
2026-08-21T16:39:27.572364945Z WARNING 08-21 16:39:27 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=202 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=56 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:39:27.572600240Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:39:27.738050180Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:39:27.997327286Z INFO 08-21 16:39:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5ce585b9c37044c389fb2e50337decfc checkpoint_tokens=7232 logical_tokens=7307 physical_query_tokens=75
2026-08-21T16:39:27.997371549Z INFO 08-21 16:39:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5ce585b9c37044c389fb2e50337decfc logical_start=7232 logical_end=7307 capped_end=7296 physical_query_tokens=64
2026-08-21T16:39:40.197331250Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:39:40.456108468Z INFO 08-21 16:39:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7ea0774bf571473d909d1fd7a80aa649 checkpoint_tokens=7296 logical_tokens=7414 physical_query_tokens=118
2026-08-21T16:39:40.456153509Z INFO 08-21 16:39:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7ea0774bf571473d909d1fd7a80aa649 logical_start=7296 logical_end=7414 capped_end=7408 physical_query_tokens=112
2026-08-21T16:39:46.356424156Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:39:46.615818084Z INFO 08-21 16:39:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6cfd0992352545119e030350b52449bc checkpoint_tokens=7296 logical_tokens=7515 physical_query_tokens=219
2026-08-21T16:39:46.615854584Z INFO 08-21 16:39:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6cfd0992352545119e030350b52449bc logical_start=7296 logical_end=7515 capped_end=7360 physical_query_tokens=64
2026-08-21T16:39:48.695084881Z INFO 08-21 16:39:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6cfd0992352545119e030350b52449bc logical_start=7360 logical_end=7515 capped_end=7504 physical_query_tokens=144
2026-08-21T16:39:56.092250945Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:39:56.218774477Z INFO 08-21 16:39:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4d7cd4289c624a0491628527c188a129 logical_start=0 logical_end=388 capped_end=384 physical_query_tokens=384
2026-08-21T16:44:02.247367752Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:44:02.518309685Z INFO 08-21 16:44:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-76e86db285874d89931d6312f41c6490 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T16:44:05.432685076Z INFO 08-21 16:44:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-76e86db285874d89931d6312f41c6490 logical_start=8192 logical_end=8705 capped_end=8688 physical_query_tokens=496
2026-08-21T16:44:28.243665229Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:44:28.504137540Z INFO 08-21 16:44:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-43d4ffbbe9e74edcbf1132551a815f6a checkpoint_tokens=7360 logical_tokens=8055 physical_query_tokens=695
2026-08-21T16:44:28.504174009Z INFO 08-21 16:44:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-43d4ffbbe9e74edcbf1132551a815f6a logical_start=7360 logical_end=8055 capped_end=7488 physical_query_tokens=128
2026-08-21T16:44:31.102874815Z INFO 08-21 16:44:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-43d4ffbbe9e74edcbf1132551a815f6a logical_start=7488 logical_end=8055 capped_end=8048 physical_query_tokens=560
2026-08-21T16:44:37.829950671Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:44:38.090345585Z INFO 08-21 16:44:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-32dfd3c8e3b340269fb8b0986610aa16 checkpoint_tokens=7488 logical_tokens=8192 physical_query_tokens=704
2026-08-21T16:44:38.090384288Z INFO 08-21 16:44:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-32dfd3c8e3b340269fb8b0986610aa16 logical_start=7488 logical_end=8192 capped_end=8000 physical_query_tokens=512
2026-08-21T16:44:41.560607725Z INFO 08-21 16:44:41 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-32dfd3c8e3b340269fb8b0986610aa16 logical_start=8000 logical_end=8507 capped_end=8496 physical_query_tokens=496
2026-08-21T16:44:48.498974330Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:44:48.761372130Z INFO 08-21 16:44:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-272c667e09a848439ff2380b5b0b0696 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T16:44:51.669741635Z INFO 08-21 16:44:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-272c667e09a848439ff2380b5b0b0696 logical_start=8192 logical_end=9334 capped_end=8704 physical_query_tokens=512
2026-08-21T16:44:55.254837891Z INFO 08-21 16:44:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-272c667e09a848439ff2380b5b0b0696 logical_start=8704 logical_end=9334 capped_end=9328 physical_query_tokens=624
2026-08-21T16:45:04.814104960Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:45:05.074775234Z INFO 08-21 16:45:05 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9d3eda82338b45e0a6313bf3668b6f1a checkpoint_tokens=8704 logical_tokens=9221 physical_query_tokens=517
2026-08-21T16:45:05.074812785Z INFO 08-21 16:45:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9d3eda82338b45e0a6313bf3668b6f1a logical_start=8704 logical_end=9221 capped_end=9216 physical_query_tokens=512
2026-08-21T16:45:15.609737717Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:45:15.903241625Z INFO 08-21 16:45:15 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-21622627ffc64330b42ee6fdfcda2c22 checkpoint_tokens=30912 logical_tokens=32768 physical_query_tokens=1856
2026-08-21T16:45:15.903282504Z INFO 08-21 16:45:15 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-21622627ffc64330b42ee6fdfcda2c22 logical_start=30912 logical_end=32768 capped_end=32000 physical_query_tokens=1088
2026-08-21T16:45:20.699664957Z INFO 08-21 16:45:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-21622627ffc64330b42ee6fdfcda2c22 logical_start=32000 logical_end=33492 capped_end=33488 physical_query_tokens=1488
2026-08-21T16:45:34.676878887Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:45:34.967516219Z INFO 08-21 16:45:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-00d855ed5fc34b24966d934e2c9f1e8e checkpoint_tokens=32000 logical_tokens=32768 physical_query_tokens=768
2026-08-21T16:45:39.434828642Z INFO 08-21 16:45:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-00d855ed5fc34b24966d934e2c9f1e8e logical_start=32768 logical_end=33606 capped_end=33472 physical_query_tokens=704
2026-08-21T16:45:43.850177063Z INFO 08-21 16:45:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-00d855ed5fc34b24966d934e2c9f1e8e logical_start=33472 logical_end=33606 capped_end=33600 physical_query_tokens=128
2026-08-21T16:45:55.581244618Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:45:55.874184603Z INFO 08-21 16:45:55 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c336f49b3a08440799c43e501ade34f0 checkpoint_tokens=33600 logical_tokens=33834 physical_query_tokens=234
2026-08-21T16:45:55.874231353Z INFO 08-21 16:45:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c336f49b3a08440799c43e501ade34f0 logical_start=33600 logical_end=33834 capped_end=33824 physical_query_tokens=224
2026-08-21T16:46:06.459967921Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:46:06.726563449Z INFO 08-21 16:46:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b2a58198fc564f1a93cad872080b6329 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T16:46:10.732191269Z INFO 08-21 16:46:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b2a58198fc564f1a93cad872080b6329 logical_start=8192 logical_end=9252 capped_end=9248 physical_query_tokens=1056
2026-08-21T16:46:34.894884691Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:47:18.907192092Z INFO 08-21 16:47:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5cbf64679344427b48460f63c88dae8 logical_start=32768 logical_end=34716 capped_end=34704 physical_query_tokens=1936
2026-08-21T16:49:16.620630013Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:49:16.883662287Z INFO 08-21 16:49:16 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b30b2fb1149c44a7ab1cc7e991ceb6fc checkpoint_tokens=8000 logical_tokens=8017 physical_query_tokens=17
2026-08-21T16:49:30.610949548Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:49:30.870368454Z INFO 08-21 16:49:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-654ba73e05ca4c2fb3dff2d93f4aa057 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T16:49:34.792434975Z INFO 08-21 16:49:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-654ba73e05ca4c2fb3dff2d93f4aa057 logical_start=8192 logical_end=8435 capped_end=8432 physical_query_tokens=240
2026-08-21T16:50:03.657361328Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:50:03.936914093Z INFO 08-21 16:50:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-048755be295441068741fa22be271960 logical_start=0 logical_end=1471 capped_end=1456 physical_query_tokens=1456
2026-08-21T16:51:21.189286373Z WARNING 08-21 16:51:21 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=109 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=38 tool_msgs=45 assistant_tool_msgs=22 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:51:21.189576889Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:51:21.463313177Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:52:01.613550645Z INFO 08-21 16:52:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-87f2a3a227ff4663a204519c73dcd796 logical_start=32768 logical_end=35317 capped_end=34688 physical_query_tokens=1920
2026-08-21T16:53:20.073880079Z INFO 08-21 16:53:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-87f2a3a227ff4663a204519c73dcd796 logical_start=34688 logical_end=35317 capped_end=35312 physical_query_tokens=624
2026-08-21T16:54:05.989976503Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:54:06.325536322Z INFO 08-21 16:54:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c722d50bbfe3401899c8889e1634545b checkpoint_tokens=34688 logical_tokens=35129 physical_query_tokens=441
2026-08-21T16:54:06.325585802Z INFO 08-21 16:54:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c722d50bbfe3401899c8889e1634545b logical_start=34688 logical_end=35129 capped_end=35120 physical_query_tokens=432
2026-08-21T16:54:18.310025522Z WARNING 08-21 16:54:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=58 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:54:18.310250540Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:54:18.330778977Z WARNING 08-21 16:54:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=36 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=14 assistant_tool_msgs=14 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:54:18.330919593Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:54:18.499515521Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:54:19.555401524Z INFO 08-21 16:54:19 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5f15b744b9494d52b753aa2ebdaec033 logical_start=0 logical_end=7823 capped_end=7808 physical_query_tokens=7808
2026-08-21T16:54:30.745802803Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:54:31.049665520Z INFO 08-21 16:54:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-40101911d125449c9cbd49caae1cafeb logical_start=0 logical_end=1893 capped_end=1344 physical_query_tokens=1344
2026-08-21T16:54:35.327573302Z INFO 08-21 16:54:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-40101911d125449c9cbd49caae1cafeb logical_start=1344 logical_end=1893 capped_end=1888 physical_query_tokens=544
2026-08-21T16:54:43.289053874Z WARNING 08-21 16:54:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=89 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=42 assistant_tool_msgs=38 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:54:43.289233225Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:54:43.305245302Z WARNING 08-21 16:54:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=54 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=16 assistant_tool_msgs=12 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T16:54:43.305395768Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T16:54:43.476605218Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:54:44.013519400Z INFO 08-21 16:54:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ca7f971e1f71482988729e3a9ad9f3d6 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T16:54:46.748292181Z INFO 08-21 16:54:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ca7f971e1f71482988729e3a9ad9f3d6 logical_start=8192 logical_end=10773 capped_end=10768 physical_query_tokens=2576
2026-08-21T16:55:18.405340033Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:55:18.667246117Z INFO 08-21 16:55:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3ebcc53c2a50478a840093ba07dba8aa logical_start=0 logical_end=7438 capped_end=7424 physical_query_tokens=7424
2026-08-21T16:55:53.172609577Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:57:30.017915027Z INFO 08-21 16:57:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-80217d9da4924142adfa587628d37f6b logical_start=65536 logical_end=67263 capped_end=67248 physical_query_tokens=1712
2026-08-21T16:58:17.363534731Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T16:59:52.487388212Z INFO 08-21 16:59:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a0ee82848f314ad880d36dd7ad195c29 logical_start=65536 logical_end=73075 capped_end=73072 physical_query_tokens=7536
2026-08-21T17:00:26.408059409Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:00:26.681145688Z INFO 08-21 17:00:26 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-edfae008ae024335b15dc8b66c556a47 checkpoint_tokens=7424 logical_tokens=7752 physical_query_tokens=328
2026-08-21T17:00:26.681191162Z INFO 08-21 17:00:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-edfae008ae024335b15dc8b66c556a47 logical_start=7424 logical_end=7752 capped_end=7744 physical_query_tokens=320
2026-08-21T17:01:00.696129312Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:01:00.959990422Z INFO 08-21 17:01:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c135cf028f37499f9aeff875918c9797 logical_start=0 logical_end=7319 capped_end=7232 physical_query_tokens=7232
2026-08-21T17:01:08.934219555Z INFO 08-21 17:01:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c135cf028f37499f9aeff875918c9797 logical_start=7232 logical_end=7319 capped_end=7312 physical_query_tokens=80
2026-08-21T17:01:20.359270475Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:01:20.654213187Z INFO 08-21 17:01:20 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d8faff05cd1d4479a24ad0a3c47c46cb checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T17:01:23.398352451Z INFO 08-21 17:01:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8faff05cd1d4479a24ad0a3c47c46cb logical_start=8192 logical_end=11555 capped_end=10752 physical_query_tokens=2560
2026-08-21T17:01:28.494488337Z INFO 08-21 17:01:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8faff05cd1d4479a24ad0a3c47c46cb logical_start=10752 logical_end=11555 capped_end=11552 physical_query_tokens=800
2026-08-21T17:01:45.951305751Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:01:46.211565195Z INFO 08-21 17:01:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f61ce61ecfc642bf93b206b9c4838b0c checkpoint_tokens=7424 logical_tokens=7646 physical_query_tokens=222
2026-08-21T17:01:46.211599339Z INFO 08-21 17:01:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f61ce61ecfc642bf93b206b9c4838b0c logical_start=7424 logical_end=7646 capped_end=7632 physical_query_tokens=208
2026-08-21T17:02:03.874785544Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:02:23.183727578Z INFO 08-21 17:02:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a935ca4e05644631839b3ea98b369fff logical_start=16384 logical_end=24576 capped_end=17856 physical_query_tokens=1472
2026-08-21T17:03:43.798951476Z INFO 08-21 17:03:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a935ca4e05644631839b3ea98b369fff logical_start=67008 logical_end=74107 capped_end=74096 physical_query_tokens=7088
2026-08-21T17:04:43.071064156Z WARNING 08-21 17:04:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=40 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=16 assistant_tool_msgs=16 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:04:43.071319819Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:04:43.100052314Z WARNING 08-21 17:04:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=390 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=65 assistant_tool_msgs=60 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:04:43.100194492Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:04:43.300487676Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:04:43.571848976Z INFO 08-21 17:04:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-352ed445fd394be48625bb9cf4eab767 checkpoint_tokens=7232 logical_tokens=7865 physical_query_tokens=633
2026-08-21T17:04:43.571888138Z INFO 08-21 17:04:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-352ed445fd394be48625bb9cf4eab767 logical_start=7232 logical_end=7865 capped_end=7296 physical_query_tokens=64
2026-08-21T17:04:45.696449193Z INFO 08-21 17:04:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-352ed445fd394be48625bb9cf4eab767 logical_start=7296 logical_end=7865 capped_end=7856 physical_query_tokens=560
2026-08-21T17:04:54.341635500Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:04:54.620346324Z INFO 08-21 17:04:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9e48a4d368884f7e8ec45ad456c1bbff checkpoint_tokens=7744 logical_tokens=8192 physical_query_tokens=448
2026-08-21T17:04:57.971304589Z INFO 08-21 17:04:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9e48a4d368884f7e8ec45ad456c1bbff logical_start=8192 logical_end=8979 capped_end=8976 physical_query_tokens=784
2026-08-21T17:05:42.947297081Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:05:43.209049975Z INFO 08-21 17:05:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cea418b526b341b79c9a7016c114424d checkpoint_tokens=7744 logical_tokens=8024 physical_query_tokens=280
2026-08-21T17:05:43.209084042Z INFO 08-21 17:05:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cea418b526b341b79c9a7016c114424d logical_start=7744 logical_end=8024 capped_end=8016 physical_query_tokens=272
2026-08-21T17:06:07.973073859Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:06:08.552671496Z INFO 08-21 17:06:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a37fcf54f98c4beeb832ffb16674b1a0 checkpoint_tokens=17856 logical_tokens=24576 physical_query_tokens=6720
2026-08-21T17:07:35.614470494Z INFO 08-21 17:07:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a37fcf54f98c4beeb832ffb16674b1a0 logical_start=73728 logical_end=74884 capped_end=74880 physical_query_tokens=1152
2026-08-21T17:09:08.703217929Z WARNING 08-21 17:09:08 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=392 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=66 assistant_tool_msgs=61 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:09:08.703483265Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:09:08.905343022Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:09:09.176745021Z INFO 08-21 17:09:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2062fcc13e704409873f702556770732 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T17:09:12.885943390Z INFO 08-21 17:09:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2062fcc13e704409873f702556770732 logical_start=8192 logical_end=8990 capped_end=8976 physical_query_tokens=784
2026-08-21T17:09:48.291590939Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:09:48.544708864Z INFO 08-21 17:09:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2957e3ac42874905b2df68612a138901 checkpoint_tokens=1344 logical_tokens=1791 physical_query_tokens=447
2026-08-21T17:09:48.544746114Z INFO 08-21 17:09:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2957e3ac42874905b2df68612a138901 logical_start=1344 logical_end=1791 capped_end=1728 physical_query_tokens=384
2026-08-21T17:09:51.732529795Z INFO 08-21 17:09:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2957e3ac42874905b2df68612a138901 logical_start=1728 logical_end=1791 capped_end=1776 physical_query_tokens=48
2026-08-21T17:10:00.485994110Z WARNING 08-21 17:10:00 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=396 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=68 assistant_tool_msgs=63 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:10:00.486170773Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:10:00.650458889Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:10:00.780259981Z INFO 08-21 17:10:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5f12609dc964153bea171f61eb039af logical_start=0 logical_end=1344 capped_end=704 physical_query_tokens=704
2026-08-21T17:10:04.083037010Z INFO 08-21 17:10:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e5f12609dc964153bea171f61eb039af logical_start=704 logical_end=1344 capped_end=1328 physical_query_tokens=624
2026-08-21T17:10:51.570489334Z WARNING 08-21 17:10:51 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=394 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=67 assistant_tool_msgs=62 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:10:51.570763506Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:10:51.756146889Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:10:51.884809615Z INFO 08-21 17:10:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eff1b60bfa96434a90cd3db3fcfe86df logical_start=0 logical_end=349 capped_end=336 physical_query_tokens=336
2026-08-21T17:13:47.042384800Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:13:47.781570362Z INFO 08-21 17:13:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e385ffebc83641fcac519c0042431e48 checkpoint_tokens=17856 logical_tokens=24576 physical_query_tokens=6720
2026-08-21T17:15:14.783880141Z INFO 08-21 17:15:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e385ffebc83641fcac519c0042431e48 logical_start=73728 logical_end=75657 capped_end=75648 physical_query_tokens=1920
2026-08-21T17:15:47.234445438Z WARNING 08-21 17:15:47 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=44 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=18 assistant_tool_msgs=18 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:15:47.234726214Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:15:47.431351738Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:15:47.702266651Z INFO 08-21 17:15:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-605d9385c2b04b0388c67ec1604347c3 checkpoint_tokens=1344 logical_tokens=7331 physical_query_tokens=5987
2026-08-21T17:15:47.702308792Z INFO 08-21 17:15:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-605d9385c2b04b0388c67ec1604347c3 logical_start=1344 logical_end=7331 capped_end=5952 physical_query_tokens=4608
2026-08-21T17:15:54.059865356Z INFO 08-21 17:15:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-605d9385c2b04b0388c67ec1604347c3 logical_start=5952 logical_end=7331 capped_end=7328 physical_query_tokens=1376
2026-08-21T17:16:10.053325377Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:16:10.319045292Z INFO 08-21 17:16:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4cf1c635b91642498eb66bf6fea224c1 checkpoint_tokens=7424 logical_tokens=8006 physical_query_tokens=582
2026-08-21T17:16:10.319078656Z INFO 08-21 17:16:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4cf1c635b91642498eb66bf6fea224c1 logical_start=7424 logical_end=8006 capped_end=7552 physical_query_tokens=128
2026-08-21T17:16:12.857975713Z INFO 08-21 17:16:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4cf1c635b91642498eb66bf6fea224c1 logical_start=7552 logical_end=8006 capped_end=8000 physical_query_tokens=448
2026-08-21T17:16:32.480510331Z ERROR 08-21 17:16:32 serving_chat.py:345] Error in applying chat template from request
2026-08-21T17:16:32.480527824Z ERROR 08-21 17:16:32 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T17:16:32.480530771Z ERROR 08-21 17:16:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T17:16:32.480533564Z ERROR 08-21 17:16:32 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T17:16:32.480535980Z ERROR 08-21 17:16:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T17:16:32.480538355Z ERROR 08-21 17:16:32 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T17:16:32.480540457Z ERROR 08-21 17:16:32 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 487, in _parse_chat_message_content
2026-08-21T17:16:32.480542688Z ERROR 08-21 17:16:32 serving_chat.py:345] result_msg["tool_calls"] = list(parsed_msg["tool_calls"])
2026-08-21T17:16:32.480546843Z ERROR 08-21 17:16:32 serving_chat.py:345] pydantic_core._pydantic_core.ValidationError: 1 validation error for ValidatorIterator
2026-08-21T17:16:32.480549087Z ERROR 08-21 17:16:32 serving_chat.py:345] 0.index
2026-08-21T17:16:32.480551061Z ERROR 08-21 17:16:32 serving_chat.py:345] Extra inputs are not permitted [type=extra_forbidden, input_value=0, input_type=int]
2026-08-21T17:16:32.480553103Z ERROR 08-21 17:16:32 serving_chat.py:345] For further information visit https://errors.pydantic.dev/2.11/v/extra_forbidden
2026-08-21T17:16:32.480696956Z WARNING 08-21 17:16:32 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=38 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=15 assistant_tool_msgs=15 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T17:16:32.480905114Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:16:32.676907173Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:16:32.943227711Z INFO 08-21 17:16:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-874e60d5b97a49868518f171e21bcf60 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T17:16:35.768072119Z INFO 08-21 17:16:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-874e60d5b97a49868518f171e21bcf60 logical_start=8192 logical_end=8465 capped_end=8448 physical_query_tokens=256
2026-08-21T17:16:56.276116419Z ERROR 08-21 17:16:56 serving_chat.py:345] Error in applying chat template from request
2026-08-21T17:16:56.276126370Z ERROR 08-21 17:16:56 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T17:16:56.276128823Z ERROR 08-21 17:16:56 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T17:16:56.276131388Z ERROR 08-21 17:16:56 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T17:16:56.276133637Z ERROR 08-21 17:16:56 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T17:16:56.276136018Z ERROR 08-21 17:16:56 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T17:16:56.276138051Z ERROR 08-21 17:16:56 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 487, in _parse_chat_message_content
2026-08-21T17:16:56.276140149Z ERROR 08-21 17:16:56 serving_chat.py:345] result_msg["tool_calls"] = list(parsed_msg["tool_calls"])
2026-08-21T17:16:56.276142334Z ERROR 08-21 17:16:56 serving_chat.py:345] pydantic_core._pydantic_core.ValidationError: 1 validation error for ValidatorIterator
2026-08-21T17:16:56.276144369Z ERROR 08-21 17:16:56 serving_chat.py:345] 0.index
2026-08-21T17:16:56.276146342Z ERROR 08-21 17:16:56 serving_chat.py:345] Extra inputs are not permitted [type=extra_forbidden, input_value=0, input_type=int]
2026-08-21T17:16:56.276148312Z ERROR 08-21 17:16:56 serving_chat.py:345] For further information visit https://errors.pydantic.dev/2.11/v/extra_forbidden
2026-08-21T17:16:56.276254052Z WARNING 08-21 17:16:56 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=40 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=16 assistant_tool_msgs=16 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T17:16:56.276432205Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:16:56.457202828Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:16:56.726578394Z INFO 08-21 17:16:56 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b70737e02a0343719d370742ebd2e754 checkpoint_tokens=8448 logical_tokens=8983 physical_query_tokens=535
2026-08-21T17:16:56.726620701Z INFO 08-21 17:16:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b70737e02a0343719d370742ebd2e754 logical_start=8448 logical_end=8983 capped_end=8976 physical_query_tokens=528
2026-08-21T17:17:12.747100555Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:17:13.013532850Z INFO 08-21 17:17:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cee23ee7fefe4b6b8c5ba7a173923246 checkpoint_tokens=8448 logical_tokens=9096 physical_query_tokens=648
2026-08-21T17:17:13.013577508Z INFO 08-21 17:17:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cee23ee7fefe4b6b8c5ba7a173923246 logical_start=8448 logical_end=9096 capped_end=8960 physical_query_tokens=512
2026-08-21T17:17:16.508259544Z INFO 08-21 17:17:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cee23ee7fefe4b6b8c5ba7a173923246 logical_start=8960 logical_end=9096 capped_end=9088 physical_query_tokens=128
2026-08-21T17:17:25.197121070Z WARNING 08-21 17:17:25 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=50 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=21 assistant_tool_msgs=21 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:17:25.197290526Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:17:25.218970702Z WARNING 08-21 17:17:25 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=52 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=22 assistant_tool_msgs=22 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:17:25.219111804Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:17:25.379026357Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:17:25.508648402Z INFO 08-21 17:17:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c8551707f573455692b38d3cffa8682f logical_start=0 logical_end=265 capped_end=64 physical_query_tokens=64
2026-08-21T17:17:27.296893234Z INFO 08-21 17:17:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c8551707f573455692b38d3cffa8682f logical_start=64 logical_end=265 capped_end=256 physical_query_tokens=192
2026-08-21T17:19:31.632149032Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:19:31.760692007Z INFO 08-21 17:19:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e7f089ca1c8b46f7851fd38b4b047799 checkpoint_tokens=64 logical_tokens=262 physical_query_tokens=198
2026-08-21T17:19:31.760731437Z INFO 08-21 17:19:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e7f089ca1c8b46f7851fd38b4b047799 logical_start=64 logical_end=262 capped_end=256 physical_query_tokens=192
2026-08-21T17:21:44.177050026Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:21:44.469035188Z INFO 08-21 17:21:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-53494198acde4ca787222ca1f80dfd8b checkpoint_tokens=9088 logical_tokens=9895 physical_query_tokens=807
2026-08-21T17:21:44.469077695Z INFO 08-21 17:21:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-53494198acde4ca787222ca1f80dfd8b logical_start=9088 logical_end=9895 capped_end=9888 physical_query_tokens=800
2026-08-21T17:22:03.207015224Z ERROR 08-21 17:22:03 serving_chat.py:345] Error in applying chat template from request
2026-08-21T17:22:03.207020119Z ERROR 08-21 17:22:03 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T17:22:03.207022337Z ERROR 08-21 17:22:03 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T17:22:03.207025029Z ERROR 08-21 17:22:03 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T17:22:03.207027150Z ERROR 08-21 17:22:03 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T17:22:03.207029276Z ERROR 08-21 17:22:03 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T17:22:03.207031254Z ERROR 08-21 17:22:03 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 487, in _parse_chat_message_content
2026-08-21T17:22:03.207033477Z ERROR 08-21 17:22:03 serving_chat.py:345] result_msg["tool_calls"] = list(parsed_msg["tool_calls"])
2026-08-21T17:22:03.207035760Z ERROR 08-21 17:22:03 serving_chat.py:345] pydantic_core._pydantic_core.ValidationError: 1 validation error for ValidatorIterator
2026-08-21T17:22:03.207045189Z ERROR 08-21 17:22:03 serving_chat.py:345] 0.index
2026-08-21T17:22:03.207047195Z ERROR 08-21 17:22:03 serving_chat.py:345] Extra inputs are not permitted [type=extra_forbidden, input_value=0, input_type=int]
2026-08-21T17:22:03.207049184Z ERROR 08-21 17:22:03 serving_chat.py:345] For further information visit https://errors.pydantic.dev/2.11/v/extra_forbidden
2026-08-21T17:22:03.207181206Z WARNING 08-21 17:22:03 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=42 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=17 assistant_tool_msgs=17 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T17:22:03.207397549Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:22:03.398066113Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:22:03.670849792Z INFO 08-21 17:22:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e19b2070c6fa4385af9bd6ff81654218 checkpoint_tokens=9088 logical_tokens=10277 physical_query_tokens=1189
2026-08-21T17:22:03.670891585Z INFO 08-21 17:22:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e19b2070c6fa4385af9bd6ff81654218 logical_start=9088 logical_end=10277 capped_end=9856 physical_query_tokens=768
2026-08-21T17:22:07.691561966Z INFO 08-21 17:22:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e19b2070c6fa4385af9bd6ff81654218 logical_start=9856 logical_end=10277 capped_end=10272 physical_query_tokens=416
2026-08-21T17:22:20.690660998Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:22:20.956133341Z INFO 08-21 17:22:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-71bfcdbc5e584f489c5f7c6c326ada3c logical_start=0 logical_end=7229 capped_end=7216 physical_query_tokens=7216
2026-08-21T17:23:01.715554201Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:23:01.852827531Z INFO 08-21 17:23:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5a412a427e4d4707a48609cf6741f309 logical_start=0 logical_end=766 capped_end=752 physical_query_tokens=752
2026-08-21T17:25:49.019360302Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:25:49.147669223Z INFO 08-21 17:25:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-93d12620d54d43e7a7a60d4afcc2866e checkpoint_tokens=752 logical_tokens=766 physical_query_tokens=14
2026-08-21T17:28:41.594224761Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:28:41.865141863Z INFO 08-21 17:28:41 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b2725d8983684b49bb363d8120478687 logical_start=0 logical_end=7197 capped_end=7184 physical_query_tokens=7184
2026-08-21T17:29:11.999043383Z ERROR 08-21 17:29:11 serving_chat.py:345] Error in applying chat template from request
2026-08-21T17:29:11.999060412Z ERROR 08-21 17:29:11 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T17:29:11.999063297Z ERROR 08-21 17:29:11 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T17:29:11.999065660Z ERROR 08-21 17:29:11 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T17:29:11.999067741Z ERROR 08-21 17:29:11 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T17:29:11.999070250Z ERROR 08-21 17:29:11 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T17:29:11.999072304Z ERROR 08-21 17:29:11 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 487, in _parse_chat_message_content
2026-08-21T17:29:11.999082237Z ERROR 08-21 17:29:11 serving_chat.py:345] result_msg["tool_calls"] = list(parsed_msg["tool_calls"])
2026-08-21T17:29:11.999084970Z ERROR 08-21 17:29:11 serving_chat.py:345] pydantic_core._pydantic_core.ValidationError: 1 validation error for ValidatorIterator
2026-08-21T17:29:11.999086978Z ERROR 08-21 17:29:11 serving_chat.py:345] 0.index
2026-08-21T17:29:11.999088786Z ERROR 08-21 17:29:11 serving_chat.py:345] Extra inputs are not permitted [type=extra_forbidden, input_value=0, input_type=int]
2026-08-21T17:29:11.999090841Z ERROR 08-21 17:29:11 serving_chat.py:345] For further information visit https://errors.pydantic.dev/2.11/v/extra_forbidden
2026-08-21T17:29:11.999229940Z WARNING 08-21 17:29:11 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=44 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=18 assistant_tool_msgs=18 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T17:29:11.999451817Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:29:12.203524231Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:29:12.480150107Z INFO 08-21 17:29:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7043debccdb0476894f86d4f8154f0b9 logical_start=0 logical_end=8192 capped_end=7296 physical_query_tokens=7296
2026-08-21T17:29:20.469268546Z INFO 08-21 17:29:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7043debccdb0476894f86d4f8154f0b9 logical_start=7296 logical_end=8745 capped_end=8736 physical_query_tokens=1440
2026-08-21T17:29:48.109545203Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:29:48.374675316Z INFO 08-21 17:29:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-80fc9820a03744e1bb3f2c62b21100b8 logical_start=0 logical_end=7346 capped_end=7168 physical_query_tokens=7168
2026-08-21T17:29:56.250407357Z INFO 08-21 17:29:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-80fc9820a03744e1bb3f2c62b21100b8 logical_start=7168 logical_end=7346 capped_end=7344 physical_query_tokens=176
2026-08-21T17:30:02.445519805Z WARNING 08-21 17:30:02 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=54 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=22 assistant_tool_msgs=22 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:30:02.445711717Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:30:02.626866361Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:30:02.892603917Z INFO 08-21 17:30:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8324eaa14c1b4b8db29ebb84630566c1 checkpoint_tokens=7168 logical_tokens=7573 physical_query_tokens=405
2026-08-21T17:30:02.892644007Z INFO 08-21 17:30:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8324eaa14c1b4b8db29ebb84630566c1 logical_start=7168 logical_end=7573 capped_end=7296 physical_query_tokens=128
2026-08-21T17:30:05.350045370Z INFO 08-21 17:30:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8324eaa14c1b4b8db29ebb84630566c1 logical_start=7296 logical_end=7573 capped_end=7568 physical_query_tokens=272
2026-08-21T17:30:14.313057338Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:30:14.442872061Z INFO 08-21 17:30:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b7bf199f4364440b9519ef57bb54fc5d checkpoint_tokens=64 logical_tokens=370 physical_query_tokens=306
2026-08-21T17:30:14.442906501Z INFO 08-21 17:30:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b7bf199f4364440b9519ef57bb54fc5d logical_start=64 logical_end=370 capped_end=368 physical_query_tokens=304
2026-08-21T17:32:33.155116376Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:32:33.282773093Z INFO 08-21 17:32:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-58480829476042dc867140c1f7122f20 checkpoint_tokens=64 logical_tokens=249 physical_query_tokens=185
2026-08-21T17:32:33.282800481Z INFO 08-21 17:32:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-58480829476042dc867140c1f7122f20 logical_start=64 logical_end=249 capped_end=240 physical_query_tokens=176
2026-08-21T17:34:24.055001117Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:34:24.345649260Z INFO 08-21 17:34:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-194eaf148789454faf6f4c4fee0a303a checkpoint_tokens=7296 logical_tokens=8192 physical_query_tokens=896
2026-08-21T17:34:24.345694388Z INFO 08-21 17:34:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-194eaf148789454faf6f4c4fee0a303a logical_start=7296 logical_end=8192 capped_end=7552 physical_query_tokens=256
2026-08-21T17:34:27.306544589Z INFO 08-21 17:34:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-194eaf148789454faf6f4c4fee0a303a logical_start=7552 logical_end=9083 capped_end=9072 physical_query_tokens=1520
2026-08-21T17:34:35.921961334Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:34:36.189686970Z INFO 08-21 17:34:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-67df7721958c461fae6d54cffabe315f checkpoint_tokens=7296 logical_tokens=8192 physical_query_tokens=896
2026-08-21T17:34:40.082922950Z INFO 08-21 17:34:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-67df7721958c461fae6d54cffabe315f logical_start=8192 logical_end=9567 capped_end=8704 physical_query_tokens=512
2026-08-21T17:34:43.295578148Z INFO 08-21 17:34:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-67df7721958c461fae6d54cffabe315f logical_start=8704 logical_end=9567 capped_end=9552 physical_query_tokens=848
2026-08-21T17:35:01.834904996Z WARNING 08-21 17:35:01 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=5 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=2 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=6 image_data=6 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:35:01.835060843Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:35:01.873599771Z ERROR 08-21 17:35:01 serving_chat.py:345] Error in applying chat template from request
2026-08-21T17:35:01.873604901Z ERROR 08-21 17:35:01 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T17:35:01.873607287Z ERROR 08-21 17:35:01 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T17:35:01.873609788Z ERROR 08-21 17:35:01 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T17:35:01.873611879Z ERROR 08-21 17:35:01 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T17:35:01.873614092Z ERROR 08-21 17:35:01 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T17:35:01.873616096Z ERROR 08-21 17:35:01 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 487, in _parse_chat_message_content
2026-08-21T17:35:01.873618095Z ERROR 08-21 17:35:01 serving_chat.py:345] result_msg["tool_calls"] = list(parsed_msg["tool_calls"])
2026-08-21T17:35:01.873620293Z ERROR 08-21 17:35:01 serving_chat.py:345] pydantic_core._pydantic_core.ValidationError: 1 validation error for ValidatorIterator
2026-08-21T17:35:01.873622251Z ERROR 08-21 17:35:01 serving_chat.py:345] 0.index
2026-08-21T17:35:01.873624173Z ERROR 08-21 17:35:01 serving_chat.py:345] Extra inputs are not permitted [type=extra_forbidden, input_value=0, input_type=int]
2026-08-21T17:35:01.873626285Z ERROR 08-21 17:35:01 serving_chat.py:345] For further information visit https://errors.pydantic.dev/2.11/v/extra_forbidden
2026-08-21T17:35:01.873737653Z WARNING 08-21 17:35:01 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=50 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=21 assistant_tool_msgs=21 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T17:35:01.873864151Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:35:02.036651249Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:35:02.165213326Z INFO 08-21 17:35:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1a11cb309454467aab4d36fe7467794f logical_start=0 logical_end=355 capped_end=352 physical_query_tokens=352
2026-08-21T17:37:57.794768310Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:37:57.923399907Z INFO 08-21 17:37:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c35e55a978a74d75850e140908cd2206 checkpoint_tokens=64 logical_tokens=319 physical_query_tokens=255
2026-08-21T17:37:57.923443223Z INFO 08-21 17:37:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c35e55a978a74d75850e140908cd2206 logical_start=64 logical_end=319 capped_end=304 physical_query_tokens=240
2026-08-21T17:40:41.105966200Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:40:41.232790444Z INFO 08-21 17:40:41 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-60d34a29d41442dcbeb7eb41090416cb checkpoint_tokens=352 logical_tokens=355 physical_query_tokens=3
2026-08-21T17:43:11.670704663Z WARNING 08-21 17:43:11 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=27 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:43:11.670972856Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:43:11.851959962Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:43:11.979057614Z INFO 08-21 17:43:11 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-67d5dc22ab4d487eb5d9c552ae58a85c checkpoint_tokens=352 logical_tokens=355 physical_query_tokens=3
2026-08-21T17:46:04.277652048Z WARNING 08-21 17:46:04 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=55 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:04.277922546Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:04.289368116Z WARNING 08-21 17:46:04 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=55 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:04.289501748Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:04.298625923Z WARNING 08-21 17:46:04 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=27 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:04.298755034Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:04.308889482Z WARNING 08-21 17:46:04 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=55 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:04.309019629Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:04.318968359Z WARNING 08-21 17:46:04 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=55 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:04.319097155Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:04.535549172Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:46:04.814348374Z INFO 08-21 17:46:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-80981932224744d2b0adbdd28dd02b30 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T17:46:07.680078683Z INFO 08-21 17:46:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-80981932224744d2b0adbdd28dd02b30 logical_start=8192 logical_end=9513 capped_end=9504 physical_query_tokens=1312
2026-08-21T17:46:52.238021976Z WARNING 08-21 17:46:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=55 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:52.238214622Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:52.281273411Z WARNING 08-21 17:46:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=4 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=6 image_data=6 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:52.281418323Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:52.303034687Z WARNING 08-21 17:46:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=9 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=16 tool_msgs=3 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:46:52.303157137Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:52.326400201Z ERROR 08-21 17:46:52 serving_chat.py:345] Error in applying chat template from request
2026-08-21T17:46:52.326405106Z ERROR 08-21 17:46:52 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T17:46:52.326407487Z ERROR 08-21 17:46:52 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T17:46:52.326416450Z ERROR 08-21 17:46:52 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T17:46:52.326418780Z ERROR 08-21 17:46:52 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T17:46:52.326421940Z ERROR 08-21 17:46:52 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T17:46:52.326423900Z ERROR 08-21 17:46:52 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 487, in _parse_chat_message_content
2026-08-21T17:46:52.326426083Z ERROR 08-21 17:46:52 serving_chat.py:345] result_msg["tool_calls"] = list(parsed_msg["tool_calls"])
2026-08-21T17:46:52.326428264Z ERROR 08-21 17:46:52 serving_chat.py:345] pydantic_core._pydantic_core.ValidationError: 1 validation error for ValidatorIterator
2026-08-21T17:46:52.326430231Z ERROR 08-21 17:46:52 serving_chat.py:345] 0.index
2026-08-21T17:46:52.326432285Z ERROR 08-21 17:46:52 serving_chat.py:345] Extra inputs are not permitted [type=extra_forbidden, input_value=0, input_type=int]
2026-08-21T17:46:52.326434356Z ERROR 08-21 17:46:52 serving_chat.py:345] For further information visit https://errors.pydantic.dev/2.11/v/extra_forbidden
2026-08-21T17:46:52.326539284Z WARNING 08-21 17:46:52 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=unclassified_chat_error messages=48 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=23 tool_msgs=20 assistant_tool_msgs=20 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T17:46:52.326670283Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:46:52.533283452Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:46:52.802734986Z INFO 08-21 17:46:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5de36382f9a04368881ec199e1c260fe checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T17:46:55.664973333Z INFO 08-21 17:46:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5de36382f9a04368881ec199e1c260fe logical_start=8192 logical_end=10017 capped_end=9472 physical_query_tokens=1280
2026-08-21T17:46:59.984639872Z INFO 08-21 17:46:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5de36382f9a04368881ec199e1c260fe logical_start=9472 logical_end=10017 capped_end=10000 physical_query_tokens=528
2026-08-21T17:47:09.831709679Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:47:10.100791471Z INFO 08-21 17:47:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3b06199ba16e40f4bdb503372f6e330d checkpoint_tokens=9472 logical_tokens=10337 physical_query_tokens=865
2026-08-21T17:47:10.100826147Z INFO 08-21 17:47:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3b06199ba16e40f4bdb503372f6e330d logical_start=9472 logical_end=10337 capped_end=9984 physical_query_tokens=512
2026-08-21T17:47:13.635097717Z INFO 08-21 17:47:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3b06199ba16e40f4bdb503372f6e330d logical_start=9984 logical_end=10337 capped_end=10320 physical_query_tokens=336
2026-08-21T17:47:24.585799760Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:47:24.854513639Z INFO 08-21 17:47:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a5101313c61c447183722e4ea527404c checkpoint_tokens=9984 logical_tokens=10441 physical_query_tokens=457
2026-08-21T17:47:24.854560193Z INFO 08-21 17:47:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a5101313c61c447183722e4ea527404c logical_start=9984 logical_end=10441 capped_end=10304 physical_query_tokens=320
2026-08-21T17:47:28.221776753Z INFO 08-21 17:47:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a5101313c61c447183722e4ea527404c logical_start=10304 logical_end=10441 capped_end=10432 physical_query_tokens=128
2026-08-21T17:47:38.294977815Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:47:38.561587790Z INFO 08-21 17:47:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3b9763f358ea4c1e8185807b5ffe325a checkpoint_tokens=10432 logical_tokens=10705 physical_query_tokens=273
2026-08-21T17:47:38.561625767Z INFO 08-21 17:47:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3b9763f358ea4c1e8185807b5ffe325a logical_start=10432 logical_end=10705 capped_end=10688 physical_query_tokens=256
2026-08-21T17:48:05.984608664Z WARNING 08-21 17:48:05 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=11 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=6 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=6 image_data=6 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:48:05.984873205Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:48:06.016866423Z WARNING 08-21 17:48:06 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=56 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=23 assistant_tool_msgs=23 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:48:06.017003485Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:48:06.214482965Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:48:06.478319213Z INFO 08-21 17:48:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-faf019ac09c0402bb2df54b01bf32cb7 checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T17:48:46.273289952Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:48:46.532407179Z INFO 08-21 17:48:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-56036c7205004031b380483e6337b180 checkpoint_tokens=7184 logical_tokens=7197 physical_query_tokens=13
2026-08-21T17:49:04.476329953Z WARNING 08-21 17:49:04 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=54 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=22 assistant_tool_msgs=22 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:49:04.476557046Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:49:04.658520321Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:49:04.920446800Z INFO 08-21 17:49:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-032b46ec156f47d7afbc4525ff23ed2c checkpoint_tokens=7168 logical_tokens=7294 physical_query_tokens=126
2026-08-21T17:49:04.920491319Z INFO 08-21 17:49:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-032b46ec156f47d7afbc4525ff23ed2c logical_start=7168 logical_end=7294 capped_end=7280 physical_query_tokens=112
2026-08-21T17:49:15.956726190Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:49:16.219427388Z INFO 08-21 17:49:16 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-83c678ca57e246b794f12ab4a15bca94 checkpoint_tokens=7168 logical_tokens=7526 physical_query_tokens=358
2026-08-21T17:49:16.219465992Z INFO 08-21 17:49:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-83c678ca57e246b794f12ab4a15bca94 logical_start=7168 logical_end=7526 capped_end=7232 physical_query_tokens=64
2026-08-21T17:49:18.218016638Z INFO 08-21 17:49:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-83c678ca57e246b794f12ab4a15bca94 logical_start=7232 logical_end=7526 capped_end=7520 physical_query_tokens=288
2026-08-21T17:49:31.279595794Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:49:31.544787328Z INFO 08-21 17:49:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-304226b29622476e93a794f6dc2f2ad7 checkpoint_tokens=7232 logical_tokens=7841 physical_query_tokens=609
2026-08-21T17:49:31.544820984Z INFO 08-21 17:49:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-304226b29622476e93a794f6dc2f2ad7 logical_start=7232 logical_end=7841 capped_end=7488 physical_query_tokens=256
2026-08-21T17:49:34.463462880Z INFO 08-21 17:49:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-304226b29622476e93a794f6dc2f2ad7 logical_start=7488 logical_end=7841 capped_end=7824 physical_query_tokens=336
2026-08-21T17:49:45.099015560Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:49:45.369670977Z INFO 08-21 17:49:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cfdc041159864b8ab5dcfca959e419b8 logical_start=0 logical_end=8192 capped_end=7232 physical_query_tokens=7232
2026-08-21T17:49:53.313074758Z INFO 08-21 17:49:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cfdc041159864b8ab5dcfca959e419b8 logical_start=7232 logical_end=9886 capped_end=9872 physical_query_tokens=2640
2026-08-21T17:50:25.313440431Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:50:25.589801856Z INFO 08-21 17:50:25 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-265c9502467741e9b5201b0a9b6fdc61 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T17:50:29.543302021Z INFO 08-21 17:50:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-265c9502467741e9b5201b0a9b6fdc61 logical_start=8192 logical_end=13070 capped_end=9856 physical_query_tokens=1664
2026-08-21T17:50:33.882436433Z INFO 08-21 17:50:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-265c9502467741e9b5201b0a9b6fdc61 logical_start=9856 logical_end=13070 capped_end=13056 physical_query_tokens=3200
2026-08-21T17:51:10.404263989Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:51:10.672745462Z INFO 08-21 17:51:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a8a7b07648b9419da165b86428f44be2 checkpoint_tokens=9856 logical_tokens=10465 physical_query_tokens=609
2026-08-21T17:51:10.672783993Z INFO 08-21 17:51:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a8a7b07648b9419da165b86428f44be2 logical_start=9856 logical_end=10465 capped_end=10448 physical_query_tokens=592
2026-08-21T17:51:43.936907804Z WARNING 08-21 17:51:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=66 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=26 assistant_tool_msgs=26 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:51:43.937097335Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:51:43.951065568Z WARNING 08-21 17:51:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=20 tool_msgs=3 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:51:43.951195356Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:51:44.149410639Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:51:44.428058588Z INFO 08-21 17:51:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-df8e7ba5426f4e539e2f09cf861cb414 checkpoint_tokens=10688 logical_tokens=14200 physical_query_tokens=3512
2026-08-21T17:51:44.428100622Z INFO 08-21 17:51:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-df8e7ba5426f4e539e2f09cf861cb414 logical_start=10688 logical_end=14200 capped_end=14192 physical_query_tokens=3504
2026-08-21T17:52:21.750265163Z WARNING 08-21 17:52:21 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=58 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=24 assistant_tool_msgs=24 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:52:21.750491146Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:52:21.771060732Z WARNING 08-21 17:52:21 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:52:21.771193727Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:52:21.943590119Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:52:22.074687651Z INFO 08-21 17:52:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-edf88915c65e4516a6b408e22fe67e19 logical_start=0 logical_end=1133 capped_end=1120 physical_query_tokens=1120
2026-08-21T17:54:29.616800255Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:54:29.904396163Z INFO 08-21 17:54:29 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d943579daa8c428eb6fb2202bb264685 checkpoint_tokens=10688 logical_tokens=14789 physical_query_tokens=4101
2026-08-21T17:54:29.904444706Z INFO 08-21 17:54:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d943579daa8c428eb6fb2202bb264685 logical_start=10688 logical_end=14789 capped_end=14144 physical_query_tokens=3456
2026-08-21T17:54:35.916516686Z INFO 08-21 17:54:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d943579daa8c428eb6fb2202bb264685 logical_start=14144 logical_end=14789 capped_end=14784 physical_query_tokens=640
2026-08-21T17:55:14.877190009Z WARNING 08-21 17:55:14 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=5 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=2 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:14.877407778Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:14.884815339Z WARNING 08-21 17:55:14 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=1 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:14.884930140Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:15.106246218Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:55:15.387678568Z INFO 08-21 17:55:15 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3d184a0b16064aa6a8abb80a7f7d5f58 checkpoint_tokens=14784 logical_tokens=16384 physical_query_tokens=1600
2026-08-21T17:55:52.040218096Z WARNING 08-21 17:55:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=20 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:52.040439565Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:52.062704012Z WARNING 08-21 17:55:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=60 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=25 assistant_tool_msgs=25 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:52.062841295Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:52.078763674Z WARNING 08-21 17:55:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=20 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:52.078890247Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:52.098486175Z WARNING 08-21 17:55:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=62 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=26 assistant_tool_msgs=26 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:52.098620631Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:52.119773480Z WARNING 08-21 17:55:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=64 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=27 assistant_tool_msgs=27 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T17:55:52.119901706Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T17:55:52.427870946Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:57:23.813876828Z INFO 08-21 17:57:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-14342993b31240e292ff8916d332f8d0 logical_start=65536 logical_end=67262 capped_end=67008 physical_query_tokens=1472
2026-08-21T17:57:29.874234727Z INFO 08-21 17:57:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-14342993b31240e292ff8916d332f8d0 logical_start=67008 logical_end=67262 capped_end=67248 physical_query_tokens=240
2026-08-21T17:58:12.670052423Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:58:13.047227431Z INFO 08-21 17:58:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-411ae71d41e64b78b1003a8c63dc989b logical_start=0 logical_end=8192 capped_end=1536 physical_query_tokens=1536
2026-08-21T17:58:47.027870847Z INFO 08-21 17:58:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-411ae71d41e64b78b1003a8c63dc989b logical_start=26112 logical_end=30128 capped_end=30112 physical_query_tokens=4000
2026-08-21T17:59:47.591461278Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T17:59:47.861263926Z INFO 08-21 17:59:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-110627e408d84ae6b3e600fbe1878b87 logical_start=0 logical_end=8054 capped_end=7424 physical_query_tokens=7424
2026-08-21T17:59:55.909832903Z INFO 08-21 17:59:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-110627e408d84ae6b3e600fbe1878b87 logical_start=7424 logical_end=8054 capped_end=8048 physical_query_tokens=624
2026-08-21T18:00:36.791473444Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:00:36.921796935Z INFO 08-21 18:00:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d75041f88fa54eeaa39035dd3db27df6 logical_start=0 logical_end=986 capped_end=976 physical_query_tokens=976
2026-08-21T18:04:43.554996967Z WARNING 08-21 18:04:43 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=66 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=28 assistant_tool_msgs=28 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:04:43.555278427Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:04:43.784739597Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:04:44.080185010Z INFO 08-21 18:04:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-eda2c0d8f8c4488faec088a6bef230a9 checkpoint_tokens=16384 logical_tokens=17360 physical_query_tokens=976
2026-08-21T18:04:44.080227542Z INFO 08-21 18:04:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eda2c0d8f8c4488faec088a6bef230a9 logical_start=16384 logical_end=17360 capped_end=17344 physical_query_tokens=960
2026-08-21T18:05:09.538896796Z WARNING 08-21 18:05:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=54 tool_msgs=1 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:05:09.539102010Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:05:09.559922172Z WARNING 08-21 18:05:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=78 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=34 assistant_tool_msgs=32 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:05:09.560062410Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:05:09.574027915Z WARNING 08-21 18:05:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=7 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=3 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:05:09.574163507Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:05:09.586688107Z WARNING 08-21 18:05:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=10 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=20 tool_msgs=4 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:05:09.586812504Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:05:09.769952803Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:05:10.035822924Z INFO 08-21 18:05:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-edbc787b0f8844d7867968d518bd934a checkpoint_tokens=7232 logical_tokens=7388 physical_query_tokens=156
2026-08-21T18:05:10.035863142Z INFO 08-21 18:05:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-edbc787b0f8844d7867968d518bd934a logical_start=7232 logical_end=7388 capped_end=7296 physical_query_tokens=64
2026-08-21T18:05:12.079432375Z INFO 08-21 18:05:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-edbc787b0f8844d7867968d518bd934a logical_start=7296 logical_end=7388 capped_end=7376 physical_query_tokens=80
2026-08-21T18:05:18.589827031Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:05:18.853642045Z INFO 08-21 18:05:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e95c54544a7843e9a050265d66f33055 checkpoint_tokens=7296 logical_tokens=7615 physical_query_tokens=319
2026-08-21T18:05:18.853681997Z INFO 08-21 18:05:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e95c54544a7843e9a050265d66f33055 logical_start=7296 logical_end=7615 capped_end=7360 physical_query_tokens=64
2026-08-21T18:05:21.001671323Z INFO 08-21 18:05:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e95c54544a7843e9a050265d66f33055 logical_start=7360 logical_end=7615 capped_end=7600 physical_query_tokens=240
2026-08-21T18:05:33.202317827Z WARNING 08-21 18:05:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=70 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=29 assistant_tool_msgs=29 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:05:33.202488865Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:05:33.410115413Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:05:33.709335594Z INFO 08-21 18:05:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3f889b9b5b174b76b42325ff2c88db77 checkpoint_tokens=1536 logical_tokens=8192 physical_query_tokens=6656
2026-08-21T18:05:41.402464338Z INFO 08-21 18:05:41 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3f889b9b5b174b76b42325ff2c88db77 logical_start=8192 logical_end=16384 capped_end=16128 physical_query_tokens=7936
2026-08-21T18:05:50.571531475Z INFO 08-21 18:05:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3f889b9b5b174b76b42325ff2c88db77 logical_start=16128 logical_end=21151 capped_end=21136 physical_query_tokens=5008
2026-08-21T18:08:26.283373489Z WARNING 08-21 18:08:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=74 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=32 assistant_tool_msgs=30 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:08:26.283645730Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:08:26.308800238Z WARNING 08-21 18:08:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=76 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=33 assistant_tool_msgs=31 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:08:26.308944369Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:08:26.509438297Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:08:26.773203228Z INFO 08-21 18:08:26 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-19d4388ea26c40b3b59ae4d80147e8b1 checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T18:08:48.942669555Z WARNING 08-21 18:08:48 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=9 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=4 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:08:48.942821741Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:08:49.119323410Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:08:49.389163903Z INFO 08-21 18:08:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d9fda997007941d4b241322315566307 logical_start=0 logical_end=7969 capped_end=7424 physical_query_tokens=7424
2026-08-21T18:08:57.432792780Z INFO 08-21 18:08:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d9fda997007941d4b241322315566307 logical_start=7424 logical_end=7969 capped_end=7952 physical_query_tokens=528
2026-08-21T18:09:14.332693092Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:09:14.614438548Z INFO 08-21 18:09:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d529b5415a524e3f957f1418e6f6d629 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T18:09:14.614475990Z INFO 08-21 18:09:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d529b5415a524e3f957f1418e6f6d629 logical_start=7424 logical_end=8192 capped_end=8000 physical_query_tokens=576
2026-08-21T18:09:18.190112475Z INFO 08-21 18:09:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d529b5415a524e3f957f1418e6f6d629 logical_start=8000 logical_end=9998 capped_end=9984 physical_query_tokens=1984
2026-08-21T18:09:46.511353664Z WARNING 08-21 18:09:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=7 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=2 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:09:46.511592097Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:09:46.519722309Z WARNING 08-21 18:09:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=12 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=20 tool_msgs=5 assistant_tool_msgs=5 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:09:46.519852843Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:09:46.708212982Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:09:46.977951562Z INFO 08-21 18:09:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-74937105309b450f94b0efda6a1c6079 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T18:09:46.977991282Z INFO 08-21 18:09:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-74937105309b450f94b0efda6a1c6079 logical_start=7424 logical_end=8192 capped_end=7936 physical_query_tokens=512
2026-08-21T18:09:50.582329120Z INFO 08-21 18:09:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-74937105309b450f94b0efda6a1c6079 logical_start=7936 logical_end=8760 capped_end=8752 physical_query_tokens=816
2026-08-21T18:10:00.234233615Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:10:00.500118282Z INFO 08-21 18:10:00 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-927366e32c874a1ca0f07fe636d33d8c checkpoint_tokens=7936 logical_tokens=8192 physical_query_tokens=256
2026-08-21T18:10:03.608119239Z INFO 08-21 18:10:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-927366e32c874a1ca0f07fe636d33d8c logical_start=8192 logical_end=9001 capped_end=8704 physical_query_tokens=512
2026-08-21T18:10:07.059061696Z INFO 08-21 18:10:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-927366e32c874a1ca0f07fe636d33d8c logical_start=8704 logical_end=9001 capped_end=8992 physical_query_tokens=288
2026-08-21T18:10:18.022431411Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:10:18.149869345Z INFO 08-21 18:10:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e7b15d375b354c39adaef62c8847750b logical_start=0 logical_end=124 capped_end=112 physical_query_tokens=112
2026-08-21T18:14:17.502822045Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:14:17.809994462Z INFO 08-21 18:14:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8045be79feb44b1b854a1cbdeac39c1e checkpoint_tokens=9984 logical_tokens=14403 physical_query_tokens=4419
2026-08-21T18:14:17.810037568Z INFO 08-21 18:14:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8045be79feb44b1b854a1cbdeac39c1e logical_start=9984 logical_end=14403 capped_end=14400 physical_query_tokens=4416
2026-08-21T18:14:55.301392248Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:14:55.705941051Z INFO 08-21 18:14:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ee33a4b442744eb582f67f0ea84eea67 logical_start=0 logical_end=8192 capped_end=64 physical_query_tokens=64
2026-08-21T18:15:38.141903859Z INFO 08-21 18:15:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ee33a4b442744eb582f67f0ea84eea67 logical_start=32832 logical_end=38041 capped_end=38032 physical_query_tokens=5200
2026-08-21T18:17:33.629680901Z WARNING 08-21 18:17:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=1016 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=26 tool_msgs=246 assistant_tool_msgs=246 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:17:33.629954748Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:17:33.832741027Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:17:34.096770269Z INFO 08-21 18:17:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-dcdcb050e9b54ae987795bc0c165915a checkpoint_tokens=7184 logical_tokens=7197 physical_query_tokens=13
2026-08-21T18:17:46.880784728Z WARNING 08-21 18:17:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=82 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=36 assistant_tool_msgs=34 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:17:46.881019500Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:17:46.919034677Z WARNING 08-21 18:17:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=1018 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=26 tool_msgs=247 assistant_tool_msgs=247 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:17:46.919182904Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:17:47.118813869Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:17:47.394614549Z INFO 08-21 18:17:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7f75354fae9540818b5875bb164de27f checkpoint_tokens=14400 logical_tokens=15606 physical_query_tokens=1206
2026-08-21T18:17:47.394649669Z INFO 08-21 18:17:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7f75354fae9540818b5875bb164de27f logical_start=14400 logical_end=15606 capped_end=15600 physical_query_tokens=1200
2026-08-21T18:18:22.881941639Z WARNING 08-21 18:18:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=86 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=38 assistant_tool_msgs=36 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:18:22.882126947Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:18:22.904785550Z WARNING 08-21 18:18:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=84 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=37 assistant_tool_msgs=35 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:18:22.904927918Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:18:23.079603153Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:18:23.338426472Z INFO 08-21 18:18:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-768216cc6cce48ee95d14b68f55e5dfe logical_start=0 logical_end=1406 capped_end=1392 physical_query_tokens=1392
2026-08-21T18:18:53.603217370Z WARNING 08-21 18:18:53 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=11 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=5 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:18:53.603399884Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:18:53.764684262Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:18:53.891664204Z INFO 08-21 18:18:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cb7184502b5242e39e6f14fed36a77f3 logical_start=0 logical_end=131 capped_end=128 physical_query_tokens=128
2026-08-21T18:22:30.299766682Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:22:30.631977320Z INFO 08-21 18:22:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-df775c67254240e2a952aefeff536a01 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T18:22:34.364532409Z INFO 08-21 18:22:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-df775c67254240e2a952aefeff536a01 logical_start=8192 logical_end=16328 capped_end=16320 physical_query_tokens=8128
2026-08-21T18:23:16.756961752Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:23:16.889709175Z INFO 08-21 18:23:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eac1aaf98aef49b2898518cf7ddc5d6a logical_start=0 logical_end=972 capped_end=960 physical_query_tokens=960
2026-08-21T18:27:30.594091257Z WARNING 08-21 18:27:30 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=14 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=6 assistant_tool_msgs=3 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:27:30.594387032Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:27:30.791008200Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:27:31.064459898Z INFO 08-21 18:27:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-092cc5941e214a819da7e8f2bd55c87f checkpoint_tokens=7424 logical_tokens=7433 physical_query_tokens=9
2026-08-21T18:27:58.574327856Z WARNING 08-21 18:27:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=16 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=20 tool_msgs=7 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:27:58.574535365Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:27:58.780538863Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:27:59.059632127Z INFO 08-21 18:27:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-302d489f54e34b21b7b9d88c225d376f checkpoint_tokens=16320 logical_tokens=16384 physical_query_tokens=64
2026-08-21T18:28:01.284190396Z INFO 08-21 18:28:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-302d489f54e34b21b7b9d88c225d376f logical_start=16384 logical_end=16885 capped_end=16880 physical_query_tokens=496
2026-08-21T18:28:33.847369982Z WARNING 08-21 18:28:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=13 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=6 assistant_tool_msgs=5 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:28:33.847562239Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:28:33.876298280Z WARNING 08-21 18:28:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=336 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=33 assistant_tool_msgs=33 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:28:33.876439377Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:28:33.920387230Z WARNING 08-21 18:28:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=398 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=68 assistant_tool_msgs=63 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:28:33.920526183Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:28:33.957789381Z WARNING 08-21 18:28:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=335 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=32 assistant_tool_msgs=32 strict_false=0 strict_true=0 choice=auto images=1 image_data=1 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:28:33.957928816Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:28:34.174711925Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:28:34.944597193Z INFO 08-21 18:28:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-db9f09b7e8a94d30bd791a6f882e8bcc logical_start=0 logical_end=8192 capped_end=64 physical_query_tokens=64
2026-08-21T18:28:55.465876581Z INFO 08-21 18:28:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-db9f09b7e8a94d30bd791a6f882e8bcc logical_start=16448 logical_end=18613 capped_end=18608 physical_query_tokens=2160
2026-08-21T18:29:10.489828780Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:29:10.997271785Z INFO 08-21 18:29:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a195e12815f041fcb1a7804570aace4b checkpoint_tokens=64 logical_tokens=8192 physical_query_tokens=8128
2026-08-21T18:29:28.824393999Z INFO 08-21 18:29:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a195e12815f041fcb1a7804570aace4b logical_start=16384 logical_end=23226 capped_end=18560 physical_query_tokens=2176
2026-08-21T18:29:34.133757861Z INFO 08-21 18:29:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a195e12815f041fcb1a7804570aace4b logical_start=18560 logical_end=23226 capped_end=23216 physical_query_tokens=4656
2026-08-21T18:31:42.612575702Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:34:20.605060616Z INFO 08-21 18:34:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8db374b347f14cf384ad6def94ae7672 logical_start=98304 logical_end=99026 capped_end=99024 physical_query_tokens=720
2026-08-21T18:40:02.624900709Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:40:02.895443069Z INFO 08-21 18:40:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ac9790c693e44a20821c25e8541db43f checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T18:40:05.732243914Z INFO 08-21 18:40:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ac9790c693e44a20821c25e8541db43f logical_start=8192 logical_end=9191 capped_end=9184 physical_query_tokens=992
2026-08-21T18:40:27.219015908Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:40:27.546909368Z INFO 08-21 18:40:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fa6c192194c74514b66a4f7fcd919824 checkpoint_tokens=16320 logical_tokens=16384 physical_query_tokens=64
2026-08-21T18:40:29.768530211Z INFO 08-21 18:40:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fa6c192194c74514b66a4f7fcd919824 logical_start=16384 logical_end=24576 capped_end=16832 physical_query_tokens=448
2026-08-21T18:40:43.745430420Z INFO 08-21 18:40:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fa6c192194c74514b66a4f7fcd919824 logical_start=25024 logical_end=32804 capped_end=32800 physical_query_tokens=7776
2026-08-21T18:41:10.482938134Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:41:10.750111872Z INFO 08-21 18:41:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f6496f36b73044a1849cb604f5c28ea8 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T18:41:13.588079267Z INFO 08-21 18:41:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f6496f36b73044a1849cb604f5c28ea8 logical_start=8192 logical_end=9473 capped_end=9152 physical_query_tokens=960
2026-08-21T18:41:17.526955665Z INFO 08-21 18:41:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f6496f36b73044a1849cb604f5c28ea8 logical_start=9152 logical_end=9473 capped_end=9456 physical_query_tokens=304
2026-08-21T18:41:33.231875430Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:41:33.499982439Z INFO 08-21 18:41:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-13959d1512dd40a1b0c9ef8115cde7bf checkpoint_tokens=9152 logical_tokens=9815 physical_query_tokens=663
2026-08-21T18:41:33.500029948Z INFO 08-21 18:41:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-13959d1512dd40a1b0c9ef8115cde7bf logical_start=9152 logical_end=9815 capped_end=9472 physical_query_tokens=320
2026-08-21T18:41:36.749976552Z INFO 08-21 18:41:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-13959d1512dd40a1b0c9ef8115cde7bf logical_start=9472 logical_end=9815 capped_end=9808 physical_query_tokens=336
2026-08-21T18:41:54.699669628Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:41:54.965734194Z INFO 08-21 18:41:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5861dd6b71d943619d7a95f2ce1e867d checkpoint_tokens=9472 logical_tokens=9635 physical_query_tokens=163
2026-08-21T18:41:54.965771970Z INFO 08-21 18:41:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5861dd6b71d943619d7a95f2ce1e867d logical_start=9472 logical_end=9635 capped_end=9632 physical_query_tokens=160
2026-08-21T18:42:08.374302087Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:42:08.638319852Z INFO 08-21 18:42:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6bee1855930744fd8f81c8a8dc8ab150 checkpoint_tokens=7232 logical_tokens=7294 physical_query_tokens=62
2026-08-21T18:42:08.638356738Z INFO 08-21 18:42:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6bee1855930744fd8f81c8a8dc8ab150 logical_start=7232 logical_end=7294 capped_end=7280 physical_query_tokens=48
2026-08-21T18:42:16.678739589Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:42:17.017998378Z INFO 08-21 18:42:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3203b7d2148649cebcdfea2048fabe86 checkpoint_tokens=67008 logical_tokens=67262 physical_query_tokens=254
2026-08-21T18:42:17.018042014Z INFO 08-21 18:42:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3203b7d2148649cebcdfea2048fabe86 logical_start=67008 logical_end=67262 capped_end=67248 physical_query_tokens=240
2026-08-21T18:42:37.063109983Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:42:37.329374485Z INFO 08-21 18:42:37 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7b002d3b1be24aba908243e30147d87e checkpoint_tokens=9472 logical_tokens=10201 physical_query_tokens=729
2026-08-21T18:42:37.329415039Z INFO 08-21 18:42:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7b002d3b1be24aba908243e30147d87e logical_start=9472 logical_end=10201 capped_end=9792 physical_query_tokens=320
2026-08-21T18:42:40.502014527Z INFO 08-21 18:42:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7b002d3b1be24aba908243e30147d87e logical_start=9792 logical_end=10201 capped_end=10192 physical_query_tokens=400
2026-08-21T18:43:04.707796696Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:43:04.975872042Z INFO 08-21 18:43:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a75d26ad4f8b42949d0183d9ce0549a0 checkpoint_tokens=7360 logical_tokens=7776 physical_query_tokens=416
2026-08-21T18:43:04.975910942Z INFO 08-21 18:43:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a75d26ad4f8b42949d0183d9ce0549a0 logical_start=7360 logical_end=7776 capped_end=7760 physical_query_tokens=400
2026-08-21T18:43:18.239076383Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:43:18.504991511Z INFO 08-21 18:43:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b378079e21b44ddea13a2e19de9d543d checkpoint_tokens=7360 logical_tokens=7938 physical_query_tokens=578
2026-08-21T18:43:18.505026577Z INFO 08-21 18:43:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b378079e21b44ddea13a2e19de9d543d logical_start=7360 logical_end=7938 capped_end=7744 physical_query_tokens=384
2026-08-21T18:43:21.650356170Z INFO 08-21 18:43:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b378079e21b44ddea13a2e19de9d543d logical_start=7744 logical_end=7938 capped_end=7936 physical_query_tokens=192
2026-08-21T18:43:28.057741733Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:43:28.364751368Z INFO 08-21 18:43:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-84a36724b2964fa78426f93bee6c2340 checkpoint_tokens=16832 logical_tokens=24576 physical_query_tokens=7744
2026-08-21T18:43:49.090847621Z INFO 08-21 18:43:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-84a36724b2964fa78426f93bee6c2340 logical_start=32768 logical_end=35023 capped_end=35008 physical_query_tokens=2240
2026-08-21T18:44:22.572312600Z WARNING 08-21 18:44:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=400 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=68 assistant_tool_msgs=63 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:44:22.572539460Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:44:22.767487785Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:44:23.034800557Z INFO 08-21 18:44:23 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7985e2aced5a48d0a0a70fb780042296 checkpoint_tokens=9792 logical_tokens=10737 physical_query_tokens=945
2026-08-21T18:44:23.034839235Z INFO 08-21 18:44:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7985e2aced5a48d0a0a70fb780042296 logical_start=9792 logical_end=10737 capped_end=10176 physical_query_tokens=384
2026-08-21T18:44:26.429487537Z INFO 08-21 18:44:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7985e2aced5a48d0a0a70fb780042296 logical_start=10176 logical_end=10737 capped_end=10720 physical_query_tokens=544
2026-08-21T18:44:42.222360564Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:44:42.488345918Z INFO 08-21 18:44:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-12d4b4aa3a6f4a98aba6bf2ecb143dc9 checkpoint_tokens=10176 logical_tokens=11113 physical_query_tokens=937
2026-08-21T18:44:42.488384337Z INFO 08-21 18:44:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-12d4b4aa3a6f4a98aba6bf2ecb143dc9 logical_start=10176 logical_end=11113 capped_end=10688 physical_query_tokens=512
2026-08-21T18:44:46.099035088Z INFO 08-21 18:44:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-12d4b4aa3a6f4a98aba6bf2ecb143dc9 logical_start=10688 logical_end=11113 capped_end=11104 physical_query_tokens=416
2026-08-21T18:44:59.439890524Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:46:18.164228757Z INFO 08-21 18:46:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ae8ddac74e4b47cc88f4a8ab971a62f7 logical_start=57344 logical_end=65135 capped_end=65120 physical_query_tokens=7776
2026-08-21T18:47:02.073623109Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:47:02.207238462Z INFO 08-21 18:47:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e83e520606724e4fafcafb275cf0599c logical_start=0 logical_end=362 capped_end=352 physical_query_tokens=352
2026-08-21T18:51:42.098362184Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:51:42.232890261Z INFO 08-21 18:51:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1713c161b9764873ad8df57037d1994a logical_start=0 logical_end=358 capped_end=352 physical_query_tokens=352
2026-08-21T18:55:31.989553615Z WARNING 08-21 18:55:31 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=88 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=38 assistant_tool_msgs=36 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T18:55:31.989839735Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:55:32.191319300Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:55:32.465375966Z INFO 08-21 18:55:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-40fd50fb1a954322abd6dfeb88d2cc28 checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T18:56:07.104943670Z ERROR 08-21 18:56:07 serving_chat.py:345] Error in applying chat template from request
2026-08-21T18:56:07.104955233Z ERROR 08-21 18:56:07 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T18:56:07.104957597Z ERROR 08-21 18:56:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T18:56:07.104959911Z ERROR 08-21 18:56:07 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T18:56:07.104962043Z ERROR 08-21 18:56:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T18:56:07.104964362Z ERROR 08-21 18:56:07 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T18:56:07.104966493Z ERROR 08-21 18:56:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T18:56:07.104975481Z ERROR 08-21 18:56:07 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T18:56:07.104977677Z ERROR 08-21 18:56:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T18:56:07.104979941Z ERROR 08-21 18:56:07 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T18:56:07.104981944Z ERROR 08-21 18:56:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T18:56:07.104984017Z ERROR 08-21 18:56:07 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T18:56:07.104985997Z ERROR 08-21 18:56:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T18:56:07.104988179Z ERROR 08-21 18:56:07 serving_chat.py:345] raise ValueError(
2026-08-21T18:56:07.104990010Z ERROR 08-21 18:56:07 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T18:56:07.105233480Z WARNING 08-21 18:56:07 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=90 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=74 tool_msgs=37 assistant_tool_msgs=37 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T18:56:07.105468817Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T18:56:07.311266087Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:56:07.601445797Z INFO 08-21 18:56:07 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-eae0693f23ed4473bff6f9d72bde4dd9 checkpoint_tokens=10688 logical_tokens=12285 physical_query_tokens=1597
2026-08-21T18:56:07.601485541Z INFO 08-21 18:56:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eae0693f23ed4473bff6f9d72bde4dd9 logical_start=10688 logical_end=12285 capped_end=11072 physical_query_tokens=384
2026-08-21T18:56:10.986840946Z INFO 08-21 18:56:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eae0693f23ed4473bff6f9d72bde4dd9 logical_start=11072 logical_end=12285 capped_end=12272 physical_query_tokens=1200
2026-08-21T18:56:33.251194198Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:56:33.523851356Z INFO 08-21 18:56:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8fabefad63f142628133073ec529a824 checkpoint_tokens=11072 logical_tokens=12382 physical_query_tokens=1310
2026-08-21T18:56:33.523893914Z INFO 08-21 18:56:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8fabefad63f142628133073ec529a824 logical_start=11072 logical_end=12382 capped_end=12224 physical_query_tokens=1152
2026-08-21T18:56:37.899412346Z INFO 08-21 18:56:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8fabefad63f142628133073ec529a824 logical_start=12224 logical_end=12382 capped_end=12368 physical_query_tokens=144
2026-08-21T18:56:47.630059509Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:56:48.632501231Z INFO 08-21 18:56:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ae2f2927c39e4e9e97d4a23b3d70e204 logical_start=0 logical_end=8192 capped_end=4224 physical_query_tokens=4224
2026-08-21T18:59:03.525479184Z INFO 08-21 18:59:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ae2f2927c39e4e9e97d4a23b3d70e204 logical_start=86144 logical_end=86747 capped_end=86736 physical_query_tokens=592
2026-08-21T18:59:54.787142869Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T18:59:55.097938027Z INFO 08-21 18:59:55 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ee79a70433204ac3824be2113f06e494 checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:00:42.986328361Z INFO 08-21 19:00:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ee79a70433204ac3824be2113f06e494 logical_start=40960 logical_end=43817 capped_end=43808 physical_query_tokens=2848
2026-08-21T19:01:07.729003249Z ERROR 08-21 19:01:07 serving_chat.py:345] Error in applying chat template from request
2026-08-21T19:01:07.729008502Z ERROR 08-21 19:01:07 serving_chat.py:345] Traceback (most recent call last):
2026-08-21T19:01:07.729010980Z ERROR 08-21 19:01:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/openai/serving_chat.py", line 313, in create_chat_completion
2026-08-21T19:01:07.729013473Z ERROR 08-21 19:01:07 serving_chat.py:345] conversation, mm_data_future = parse_chat_messages_futures(
2026-08-21T19:01:07.729015476Z ERROR 08-21 19:01:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 565, in parse_chat_messages_futures
2026-08-21T19:01:07.729017603Z ERROR 08-21 19:01:07 serving_chat.py:345] sub_messages = _parse_chat_message_content(msg, mm_tracker)
2026-08-21T19:01:07.729019597Z ERROR 08-21 19:01:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 476, in _parse_chat_message_content
2026-08-21T19:01:07.729021774Z ERROR 08-21 19:01:07 serving_chat.py:345] result = _parse_chat_message_content_parts(
2026-08-21T19:01:07.729023652Z ERROR 08-21 19:01:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 428, in _parse_chat_message_content_parts
2026-08-21T19:01:07.729025740Z ERROR 08-21 19:01:07 serving_chat.py:345] mm_parser.parse_image(image_url["url"])
2026-08-21T19:01:07.729027841Z ERROR 08-21 19:01:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 310, in parse_image
2026-08-21T19:01:07.729037071Z ERROR 08-21 19:01:07 serving_chat.py:345] placeholder = self._tracker.add("image", image_coro)
2026-08-21T19:01:07.729039285Z ERROR 08-21 19:01:07 serving_chat.py:345] File "/usr/local/corex/lib64/python3/dist-packages/vllm/entrypoints/chat_utils.py", line 219, in add
2026-08-21T19:01:07.729041393Z ERROR 08-21 19:01:07 serving_chat.py:345] raise ValueError(
2026-08-21T19:01:07.729043309Z ERROR 08-21 19:01:07 serving_chat.py:345] ValueError: At most 1 image(s) may be provided in one request.
2026-08-21T19:01:07.729281161Z WARNING 08-21 19:01:07 api_server.py:434] [BI100 4XX] endpoint=chat code=400 reason=image_count_limit messages=92 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=74 tool_msgs=38 assistant_tool_msgs=38 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=1
2026-08-21T19:01:07.729528597Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:01:07.746738764Z WARNING 08-21 19:01:07 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=17 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=8 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:01:07.746874087Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:01:07.959808650Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:01:08.235708134Z INFO 08-21 19:01:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-09f8a001aee5499099d93bc42e646fe3 checkpoint_tokens=12224 logical_tokens=12893 physical_query_tokens=669
2026-08-21T19:01:08.235747937Z INFO 08-21 19:01:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-09f8a001aee5499099d93bc42e646fe3 logical_start=12224 logical_end=12893 capped_end=12352 physical_query_tokens=128
2026-08-21T19:01:11.109126785Z INFO 08-21 19:01:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-09f8a001aee5499099d93bc42e646fe3 logical_start=12352 logical_end=12893 capped_end=12880 physical_query_tokens=528
2026-08-21T19:01:23.355174491Z WARNING 08-21 19:01:23 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=98 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=43 assistant_tool_msgs=41 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:01:23.355341475Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:01:23.384316175Z WARNING 08-21 19:01:23 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=94 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=41 assistant_tool_msgs=39 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:01:23.384458261Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:01:23.570728298Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:01:23.846546415Z INFO 08-21 19:01:23 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ce0a018db5d14099bcd75a7628dbac18 checkpoint_tokens=12352 logical_tokens=13205 physical_query_tokens=853
2026-08-21T19:01:23.846592345Z INFO 08-21 19:01:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ce0a018db5d14099bcd75a7628dbac18 logical_start=12352 logical_end=13205 capped_end=12864 physical_query_tokens=512
2026-08-21T19:01:27.332052778Z INFO 08-21 19:01:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ce0a018db5d14099bcd75a7628dbac18 logical_start=12864 logical_end=13205 capped_end=13200 physical_query_tokens=336
2026-08-21T19:02:12.506930206Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:02:12.821911589Z INFO 08-21 19:02:12 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-bba95f0e3e8b42969ab90d53952c3d2c checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:03:13.530672820Z INFO 08-21 19:03:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-bba95f0e3e8b42969ab90d53952c3d2c logical_start=49152 logical_end=52221 capped_end=52208 physical_query_tokens=3056
2026-08-21T19:03:27.870483105Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:03:28.149942077Z INFO 08-21 19:03:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8c7cd17a6c648559c497ff1538ea9fe logical_start=0 logical_end=8192 capped_end=7168 physical_query_tokens=7168
2026-08-21T19:03:36.065989471Z INFO 08-21 19:03:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8c7cd17a6c648559c497ff1538ea9fe logical_start=7168 logical_end=8916 capped_end=8912 physical_query_tokens=1744
2026-08-21T19:03:56.921385236Z WARNING 08-21 19:03:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=96 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=42 assistant_tool_msgs=40 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:03:56.921593919Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:03:57.201953102Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:03:57.520872561Z INFO 08-21 19:03:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5746c10879114447abada03ce2532f76 checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:04:58.167133801Z INFO 08-21 19:04:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5746c10879114447abada03ce2532f76 logical_start=49152 logical_end=55905 capped_end=55888 physical_query_tokens=6736
2026-08-21T19:05:48.225648625Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:05:48.538790645Z INFO 08-21 19:05:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d8508992dcab4ed8b2a1c4edb224092a checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:06:49.120852473Z INFO 08-21 19:06:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8508992dcab4ed8b2a1c4edb224092a logical_start=49152 logical_end=52353 capped_end=52336 physical_query_tokens=3184
2026-08-21T19:07:08.459804398Z WARNING 08-21 19:07:08 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=100 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=44 assistant_tool_msgs=42 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:07:08.460058046Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:07:08.747617727Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:07:09.060662578Z INFO 08-21 19:07:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-29ab4a7f252b4f79a01ab918fc9c38a1 checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:08:09.752258602Z INFO 08-21 19:08:09 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-29ab4a7f252b4f79a01ab918fc9c38a1 logical_start=49152 logical_end=52497 capped_end=52480 physical_query_tokens=3328
2026-08-21T19:08:29.466690733Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:08:29.735938642Z INFO 08-21 19:08:29 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7d687e140e904d04aed0577a74474c46 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T19:08:33.771772024Z INFO 08-21 19:08:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7d687e140e904d04aed0577a74474c46 logical_start=8192 logical_end=9237 capped_end=8896 physical_query_tokens=704
2026-08-21T19:08:37.565415183Z INFO 08-21 19:08:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7d687e140e904d04aed0577a74474c46 logical_start=8896 logical_end=9237 capped_end=9232 physical_query_tokens=336
2026-08-21T19:09:00.000083407Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:09:00.269559810Z INFO 08-21 19:09:00 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5e56f2fc50654c43bad3e22e53a52113 checkpoint_tokens=8896 logical_tokens=9651 physical_query_tokens=755
2026-08-21T19:09:00.269594591Z INFO 08-21 19:09:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5e56f2fc50654c43bad3e22e53a52113 logical_start=8896 logical_end=9651 capped_end=9216 physical_query_tokens=320
2026-08-21T19:09:03.573411303Z INFO 08-21 19:09:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5e56f2fc50654c43bad3e22e53a52113 logical_start=9216 logical_end=9651 capped_end=9648 physical_query_tokens=432
2026-08-21T19:09:12.795321784Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:09:13.058858476Z INFO 08-21 19:09:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c272dacccc6e4b83a378f2b7810c93b9 logical_start=0 logical_end=7197 capped_end=7184 physical_query_tokens=7184
2026-08-21T19:09:36.838060729Z WARNING 08-21 19:09:36 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=104 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=46 assistant_tool_msgs=44 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:09:36.838239869Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:09:37.016063138Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:09:37.281115375Z INFO 08-21 19:09:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4bf5c44e545442b8369efc001cfddb1 logical_start=0 logical_end=7426 capped_end=7232 physical_query_tokens=7232
2026-08-21T19:09:45.253952455Z INFO 08-21 19:09:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4bf5c44e545442b8369efc001cfddb1 logical_start=7232 logical_end=7426 capped_end=7424 physical_query_tokens=192
2026-08-21T19:09:54.242949395Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:09:54.534301885Z INFO 08-21 19:09:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cf328887a5ba4e88a6bfb8ca43aac919 checkpoint_tokens=9216 logical_tokens=12431 physical_query_tokens=3215
2026-08-21T19:09:54.534333157Z INFO 08-21 19:09:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cf328887a5ba4e88a6bfb8ca43aac919 logical_start=9216 logical_end=12431 capped_end=9600 physical_query_tokens=384
2026-08-21T19:09:57.841706557Z INFO 08-21 19:09:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cf328887a5ba4e88a6bfb8ca43aac919 logical_start=9600 logical_end=12431 capped_end=12416 physical_query_tokens=2816
2026-08-21T19:10:29.694379414Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:10:29.958979555Z INFO 08-21 19:10:29 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2b534f43489b4839867aca0a4b9a63a5 checkpoint_tokens=7424 logical_tokens=7530 physical_query_tokens=106
2026-08-21T19:10:29.959016206Z INFO 08-21 19:10:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2b534f43489b4839867aca0a4b9a63a5 logical_start=7424 logical_end=7530 capped_end=7520 physical_query_tokens=96
2026-08-21T19:10:36.709437404Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:10:37.002333911Z INFO 08-21 19:10:37 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4d810e5015b24f3f9e1bb0e24367f8c4 checkpoint_tokens=12416 logical_tokens=15698 physical_query_tokens=3282
2026-08-21T19:10:37.002370198Z INFO 08-21 19:10:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4d810e5015b24f3f9e1bb0e24367f8c4 logical_start=12416 logical_end=15698 capped_end=15696 physical_query_tokens=3280
2026-08-21T19:11:04.179378892Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:11:04.448954959Z INFO 08-21 19:11:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-57234412b6f046d48a2ab68c725f054e checkpoint_tokens=12416 logical_tokens=13212 physical_query_tokens=796
2026-08-21T19:11:04.448994624Z INFO 08-21 19:11:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-57234412b6f046d48a2ab68c725f054e logical_start=12416 logical_end=13212 capped_end=13200 physical_query_tokens=784
2026-08-21T19:12:03.825645301Z WARNING 08-21 19:12:03 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=19 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=24 tool_msgs=9 assistant_tool_msgs=8 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:12:03.825902771Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:12:04.030176889Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:12:04.296151181Z INFO 08-21 19:12:04 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f69c3860c95444bfa460941c2e868192 checkpoint_tokens=7424 logical_tokens=7843 physical_query_tokens=419
2026-08-21T19:12:04.296190670Z INFO 08-21 19:12:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f69c3860c95444bfa460941c2e868192 logical_start=7424 logical_end=7843 capped_end=7488 physical_query_tokens=64
2026-08-21T19:12:06.467532218Z INFO 08-21 19:12:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f69c3860c95444bfa460941c2e868192 logical_start=7488 logical_end=7843 capped_end=7840 physical_query_tokens=352
2026-08-21T19:12:12.810220135Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:12:12.940015732Z INFO 08-21 19:12:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-94fc7d05992a48b5afdb27aceb0e0fff logical_start=0 logical_end=548 capped_end=544 physical_query_tokens=544
2026-08-21T19:18:17.434247143Z WARNING 08-21 19:18:17 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=102 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=45 assistant_tool_msgs=43 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:18:17.434542012Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:18:17.455822130Z WARNING 08-21 19:18:17 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=92 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=43 assistant_tool_msgs=39 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:18:17.455958463Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:18:17.656623212Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:18:17.936658781Z INFO 08-21 19:18:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cc9f43a6f785448680a6639a901c48b9 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T19:18:17.936701474Z INFO 08-21 19:18:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cc9f43a6f785448680a6639a901c48b9 logical_start=8000 logical_end=8192 capped_end=8128 physical_query_tokens=128
2026-08-21T19:18:20.531986860Z INFO 08-21 19:18:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cc9f43a6f785448680a6639a901c48b9 logical_start=8128 logical_end=9201 capped_end=9184 physical_query_tokens=1056
2026-08-21T19:18:39.199055710Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:18:43.721442851Z INFO 08-21 19:18:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-faf84aef0a284d6da26459a34e2e104a logical_start=0 logical_end=8192 capped_end=6464 physical_query_tokens=6464
2026-08-21T19:20:30.197224736Z INFO 08-21 19:20:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-faf84aef0a284d6da26459a34e2e104a logical_start=72000 logical_end=76677 capped_end=76672 physical_query_tokens=4672
2026-08-21T19:20:53.098787273Z WARNING 08-21 19:20:53 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=94 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=44 assistant_tool_msgs=40 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:20:53.099141380Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:20:53.280882603Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:20:53.413767359Z INFO 08-21 19:20:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-65ad18c8f7f44c68b6f0f892c203b569 logical_start=0 logical_end=593 capped_end=448 physical_query_tokens=448
2026-08-21T19:20:56.417764324Z INFO 08-21 19:20:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-65ad18c8f7f44c68b6f0f892c203b569 logical_start=448 logical_end=593 capped_end=576 physical_query_tokens=128
2026-08-21T19:25:31.902613684Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:25:32.199528157Z INFO 08-21 19:25:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d039f1bf2495423a9717c46559863394 checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:25:57.518538491Z INFO 08-21 19:25:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d039f1bf2495423a9717c46559863394 logical_start=24576 logical_end=25460 capped_end=25456 physical_query_tokens=880
2026-08-21T19:26:45.541865074Z WARNING 08-21 19:26:45 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=72 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=28 assistant_tool_msgs=28 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:26:45.542108859Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:26:45.818596277Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:26:46.128856721Z INFO 08-21 19:26:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-349d13ddf79c4933a78a1bbecd4f7970 checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:27:33.974817272Z INFO 08-21 19:27:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-349d13ddf79c4933a78a1bbecd4f7970 logical_start=40960 logical_end=43310 capped_end=43296 physical_query_tokens=2336
2026-08-21T19:28:10.122265248Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:28:10.450115347Z INFO 08-21 19:28:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-51166256621245b494bf775db46c4b3a checkpoint_tokens=8128 logical_tokens=8192 physical_query_tokens=64
2026-08-21T19:28:12.451439140Z INFO 08-21 19:28:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-51166256621245b494bf775db46c4b3a logical_start=8192 logical_end=10801 capped_end=9152 physical_query_tokens=960
2026-08-21T19:28:16.417818616Z INFO 08-21 19:28:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-51166256621245b494bf775db46c4b3a logical_start=9152 logical_end=10801 capped_end=10784 physical_query_tokens=1632
2026-08-21T19:28:33.560959716Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:28:33.831930883Z INFO 08-21 19:28:33 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-dc632b726ae0488f8c9ad6167a6a9aec checkpoint_tokens=9152 logical_tokens=10482 physical_query_tokens=1330
2026-08-21T19:28:33.831966029Z INFO 08-21 19:28:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-dc632b726ae0488f8c9ad6167a6a9aec logical_start=9152 logical_end=10482 capped_end=10480 physical_query_tokens=1328
2026-08-21T19:28:51.939753050Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:28:52.265042077Z INFO 08-21 19:28:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-47e6ebbc36fa4f15a65db390e8e1e8db checkpoint_tokens=4224 logical_tokens=8192 physical_query_tokens=3968
2026-08-21T19:30:06.288607557Z INFO 08-21 19:30:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-47e6ebbc36fa4f15a65db390e8e1e8db logical_start=57344 logical_end=58375 capped_end=58368 physical_query_tokens=1024
2026-08-21T19:30:40.085865019Z WARNING 08-21 19:30:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=121 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=29 assistant_tool_msgs=28 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:30:40.086134304Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:30:40.114890436Z WARNING 08-21 19:30:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=108 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=47 assistant_tool_msgs=45 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:30:40.115033503Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:30:40.143362777Z WARNING 08-21 19:30:40 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=110 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=48 assistant_tool_msgs=46 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:30:40.143501216Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:30:40.326591100Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:30:40.457208055Z INFO 08-21 19:30:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-44649b7f5a334a8f94700e782f0dea4a checkpoint_tokens=448 logical_tokens=542 physical_query_tokens=94
2026-08-21T19:30:40.457251076Z INFO 08-21 19:30:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-44649b7f5a334a8f94700e782f0dea4a logical_start=448 logical_end=542 capped_end=528 physical_query_tokens=80
2026-08-21T19:36:39.677536158Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:36:40.027449547Z INFO 08-21 19:36:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-00732b9d83104d259e85798fab553a74 checkpoint_tokens=9152 logical_tokens=13038 physical_query_tokens=3886
2026-08-21T19:36:40.027490499Z INFO 08-21 19:36:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-00732b9d83104d259e85798fab553a74 logical_start=9152 logical_end=13038 capped_end=10752 physical_query_tokens=1600
2026-08-21T19:36:44.652785180Z INFO 08-21 19:36:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-00732b9d83104d259e85798fab553a74 logical_start=10752 logical_end=13038 capped_end=13024 physical_query_tokens=2272
2026-08-21T19:37:01.063847894Z WARNING 08-21 19:37:01 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=98 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=36 tool_msgs=46 assistant_tool_msgs=42 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:37:01.064099124Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:37:01.237059202Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:37:01.368564642Z INFO 08-21 19:37:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ac5f42983014441f86a59a62890f2eea checkpoint_tokens=448 logical_tokens=569 physical_query_tokens=121
2026-08-21T19:37:01.368607872Z INFO 08-21 19:37:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ac5f42983014441f86a59a62890f2eea logical_start=448 logical_end=569 capped_end=560 physical_query_tokens=112
2026-08-21T19:41:37.878283860Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:41:38.173941592Z INFO 08-21 19:41:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d8c218b47cc44f769506a222ee880636 checkpoint_tokens=10752 logical_tokens=13403 physical_query_tokens=2651
2026-08-21T19:41:38.173983252Z INFO 08-21 19:41:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8c218b47cc44f769506a222ee880636 logical_start=10752 logical_end=13403 capped_end=12992 physical_query_tokens=2240
2026-08-21T19:41:43.352459823Z INFO 08-21 19:41:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d8c218b47cc44f769506a222ee880636 logical_start=12992 logical_end=13403 capped_end=13392 physical_query_tokens=400
2026-08-21T19:42:03.583787941Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:42:03.713533619Z INFO 08-21 19:42:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d171b97010264d5f9be93727f306e1a5 checkpoint_tokens=448 logical_tokens=537 physical_query_tokens=89
2026-08-21T19:42:03.713573177Z INFO 08-21 19:42:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d171b97010264d5f9be93727f306e1a5 logical_start=448 logical_end=537 capped_end=528 physical_query_tokens=80
2026-08-21T19:46:57.033835326Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:46:57.310997020Z INFO 08-21 19:46:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2fcae866e3a34ec2a88bdfc382cafb73 checkpoint_tokens=7184 logical_tokens=7197 physical_query_tokens=13
2026-08-21T19:47:09.339916979Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:47:09.618520735Z INFO 08-21 19:47:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-cae8ecc9a3f64ea09d165f8e6fd317f5 checkpoint_tokens=12992 logical_tokens=13641 physical_query_tokens=649
2026-08-21T19:47:09.618565940Z INFO 08-21 19:47:09 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cae8ecc9a3f64ea09d165f8e6fd317f5 logical_start=12992 logical_end=13641 capped_end=13376 physical_query_tokens=384
2026-08-21T19:47:13.102978359Z INFO 08-21 19:47:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-cae8ecc9a3f64ea09d165f8e6fd317f5 logical_start=13376 logical_end=13641 capped_end=13632 physical_query_tokens=256
2026-08-21T19:47:22.508279969Z WARNING 08-21 19:47:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=114 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=50 assistant_tool_msgs=48 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:47:22.508487692Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:47:22.665322648Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:47:22.795815579Z INFO 08-21 19:47:22 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-06682256b227494286e8a238335678d5 checkpoint_tokens=448 logical_tokens=537 physical_query_tokens=89
2026-08-21T19:47:22.795852768Z INFO 08-21 19:47:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-06682256b227494286e8a238335678d5 logical_start=448 logical_end=537 capped_end=528 physical_query_tokens=80
2026-08-21T19:52:25.137278640Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:52:25.423014618Z INFO 08-21 19:52:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9be0de4255324fb6b5a77f5935cb052a logical_start=0 logical_end=7666 capped_end=7232 physical_query_tokens=7232
2026-08-21T19:52:33.402291790Z INFO 08-21 19:52:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9be0de4255324fb6b5a77f5935cb052a logical_start=7232 logical_end=7666 capped_end=7664 physical_query_tokens=432
2026-08-21T19:52:39.727960116Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:52:40.006283531Z INFO 08-21 19:52:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1f71bc7c74c0445dbe53796ebf78828c checkpoint_tokens=13632 logical_tokens=13859 physical_query_tokens=227
2026-08-21T19:52:40.006320544Z INFO 08-21 19:52:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1f71bc7c74c0445dbe53796ebf78828c logical_start=13632 logical_end=13859 capped_end=13856 physical_query_tokens=224
2026-08-21T19:52:56.294236243Z WARNING 08-21 19:52:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=116 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=51 assistant_tool_msgs=49 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:52:56.294433892Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:52:56.319925183Z WARNING 08-21 19:52:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=118 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=52 assistant_tool_msgs=50 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T19:52:56.320059955Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T19:52:56.621035400Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T19:52:57.077204158Z INFO 08-21 19:52:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3e894086c41b4a1aa85a3e54236bbacd checkpoint_tokens=58368 logical_tokens=65536 physical_query_tokens=7168
2026-08-21T19:52:57.077257259Z INFO 08-21 19:52:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3e894086c41b4a1aa85a3e54236bbacd logical_start=58368 logical_end=65536 capped_end=65088 physical_query_tokens=6720
2026-08-21T19:53:09.620805800Z INFO 08-21 19:53:09 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3e894086c41b4a1aa85a3e54236bbacd logical_start=65088 logical_end=70311 capped_end=70304 physical_query_tokens=5216
2026-08-21T20:12:36.708398874Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:12:36.987875968Z INFO 08-21 20:12:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-82d3eb547d4b46f294452606f38651bb checkpoint_tokens=6464 logical_tokens=8192 physical_query_tokens=1728
2026-08-21T20:12:50.945822440Z INFO 08-21 20:12:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-82d3eb547d4b46f294452606f38651bb logical_start=16384 logical_end=18593 capped_end=18432 physical_query_tokens=2048
2026-08-21T20:12:56.065147025Z INFO 08-21 20:12:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-82d3eb547d4b46f294452606f38651bb logical_start=18432 logical_end=18593 capped_end=18576 physical_query_tokens=144
2026-08-21T20:13:07.064577455Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:13:07.191375255Z INFO 08-21 20:13:07 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fe4b7733817e4bd9b6879ccded931073 checkpoint_tokens=448 logical_tokens=540 physical_query_tokens=92
2026-08-21T20:13:07.191413029Z INFO 08-21 20:13:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fe4b7733817e4bd9b6879ccded931073 logical_start=448 logical_end=540 capped_end=528 physical_query_tokens=80
2026-08-21T20:17:46.776830695Z WARNING 08-21 20:17:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=402 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=68 assistant_tool_msgs=63 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:17:46.777112363Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:17:46.957530130Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:17:47.084889850Z INFO 08-21 20:17:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f261178b02454273a0f955fc424c1705 checkpoint_tokens=448 logical_tokens=540 physical_query_tokens=92
2026-08-21T20:17:47.084939378Z INFO 08-21 20:17:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f261178b02454273a0f955fc424c1705 logical_start=448 logical_end=540 capped_end=528 physical_query_tokens=80
2026-08-21T20:22:36.483387756Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:22:36.756886748Z INFO 08-21 20:22:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e80cf7e10fd048b380c68e74cdf12010 checkpoint_tokens=7168 logical_tokens=7229 physical_query_tokens=61
2026-08-21T20:22:36.756928377Z INFO 08-21 20:22:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e80cf7e10fd048b380c68e74cdf12010 logical_start=7168 logical_end=7229 capped_end=7216 physical_query_tokens=48
2026-08-21T20:23:11.578805689Z WARNING 08-21 20:23:11 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=124 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=55 assistant_tool_msgs=53 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:23:11.579054671Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:23:11.900310307Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:23:12.289702094Z INFO 08-21 20:23:12 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d714e069dc4c417eb76e28b02ff69799 checkpoint_tokens=65088 logical_tokens=65536 physical_query_tokens=448
2026-08-21T20:23:16.660495608Z INFO 08-21 20:23:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d714e069dc4c417eb76e28b02ff69799 logical_start=65536 logical_end=73728 capped_end=70272 physical_query_tokens=4736
2026-08-21T20:23:26.902139554Z INFO 08-21 20:23:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d714e069dc4c417eb76e28b02ff69799 logical_start=70272 logical_end=74146 capped_end=74144 physical_query_tokens=3872
2026-08-21T20:23:56.915574013Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:23:57.180707064Z INFO 08-21 20:23:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fedcc426683e4083a36f3c09213f3fb4 logical_start=0 logical_end=7772 capped_end=7424 physical_query_tokens=7424
2026-08-21T20:24:05.172835119Z INFO 08-21 20:24:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fedcc426683e4083a36f3c09213f3fb4 logical_start=7424 logical_end=7772 capped_end=7760 physical_query_tokens=336
2026-08-21T20:24:28.262115049Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:24:28.527650276Z INFO 08-21 20:24:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ed63846884a44420891a0a614969c6e1 checkpoint_tokens=7424 logical_tokens=7898 physical_query_tokens=474
2026-08-21T20:24:28.527690710Z INFO 08-21 20:24:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ed63846884a44420891a0a614969c6e1 logical_start=7424 logical_end=7898 capped_end=7744 physical_query_tokens=320
2026-08-21T20:24:31.680344023Z INFO 08-21 20:24:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ed63846884a44420891a0a614969c6e1 logical_start=7744 logical_end=7898 capped_end=7888 physical_query_tokens=144
2026-08-21T20:24:41.631574436Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:24:41.916782584Z INFO 08-21 20:24:41 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8a4f237907d940b1be939b542c0f3d51 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T20:24:41.916819462Z INFO 08-21 20:24:41 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8a4f237907d940b1be939b542c0f3d51 logical_start=7168 logical_end=8192 capped_end=7232 physical_query_tokens=64
2026-08-21T20:24:43.723549377Z INFO 08-21 20:24:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8a4f237907d940b1be939b542c0f3d51 logical_start=7232 logical_end=9390 capped_end=9376 physical_query_tokens=2144
2026-08-21T20:25:12.600022402Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:25:12.874262445Z INFO 08-21 20:25:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-351f2ad7a43d434ea6586b49405e6435 logical_start=0 logical_end=8192 capped_end=7680 physical_query_tokens=7680
2026-08-21T20:25:20.972549339Z INFO 08-21 20:25:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-351f2ad7a43d434ea6586b49405e6435 logical_start=7680 logical_end=8844 capped_end=8832 physical_query_tokens=1152
2026-08-21T20:25:46.208442232Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:25:46.477567958Z INFO 08-21 20:25:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c698d067f9264e8e9f876e67fb82366d checkpoint_tokens=8832 logical_tokens=9055 physical_query_tokens=223
2026-08-21T20:25:46.477615940Z INFO 08-21 20:25:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c698d067f9264e8e9f876e67fb82366d logical_start=8832 logical_end=9055 capped_end=9040 physical_query_tokens=208
2026-08-21T20:26:13.065233399Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:26:13.337788864Z INFO 08-21 20:26:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ba104cd44aa14723a5c59f63fee17f60 checkpoint_tokens=7744 logical_tokens=8192 physical_query_tokens=448
2026-08-21T20:26:13.337822482Z INFO 08-21 20:26:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ba104cd44aa14723a5c59f63fee17f60 logical_start=7744 logical_end=8192 capped_end=7872 physical_query_tokens=128
2026-08-21T20:26:16.018751349Z INFO 08-21 20:26:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ba104cd44aa14723a5c59f63fee17f60 logical_start=7872 logical_end=8828 capped_end=8816 physical_query_tokens=944
2026-08-21T20:26:53.462269587Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:26:53.734739054Z INFO 08-21 20:26:53 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-062deb3b73bf4a53aef8d4568105814e checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T20:26:57.684975231Z INFO 08-21 20:26:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-062deb3b73bf4a53aef8d4568105814e logical_start=8192 logical_end=10064 capped_end=9344 physical_query_tokens=1152
2026-08-21T20:27:01.689574565Z INFO 08-21 20:27:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-062deb3b73bf4a53aef8d4568105814e logical_start=9344 logical_end=10064 capped_end=10048 physical_query_tokens=704
2026-08-21T20:27:10.388857372Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:27:10.653397594Z INFO 08-21 20:27:10 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ca9127b9c72d4bdab6c225e96d5071a6 checkpoint_tokens=9344 logical_tokens=9859 physical_query_tokens=515
2026-08-21T20:27:10.653440792Z INFO 08-21 20:27:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ca9127b9c72d4bdab6c225e96d5071a6 logical_start=9344 logical_end=9859 capped_end=9856 physical_query_tokens=512
2026-08-21T20:27:35.837288870Z WARNING 08-21 20:27:35 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:27:35.837482323Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:27:36.017862779Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:27:36.307623006Z INFO 08-21 20:27:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-91ec642cc6054c3ebc5d1d1413e96ed4 checkpoint_tokens=10048 logical_tokens=13364 physical_query_tokens=3316
2026-08-21T20:27:36.307666928Z INFO 08-21 20:27:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91ec642cc6054c3ebc5d1d1413e96ed4 logical_start=10048 logical_end=13364 capped_end=13360 physical_query_tokens=3312
2026-08-21T20:27:59.797794646Z WARNING 08-21 20:27:59 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=4 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:27:59.798033000Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:27:59.993055407Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:28:00.260865350Z INFO 08-21 20:28:00 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-333fae739aad41aa94431612041c3d56 checkpoint_tokens=10048 logical_tokens=11594 physical_query_tokens=1546
2026-08-21T20:28:00.260903444Z INFO 08-21 20:28:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-333fae739aad41aa94431612041c3d56 logical_start=10048 logical_end=11594 capped_end=11584 physical_query_tokens=1536
2026-08-21T20:28:53.523829723Z WARNING 08-21 20:28:53 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=5 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=2 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:28:53.523994563Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:28:53.724107388Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:28:53.996727657Z INFO 08-21 20:28:53 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-870b7409941b49a8b4f80bb25007dc06 checkpoint_tokens=11584 logical_tokens=12381 physical_query_tokens=797
2026-08-21T20:28:53.996765881Z INFO 08-21 20:28:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-870b7409941b49a8b4f80bb25007dc06 logical_start=11584 logical_end=12381 capped_end=12368 physical_query_tokens=784
2026-08-21T20:29:28.925371127Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:29:57.242021711Z INFO 08-21 20:29:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6d3efc2be45241d4a93109eac5882274 logical_start=24576 logical_end=32768 capped_end=27200 physical_query_tokens=2624
2026-08-21T20:30:27.108007820Z INFO 08-21 20:30:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6d3efc2be45241d4a93109eac5882274 logical_start=43584 logical_end=46520 capped_end=46512 physical_query_tokens=2928
2026-08-21T20:30:42.318868035Z WARNING 08-21 20:30:42 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=74 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=29 assistant_tool_msgs=29 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:30:42.319145637Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:30:42.517277273Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:30:42.783239512Z INFO 08-21 20:30:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-815d924109b94ca4a327fe9af972bf7b checkpoint_tokens=7232 logical_tokens=7307 physical_query_tokens=75
2026-08-21T20:30:42.783266971Z INFO 08-21 20:30:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-815d924109b94ca4a327fe9af972bf7b logical_start=7232 logical_end=7307 capped_end=7296 physical_query_tokens=64
2026-08-21T20:30:52.411644854Z WARNING 08-21 20:30:52 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=128 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=56 assistant_tool_msgs=54 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:30:52.411821224Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:30:52.672006812Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:30:52.985194160Z INFO 08-21 20:30:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2e77c79f452c4f799d7fd6644b502728 checkpoint_tokens=27200 logical_tokens=32768 physical_query_tokens=5568
2026-08-21T20:31:13.475899469Z INFO 08-21 20:31:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2e77c79f452c4f799d7fd6644b502728 logical_start=40960 logical_end=46672 capped_end=46464 physical_query_tokens=5504
2026-08-21T20:31:23.161908627Z INFO 08-21 20:31:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2e77c79f452c4f799d7fd6644b502728 logical_start=46464 logical_end=46672 capped_end=46656 physical_query_tokens=192
2026-08-21T20:31:42.206377926Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:31:42.338056383Z INFO 08-21 20:31:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e8b291a9c078401fb7d6e046e257fad8 logical_start=0 logical_end=540 capped_end=528 physical_query_tokens=528
2026-08-21T20:37:16.563892046Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:37:44.747236220Z INFO 08-21 20:37:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d46f51e94c2b44b5a127ab202f155575 logical_start=24576 logical_end=32768 capped_end=27008 physical_query_tokens=2432
2026-08-21T20:38:14.283479109Z INFO 08-21 20:38:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d46f51e94c2b44b5a127ab202f155575 logical_start=43392 logical_end=46672 capped_end=46656 physical_query_tokens=3264
2026-08-21T20:38:42.741194225Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:38:43.010558508Z INFO 08-21 20:38:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e9349ae44ceb4f34a37c8b92d5b88b5e checkpoint_tokens=7296 logical_tokens=7755 physical_query_tokens=459
2026-08-21T20:38:43.010604196Z INFO 08-21 20:38:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e9349ae44ceb4f34a37c8b92d5b88b5e logical_start=7296 logical_end=7755 capped_end=7744 physical_query_tokens=448
2026-08-21T20:38:50.382714560Z WARNING 08-21 20:38:50 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=602 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=61 assistant_tool_msgs=61 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:38:50.382946325Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:38:50.410786157Z WARNING 08-21 20:38:50 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=125 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=30 assistant_tool_msgs=29 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:38:50.410927962Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:38:50.659628368Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:38:50.976646520Z INFO 08-21 20:38:50 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f7c36fa39bf74449813e1a10e141afb1 checkpoint_tokens=46656 logical_tokens=47569 physical_query_tokens=913
2026-08-21T20:38:50.976687260Z INFO 08-21 20:38:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f7c36fa39bf74449813e1a10e141afb1 logical_start=46656 logical_end=47569 capped_end=47552 physical_query_tokens=896
2026-08-21T20:39:09.135997505Z WARNING 08-21 20:39:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=9 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=4 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:39:09.136212056Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:39:09.150082966Z WARNING 08-21 20:39:09 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=15 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=8 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:39:09.150222244Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:39:09.345981205Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:39:09.629149071Z INFO 08-21 20:39:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a33676dcf0954f189c2798a381bca112 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T20:39:13.604015085Z INFO 08-21 20:39:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a33676dcf0954f189c2798a381bca112 logical_start=8192 logical_end=13359 capped_end=13344 physical_query_tokens=5152
2026-08-21T20:40:01.410778429Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:40:01.682148321Z INFO 08-21 20:40:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-295f44a10721449cbe2ed4206570ae6e checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T20:40:05.657373528Z INFO 08-21 20:40:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-295f44a10721449cbe2ed4206570ae6e logical_start=8192 logical_end=13902 capped_end=13312 physical_query_tokens=5120
2026-08-21T20:40:12.729926957Z INFO 08-21 20:40:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-295f44a10721449cbe2ed4206570ae6e logical_start=13312 logical_end=13902 capped_end=13888 physical_query_tokens=576
2026-08-21T20:40:39.443009346Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:40:39.721752135Z INFO 08-21 20:40:39 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1955c8d0ef694970ab6fb40e66cd68fc checkpoint_tokens=7872 logical_tokens=8192 physical_query_tokens=320
2026-08-21T20:40:42.815510634Z INFO 08-21 20:40:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1955c8d0ef694970ab6fb40e66cd68fc logical_start=8192 logical_end=13273 capped_end=8768 physical_query_tokens=576
2026-08-21T20:40:46.184873171Z INFO 08-21 20:40:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1955c8d0ef694970ab6fb40e66cd68fc logical_start=8768 logical_end=13273 capped_end=13264 physical_query_tokens=4496
2026-08-21T20:41:15.662394506Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:41:15.790503898Z INFO 08-21 20:41:15 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-35e3648f6ce843c9a8dc2c5dcb6cc3e9 checkpoint_tokens=528 logical_tokens=540 physical_query_tokens=12
2026-08-21T20:47:22.040879455Z WARNING 08-21 20:47:22 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=76 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=42 tool_msgs=30 assistant_tool_msgs=30 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:47:22.041159973Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:47:22.239576681Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:47:22.524656075Z INFO 08-21 20:47:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ff170b588f924fcbab11b49bce8950ad logical_start=0 logical_end=8031 capped_end=7424 physical_query_tokens=7424
2026-08-21T20:47:30.507997477Z INFO 08-21 20:47:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ff170b588f924fcbab11b49bce8950ad logical_start=7424 logical_end=8031 capped_end=8016 physical_query_tokens=592
2026-08-21T20:47:48.789715318Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:47:48.939576896Z INFO 08-21 20:47:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-40b8349803ea4939b8cbfe65a7fe3b94 logical_start=0 logical_end=1559 capped_end=1552 physical_query_tokens=1552
2026-08-21T20:52:02.340823228Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:52:02.635090504Z INFO 08-21 20:52:02 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-139a4926f4a744618ce1f84c2650728b checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T20:52:02.635121118Z INFO 08-21 20:52:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-139a4926f4a744618ce1f84c2650728b logical_start=7424 logical_end=8192 capped_end=8000 physical_query_tokens=576
2026-08-21T20:52:06.389518981Z INFO 08-21 20:52:06 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-139a4926f4a744618ce1f84c2650728b logical_start=8000 logical_end=9330 capped_end=9328 physical_query_tokens=1328
2026-08-21T20:52:47.740382298Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:52:48.175137640Z INFO 08-21 20:52:48 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2d062dedbcac47e790fd2e0a6e730ad6 logical_start=0 logical_end=8192 capped_end=7232 physical_query_tokens=7232
2026-08-21T20:53:16.015865724Z INFO 08-21 20:53:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2d062dedbcac47e790fd2e0a6e730ad6 logical_start=23616 logical_end=27546 capped_end=27536 physical_query_tokens=3920
2026-08-21T20:54:01.063365884Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:54:01.333062336Z INFO 08-21 20:54:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-63cafaaf0192411ea7125cace5637769 checkpoint_tokens=8000 logical_tokens=8192 physical_query_tokens=192
2026-08-21T20:54:04.117134552Z INFO 08-21 20:54:04 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-63cafaaf0192411ea7125cace5637769 logical_start=8192 logical_end=9612 capped_end=9280 physical_query_tokens=1088
2026-08-21T20:54:08.225311572Z INFO 08-21 20:54:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-63cafaaf0192411ea7125cace5637769 logical_start=9280 logical_end=9612 capped_end=9600 physical_query_tokens=320
2026-08-21T20:54:22.505918241Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:54:22.774704072Z INFO 08-21 20:54:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4587e88592fa42a88f1b38b0bbd9b05f logical_start=0 logical_end=7787 capped_end=7296 physical_query_tokens=7296
2026-08-21T20:54:30.674079204Z INFO 08-21 20:54:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4587e88592fa42a88f1b38b0bbd9b05f logical_start=7296 logical_end=7787 capped_end=7776 physical_query_tokens=480
2026-08-21T20:54:45.206616005Z WARNING 08-21 20:54:45 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=129 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=56 assistant_tool_msgs=54 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T20:54:45.206804533Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T20:54:45.393063474Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:54:45.667859827Z INFO 08-21 20:54:45 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6f2be80dfb584b21a539ada5f83bb8e3 checkpoint_tokens=8768 logical_tokens=15999 physical_query_tokens=7231
2026-08-21T20:54:45.667894291Z INFO 08-21 20:54:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6f2be80dfb584b21a539ada5f83bb8e3 logical_start=8768 logical_end=15999 capped_end=13248 physical_query_tokens=4480
2026-08-21T20:54:52.412957164Z INFO 08-21 20:54:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6f2be80dfb584b21a539ada5f83bb8e3 logical_start=13248 logical_end=15999 capped_end=15984 physical_query_tokens=2736
2026-08-21T20:55:40.219415079Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T20:55:40.345676327Z INFO 08-21 20:55:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0d2b73ba3ad146a3a106557498d34556 checkpoint_tokens=528 logical_tokens=540 physical_query_tokens=12
2026-08-21T21:02:41.215701036Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:02:41.501220132Z INFO 08-21 21:02:41 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d04d53ea4f824a36a54d26afd1b51074 checkpoint_tokens=7296 logical_tokens=8191 physical_query_tokens=895
2026-08-21T21:02:41.501255997Z INFO 08-21 21:02:41 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d04d53ea4f824a36a54d26afd1b51074 logical_start=7296 logical_end=8191 capped_end=7744 physical_query_tokens=448
2026-08-21T21:02:44.817433081Z INFO 08-21 21:02:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d04d53ea4f824a36a54d26afd1b51074 logical_start=7744 logical_end=8191 capped_end=8176 physical_query_tokens=432
2026-08-21T21:02:53.900136691Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:02:54.183088952Z INFO 08-21 21:02:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9e04b64de003457086b21f0b38aa4d3d logical_start=0 logical_end=8192 capped_end=7168 physical_query_tokens=7168
2026-08-21T21:03:01.981951536Z INFO 08-21 21:03:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9e04b64de003457086b21f0b38aa4d3d logical_start=7168 logical_end=8320 capped_end=8304 physical_query_tokens=1136
2026-08-21T21:03:30.377745805Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:03:30.644374366Z INFO 08-21 21:03:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e788f54e14364fa7aafe660ae514f6b3 checkpoint_tokens=7744 logical_tokens=8192 physical_query_tokens=448
2026-08-21T21:03:30.644417356Z INFO 08-21 21:03:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e788f54e14364fa7aafe660ae514f6b3 logical_start=7744 logical_end=8192 capped_end=8128 physical_query_tokens=384
2026-08-21T21:03:33.878410669Z INFO 08-21 21:03:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e788f54e14364fa7aafe660ae514f6b3 logical_start=8128 logical_end=8301 capped_end=8288 physical_query_tokens=160
2026-08-21T21:03:39.910646407Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:03:40.187560052Z INFO 08-21 21:03:40 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b54830e6355e45348a37e274e5535a5c checkpoint_tokens=9600 logical_tokens=10519 physical_query_tokens=919
2026-08-21T21:03:40.187596930Z INFO 08-21 21:03:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b54830e6355e45348a37e274e5535a5c logical_start=9600 logical_end=10519 capped_end=10512 physical_query_tokens=912
2026-08-21T21:04:16.107491199Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:04:16.452391967Z INFO 08-21 21:04:16 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4234b1b280294f2a81fd2d0b8c4b1eae checkpoint_tokens=70272 logical_tokens=73728 physical_query_tokens=3456
2026-08-21T21:04:25.107981353Z INFO 08-21 21:04:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4234b1b280294f2a81fd2d0b8c4b1eae logical_start=73728 logical_end=74000 capped_end=73984 physical_query_tokens=256
2026-08-21T21:12:29.460517954Z WARNING 08-21 21:12:29 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=17 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=8 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=2 image_data=2 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:12:29.460760194Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:12:29.668863742Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:12:29.952727775Z INFO 08-21 21:12:29 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0bc83a926b1240cbb177958592914082 checkpoint_tokens=9600 logical_tokens=11405 physical_query_tokens=1805
2026-08-21T21:12:29.952785704Z INFO 08-21 21:12:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0bc83a926b1240cbb177958592914082 logical_start=9600 logical_end=11405 capped_end=10496 physical_query_tokens=896
2026-08-21T21:12:33.957206523Z INFO 08-21 21:12:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0bc83a926b1240cbb177958592914082 logical_start=10496 logical_end=11405 capped_end=11392 physical_query_tokens=896
2026-08-21T21:12:51.137510091Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:12:51.423870240Z INFO 08-21 21:12:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-91da62dfa3a34a5c8e341e0c8d912b8a checkpoint_tokens=11392 logical_tokens=12577 physical_query_tokens=1185
2026-08-21T21:12:51.423909213Z INFO 08-21 21:12:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-91da62dfa3a34a5c8e341e0c8d912b8a logical_start=11392 logical_end=12577 capped_end=12560 physical_query_tokens=1168
2026-08-21T21:13:29.872043363Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:13:30.142685933Z INFO 08-21 21:13:30 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-75557520cc5a4f65b31d1757ed52855b checkpoint_tokens=11392 logical_tokens=12028 physical_query_tokens=636
2026-08-21T21:13:30.142730108Z INFO 08-21 21:13:30 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-75557520cc5a4f65b31d1757ed52855b logical_start=11392 logical_end=12028 capped_end=12016 physical_query_tokens=624
2026-08-21T21:13:52.289935232Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:13:52.561389448Z INFO 08-21 21:13:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-adaac2b297a74828ae5bb81355f66b48 checkpoint_tokens=7232 logical_tokens=7891 physical_query_tokens=659
2026-08-21T21:13:52.561424488Z INFO 08-21 21:13:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-adaac2b297a74828ae5bb81355f66b48 logical_start=7232 logical_end=7891 capped_end=7888 physical_query_tokens=656
2026-08-21T21:14:18.765228515Z WARNING 08-21 21:14:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=2 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=0 assistant_tool_msgs=0 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:14:18.765426878Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:14:18.779653422Z WARNING 08-21 21:14:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=19 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=8 assistant_tool_msgs=4 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:14:18.779788975Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:14:18.800912455Z WARNING 08-21 21:14:18 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=450 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=39 tool_msgs=110 assistant_tool_msgs=75 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:14:18.801051017Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:14:19.002029874Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:14:19.286735700Z INFO 08-21 21:14:19 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9af21ac7c6e249d7a0e7ed16ae4bbe52 checkpoint_tokens=11392 logical_tokens=13505 physical_query_tokens=2113
2026-08-21T21:14:19.286784649Z INFO 08-21 21:14:19 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9af21ac7c6e249d7a0e7ed16ae4bbe52 logical_start=11392 logical_end=13505 capped_end=12544 physical_query_tokens=1152
2026-08-21T21:14:23.464513539Z INFO 08-21 21:14:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9af21ac7c6e249d7a0e7ed16ae4bbe52 logical_start=12544 logical_end=13505 capped_end=13488 physical_query_tokens=944
2026-08-21T21:14:36.003538641Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:14:36.273080606Z INFO 08-21 21:14:36 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-760b5b9048fe493c963e70509720a5da checkpoint_tokens=12544 logical_tokens=13670 physical_query_tokens=1126
2026-08-21T21:14:36.273123611Z INFO 08-21 21:14:36 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-760b5b9048fe493c963e70509720a5da logical_start=12544 logical_end=13670 capped_end=13504 physical_query_tokens=960
2026-08-21T21:14:40.371912499Z INFO 08-21 21:14:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-760b5b9048fe493c963e70509720a5da logical_start=13504 logical_end=13670 capped_end=13664 physical_query_tokens=160
2026-08-21T21:14:57.928513150Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:14:58.251986486Z INFO 08-21 21:14:58 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c7962499d8f543cd967da047ac5bcfd1 checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T21:14:58.252025771Z INFO 08-21 21:14:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c7962499d8f543cd967da047ac5bcfd1 logical_start=7232 logical_end=8192 capped_end=7872 physical_query_tokens=640
2026-08-21T21:15:01.868771798Z INFO 08-21 21:15:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c7962499d8f543cd967da047ac5bcfd1 logical_start=7872 logical_end=13245 capped_end=13232 physical_query_tokens=5360
2026-08-21T21:15:33.655394297Z WARNING 08-21 21:15:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=129 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=31 assistant_tool_msgs=30 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:15:33.655617285Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:15:33.684559344Z WARNING 08-21 21:15:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=127 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=30 assistant_tool_msgs=29 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:15:33.684696638Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:15:33.872435277Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:15:34.139879176Z INFO 08-21 21:15:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-14373332b94148cf965b45cadd8bb593 logical_start=0 logical_end=7438 capped_end=7424 physical_query_tokens=7424
2026-08-21T21:16:13.711479362Z WARNING 08-21 21:16:13 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=6 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=3 assistant_tool_msgs=1 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:16:13.711714258Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:16:13.891730128Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:16:14.159166826Z INFO 08-21 21:16:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f4bd1158f08a435c9b5ccfab69dfbfe9 checkpoint_tokens=7168 logical_tokens=7197 physical_query_tokens=29
2026-08-21T21:16:14.159208859Z INFO 08-21 21:16:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f4bd1158f08a435c9b5ccfab69dfbfe9 logical_start=7168 logical_end=7197 capped_end=7184 physical_query_tokens=16
2026-08-21T21:16:33.318570626Z WARNING 08-21 21:16:33 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=23 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=10 assistant_tool_msgs=6 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:16:33.318739048Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:16:33.494885399Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:16:33.802181813Z INFO 08-21 21:16:33 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-63f36dc0146f4ca485063415f45b5305 logical_start=0 logical_end=6327 capped_end=6320 physical_query_tokens=6320
2026-08-21T21:16:50.731461181Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:16:51.015485601Z INFO 08-21 21:16:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c86b11609d354192b20fd119f392a246 checkpoint_tokens=7872 logical_tokens=8192 physical_query_tokens=320
2026-08-21T21:16:54.174071474Z INFO 08-21 21:16:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c86b11609d354192b20fd119f392a246 logical_start=8192 logical_end=14662 capped_end=13184 physical_query_tokens=4992
2026-08-21T21:17:01.156087896Z INFO 08-21 21:17:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c86b11609d354192b20fd119f392a246 logical_start=13184 logical_end=14662 capped_end=14656 physical_query_tokens=1472
2026-08-21T21:17:24.278881077Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:17:24.544417376Z INFO 08-21 21:17:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f5b68790552848e89100ff7153fdbe7f logical_start=0 logical_end=6439 capped_end=6272 physical_query_tokens=6272
2026-08-21T21:17:31.822588855Z INFO 08-21 21:17:31 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f5b68790552848e89100ff7153fdbe7f logical_start=6272 logical_end=6439 capped_end=6432 physical_query_tokens=160
2026-08-21T21:17:42.275092167Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:17:42.546595695Z INFO 08-21 21:17:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-49811b0b8b6e4f63adfa028f80bee5b7 checkpoint_tokens=13184 logical_tokens=14299 physical_query_tokens=1115
2026-08-21T21:17:42.546635687Z INFO 08-21 21:17:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-49811b0b8b6e4f63adfa028f80bee5b7 logical_start=13184 logical_end=14299 capped_end=14288 physical_query_tokens=1104
2026-08-21T21:18:11.931528402Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:18:12.215433296Z INFO 08-21 21:18:12 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-aec80521acb34893986f167e54602464 checkpoint_tokens=14656 logical_tokens=16287 physical_query_tokens=1631
2026-08-21T21:18:12.215465711Z INFO 08-21 21:18:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-aec80521acb34893986f167e54602464 logical_start=14656 logical_end=16287 capped_end=16272 physical_query_tokens=1616
2026-08-21T21:18:42.113278174Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:18:42.486949373Z INFO 08-21 21:18:42 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-33af3ffb9d4a42c992b4d08f03cd366f checkpoint_tokens=73984 logical_tokens=81920 physical_query_tokens=7936
2026-08-21T21:18:42.486995085Z INFO 08-21 21:18:42 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-33af3ffb9d4a42c992b4d08f03cd366f logical_start=73984 logical_end=81920 capped_end=74112 physical_query_tokens=128
2026-08-21T21:18:45.978573461Z INFO 08-21 21:18:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-33af3ffb9d4a42c992b4d08f03cd366f logical_start=74112 logical_end=82072 capped_end=82064 physical_query_tokens=7952
2026-08-21T21:19:58.639804132Z WARNING 08-21 21:19:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=25 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=11 assistant_tool_msgs=7 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:19:58.640060104Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:19:58.655273049Z WARNING 08-21 21:19:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=27 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=12 assistant_tool_msgs=8 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:19:58.655405635Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:19:58.669117938Z WARNING 08-21 21:19:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=29 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=13 assistant_tool_msgs=9 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:19:58.669242843Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:19:58.954988491Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:19:59.270280130Z INFO 08-21 21:19:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4fc7256d625c4494a2971216122d71ff checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T21:20:02.929931695Z INFO 08-21 21:20:02 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4fc7256d625c4494a2971216122d71ff logical_start=8192 logical_end=9928 capped_end=9920 physical_query_tokens=1728
2026-08-21T21:20:49.645195916Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:20:49.983996346Z INFO 08-21 21:20:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7f8b3d956df9432a9fa9e8323eb70b7a checkpoint_tokens=27200 logical_tokens=32768 physical_query_tokens=5568
2026-08-21T21:21:50.345547901Z INFO 08-21 21:21:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7f8b3d956df9432a9fa9e8323eb70b7a logical_start=65536 logical_end=67260 capped_end=67008 physical_query_tokens=1472
2026-08-21T21:21:56.329769816Z INFO 08-21 21:21:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7f8b3d956df9432a9fa9e8323eb70b7a logical_start=67008 logical_end=67260 capped_end=67248 physical_query_tokens=240
2026-08-21T21:22:25.450847077Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:22:25.790557595Z INFO 08-21 21:22:25 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d24a7f5d83fe4d8d93a22bcb358092cd checkpoint_tokens=67248 logical_tokens=67260 physical_query_tokens=12
2026-08-21T21:22:54.522259791Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:22:54.793286124Z INFO 08-21 21:22:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-bc049afcbf62436b80109313caf36006 checkpoint_tokens=7168 logical_tokens=7518 physical_query_tokens=350
2026-08-21T21:22:54.793339020Z INFO 08-21 21:22:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-bc049afcbf62436b80109313caf36006 logical_start=7168 logical_end=7518 capped_end=7232 physical_query_tokens=64
2026-08-21T21:22:56.778099630Z INFO 08-21 21:22:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-bc049afcbf62436b80109313caf36006 logical_start=7232 logical_end=7518 capped_end=7504 physical_query_tokens=272
2026-08-21T21:23:04.766478813Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:23:05.123852401Z INFO 08-21 21:23:05 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d7a4fd9cda7e4e0cb2b04df06f22750a checkpoint_tokens=14656 logical_tokens=16384 physical_query_tokens=1728
2026-08-21T21:23:05.123890768Z INFO 08-21 21:23:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d7a4fd9cda7e4e0cb2b04df06f22750a logical_start=14656 logical_end=16384 capped_end=16256 physical_query_tokens=1600
2026-08-21T21:23:09.728281248Z INFO 08-21 21:23:09 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d7a4fd9cda7e4e0cb2b04df06f22750a logical_start=16256 logical_end=19522 capped_end=19520 physical_query_tokens=3264
2026-08-21T21:23:47.210522891Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:23:47.508949556Z INFO 08-21 21:23:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-87515d1c06a948358bf903663dae9b96 checkpoint_tokens=9920 logical_tokens=11338 physical_query_tokens=1418
2026-08-21T21:23:47.508981626Z INFO 08-21 21:23:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-87515d1c06a948358bf903663dae9b96 logical_start=9920 logical_end=11338 capped_end=11328 physical_query_tokens=1408
2026-08-21T21:24:18.688848105Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:24:18.826086160Z INFO 08-21 21:24:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0aed6ac5f12146c7af0f0e1823a17f57 logical_start=0 logical_end=506 capped_end=496 physical_query_tokens=496
2026-08-21T21:28:26.273892318Z WARNING 08-21 21:28:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=33 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=37 tool_msgs=15 assistant_tool_msgs=11 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:28:26.274162564Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:28:26.298225851Z WARNING 08-21 21:28:26 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=135 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=58 assistant_tool_msgs=56 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:28:26.298370107Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:28:26.509369446Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:28:26.811870040Z INFO 08-21 21:28:26 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d29a7e4af48647dd9860156250d108bd checkpoint_tokens=11328 logical_tokens=12263 physical_query_tokens=935
2026-08-21T21:28:26.811917167Z INFO 08-21 21:28:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d29a7e4af48647dd9860156250d108bd logical_start=11328 logical_end=12263 capped_end=12256 physical_query_tokens=928
2026-08-21T21:28:52.891615383Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:28:53.028117948Z INFO 08-21 21:28:53 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d7822ae78ddd4d4d90e253b63ff690c6 logical_start=0 logical_end=519 capped_end=512 physical_query_tokens=512
2026-08-21T21:34:08.438666902Z WARNING 08-21 21:34:08 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=133 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=57 assistant_tool_msgs=55 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:34:08.438932080Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:34:08.670235125Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:34:08.988898316Z INFO 08-21 21:34:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-fbf850f875a143b59896d50a46f37c08 checkpoint_tokens=19520 logical_tokens=20987 physical_query_tokens=1467
2026-08-21T21:34:08.988934877Z INFO 08-21 21:34:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-fbf850f875a143b59896d50a46f37c08 logical_start=19520 logical_end=20987 capped_end=20976 physical_query_tokens=1456
2026-08-21T21:34:57.190813972Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:34:57.472740198Z INFO 08-21 21:34:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ffafc502f3c443fb9a6c74a7b5ba1152 checkpoint_tokens=11328 logical_tokens=12863 physical_query_tokens=1535
2026-08-21T21:34:57.472782377Z INFO 08-21 21:34:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ffafc502f3c443fb9a6c74a7b5ba1152 logical_start=11328 logical_end=12863 capped_end=12224 physical_query_tokens=896
2026-08-21T21:35:01.458118443Z INFO 08-21 21:35:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ffafc502f3c443fb9a6c74a7b5ba1152 logical_start=12224 logical_end=12863 capped_end=12848 physical_query_tokens=624
2026-08-21T21:35:28.333358207Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:35:28.607099034Z INFO 08-21 21:35:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-410b2c1d9eb74d3bbff6433fc2c6b452 checkpoint_tokens=12224 logical_tokens=12994 physical_query_tokens=770
2026-08-21T21:35:28.607140860Z INFO 08-21 21:35:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-410b2c1d9eb74d3bbff6433fc2c6b452 logical_start=12224 logical_end=12994 capped_end=12800 physical_query_tokens=576
2026-08-21T21:35:32.321085807Z INFO 08-21 21:35:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-410b2c1d9eb74d3bbff6433fc2c6b452 logical_start=12800 logical_end=12994 capped_end=12992 physical_query_tokens=192
2026-08-21T21:36:01.197671844Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:36:01.471018622Z INFO 08-21 21:36:01 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7a7a39b326f745d2902033c7de2ff7ce checkpoint_tokens=12992 logical_tokens=13209 physical_query_tokens=217
2026-08-21T21:36:01.471056777Z INFO 08-21 21:36:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7a7a39b326f745d2902033c7de2ff7ce logical_start=12992 logical_end=13209 capped_end=13200 physical_query_tokens=208
2026-08-21T21:36:26.487861310Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:36:26.763897326Z INFO 08-21 21:36:26 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0043c315ea9e47e39286aa43e8639f9c checkpoint_tokens=7424 logical_tokens=8031 physical_query_tokens=607
2026-08-21T21:36:26.763937857Z INFO 08-21 21:36:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0043c315ea9e47e39286aa43e8639f9c logical_start=7424 logical_end=8031 capped_end=8016 physical_query_tokens=592
2026-08-21T21:36:50.237748626Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:36:50.541174329Z INFO 08-21 21:36:50 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-3d92dbbd80654f2cb784034d195be2a2 checkpoint_tokens=19520 logical_tokens=22247 physical_query_tokens=2727
2026-08-21T21:36:50.541212578Z INFO 08-21 21:36:50 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3d92dbbd80654f2cb784034d195be2a2 logical_start=19520 logical_end=22247 capped_end=20928 physical_query_tokens=1408
2026-08-21T21:36:55.247700581Z INFO 08-21 21:36:55 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-3d92dbbd80654f2cb784034d195be2a2 logical_start=20928 logical_end=22247 capped_end=22240 physical_query_tokens=1312
2026-08-21T21:39:02.564867714Z WARNING 08-21 21:39:02 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=137 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=59 assistant_tool_msgs=57 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T21:39:02.565117734Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T21:39:02.778414486Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:39:03.071298010Z INFO 08-21 21:39:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-c6e561ef36ee46648bf518cd085ccc66 checkpoint_tokens=12992 logical_tokens=14346 physical_query_tokens=1354
2026-08-21T21:39:03.071345988Z INFO 08-21 21:39:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c6e561ef36ee46648bf518cd085ccc66 logical_start=12992 logical_end=14346 capped_end=13184 physical_query_tokens=192
2026-08-21T21:39:05.963607520Z INFO 08-21 21:39:05 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-c6e561ef36ee46648bf518cd085ccc66 logical_start=13184 logical_end=14346 capped_end=14336 physical_query_tokens=1152
2026-08-21T21:39:28.632614766Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:39:28.915509739Z INFO 08-21 21:39:28 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ad8a1523048a4196967f51e7c1d82f8c checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T21:39:28.915542124Z INFO 08-21 21:39:28 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ad8a1523048a4196967f51e7c1d82f8c logical_start=7424 logical_end=8192 capped_end=8000 physical_query_tokens=576
2026-08-21T21:39:32.650236769Z INFO 08-21 21:39:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ad8a1523048a4196967f51e7c1d82f8c logical_start=8000 logical_end=9165 capped_end=9152 physical_query_tokens=1152
2026-08-21T21:40:05.600666788Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:40:05.728145988Z INFO 08-21 21:40:05 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e1faa80f7b1744dc93e258a4e8e2e329 checkpoint_tokens=512 logical_tokens=519 physical_query_tokens=7
2026-08-21T21:49:37.842564413Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:49:38.127746225Z INFO 08-21 21:49:38 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-63b78bb347b0417ab3b1761f4838bb22 checkpoint_tokens=9152 logical_tokens=9792 physical_query_tokens=640
2026-08-21T21:49:38.127785440Z INFO 08-21 21:49:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-63b78bb347b0417ab3b1761f4838bb22 logical_start=9152 logical_end=9792 capped_end=9776 physical_query_tokens=624
2026-08-21T21:50:03.831371912Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:50:03.959089203Z INFO 08-21 21:50:03 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-93e24156de894e359d6ee4f73fa6f88f checkpoint_tokens=496 logical_tokens=506 physical_query_tokens=10
2026-08-21T21:57:22.618091139Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:57:22.897187365Z INFO 08-21 21:57:22 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-caf56017c40446dfaa717939fb67502f checkpoint_tokens=9152 logical_tokens=10122 physical_query_tokens=970
2026-08-21T21:57:22.897221782Z INFO 08-21 21:57:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-caf56017c40446dfaa717939fb67502f logical_start=9152 logical_end=10122 capped_end=9728 physical_query_tokens=576
2026-08-21T21:57:26.655071700Z INFO 08-21 21:57:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-caf56017c40446dfaa717939fb67502f logical_start=9728 logical_end=10122 capped_end=10112 physical_query_tokens=384
2026-08-21T21:57:45.143137592Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:57:45.478578982Z INFO 08-21 21:57:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1511472449a64f1aaf0751b6e47fa2a7 logical_start=0 logical_end=8192 capped_end=1536 physical_query_tokens=1536
2026-08-21T21:57:58.806309271Z INFO 08-21 21:57:58 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1511472449a64f1aaf0751b6e47fa2a7 logical_start=9728 logical_end=14085 capped_end=14080 physical_query_tokens=4352
2026-08-21T21:58:51.357910841Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:58:51.626527312Z INFO 08-21 21:58:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5eadb65f055e440998524ae7b8474fe1 checkpoint_tokens=10112 logical_tokens=10227 physical_query_tokens=115
2026-08-21T21:58:51.626561725Z INFO 08-21 21:58:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5eadb65f055e440998524ae7b8474fe1 logical_start=10112 logical_end=10227 capped_end=10224 physical_query_tokens=112
2026-08-21T21:59:08.119944285Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:59:08.381691774Z INFO 08-21 21:59:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a9ec83eccf2b490981bc0f302e68b7bb checkpoint_tokens=7232 logical_tokens=7307 physical_query_tokens=75
2026-08-21T21:59:08.381736389Z INFO 08-21 21:59:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a9ec83eccf2b490981bc0f302e68b7bb logical_start=7232 logical_end=7307 capped_end=7296 physical_query_tokens=64
2026-08-21T21:59:18.357204913Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T21:59:18.484685145Z INFO 08-21 21:59:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d6ed9449fc7a470a8f090bd0b1e9acf9 checkpoint_tokens=512 logical_tokens=519 physical_query_tokens=7
2026-08-21T22:04:00.354822015Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:04:00.634125231Z INFO 08-21 22:04:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-17c2beefabc64c6694403bc82b68aa8c logical_start=0 logical_end=8192 capped_end=6144 physical_query_tokens=6144
2026-08-21T22:04:07.827108575Z INFO 08-21 22:04:07 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-17c2beefabc64c6694403bc82b68aa8c logical_start=6144 logical_end=8239 capped_end=8224 physical_query_tokens=2080
2026-08-21T22:04:20.933155543Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:04:21.212969979Z INFO 08-21 22:04:21 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-041de214f4b241039cb998f41ac0ebc4 checkpoint_tokens=10112 logical_tokens=10761 physical_query_tokens=649
2026-08-21T22:04:21.213010261Z INFO 08-21 22:04:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-041de214f4b241039cb998f41ac0ebc4 logical_start=10112 logical_end=10761 capped_end=10176 physical_query_tokens=64
2026-08-21T22:04:23.362355711Z INFO 08-21 22:04:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-041de214f4b241039cb998f41ac0ebc4 logical_start=10176 logical_end=10761 capped_end=10752 physical_query_tokens=576
2026-08-21T22:04:59.578726915Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:04:59.856036646Z INFO 08-21 22:04:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-78b9095fb7834cf1836dfd4f7bc424fb checkpoint_tokens=10752 logical_tokens=11170 physical_query_tokens=418
2026-08-21T22:04:59.856078676Z INFO 08-21 22:04:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-78b9095fb7834cf1836dfd4f7bc424fb logical_start=10752 logical_end=11170 capped_end=11168 physical_query_tokens=416
2026-08-21T22:05:20.095057580Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:05:20.367438900Z INFO 08-21 22:05:20 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-34ec2e01f2dc43af922625f3bd8bd4c6 checkpoint_tokens=10752 logical_tokens=11415 physical_query_tokens=663
2026-08-21T22:05:20.367473100Z INFO 08-21 22:05:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-34ec2e01f2dc43af922625f3bd8bd4c6 logical_start=10752 logical_end=11415 capped_end=11136 physical_query_tokens=384
2026-08-21T22:05:23.739156508Z INFO 08-21 22:05:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-34ec2e01f2dc43af922625f3bd8bd4c6 logical_start=11136 logical_end=11415 capped_end=11408 physical_query_tokens=272
2026-08-21T22:05:41.638104208Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:05:43.253815460Z INFO 08-21 22:05:43 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-4a6e562436ba46cea3f75cbebe3ef073 checkpoint_tokens=27200 logical_tokens=32768 physical_query_tokens=5568
2026-08-21T22:05:43.253859585Z INFO 08-21 22:05:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4a6e562436ba46cea3f75cbebe3ef073 logical_start=27200 logical_end=32768 capped_end=27584 physical_query_tokens=384
2026-08-21T22:07:59.921643788Z INFO 08-21 22:07:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4a6e562436ba46cea3f75cbebe3ef073 logical_start=101312 logical_end=106344 capped_end=106336 physical_query_tokens=5024
2026-08-21T22:10:44.279125874Z WARNING 08-21 22:10:44 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=131 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=31 assistant_tool_msgs=30 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:10:44.279393354Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:10:44.479486239Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:10:44.742079254Z INFO 08-21 22:10:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-63330972e56b4c8399ca724af3e7f536 logical_start=0 logical_end=7229 capped_end=7216 physical_query_tokens=7216
2026-08-21T22:11:14.301127831Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:11:14.560513331Z INFO 08-21 22:11:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-213e2d1556e244c7a6b3a1a7963d17d5 checkpoint_tokens=7296 logical_tokens=7307 physical_query_tokens=11
2026-08-21T22:11:21.957616134Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:11:22.287544308Z INFO 08-21 22:11:22 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2f2609b3b2784dea8bfbf6c4435b58ba checkpoint_tokens=11136 logical_tokens=15016 physical_query_tokens=3880
2026-08-21T22:11:22.287588663Z INFO 08-21 22:11:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f2609b3b2784dea8bfbf6c4435b58ba logical_start=11136 logical_end=15016 capped_end=11392 physical_query_tokens=256
2026-08-21T22:11:25.400967252Z INFO 08-21 22:11:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f2609b3b2784dea8bfbf6c4435b58ba logical_start=11392 logical_end=15016 capped_end=15008 physical_query_tokens=3616
2026-08-21T22:11:45.190247404Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:11:45.451789775Z INFO 08-21 22:11:45 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9b9b691f398845a8aecf41b1c601886d checkpoint_tokens=7296 logical_tokens=7414 physical_query_tokens=118
2026-08-21T22:11:45.451825015Z INFO 08-21 22:11:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9b9b691f398845a8aecf41b1c601886d logical_start=7296 logical_end=7414 capped_end=7408 physical_query_tokens=112
2026-08-21T22:11:59.155809977Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:11:59.419385661Z INFO 08-21 22:11:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b14e9312e7b3434b81de8ac2fa10989a checkpoint_tokens=7296 logical_tokens=7648 physical_query_tokens=352
2026-08-21T22:11:59.419424500Z INFO 08-21 22:11:59 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b14e9312e7b3434b81de8ac2fa10989a logical_start=7296 logical_end=7648 capped_end=7360 physical_query_tokens=64
2026-08-21T22:12:01.489601333Z INFO 08-21 22:12:01 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b14e9312e7b3434b81de8ac2fa10989a logical_start=7360 logical_end=7648 capped_end=7632 physical_query_tokens=272
2026-08-21T22:12:07.808590358Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:12:08.077995883Z INFO 08-21 22:12:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6e08a48f3aa6499586b1bc317280416e checkpoint_tokens=7168 logical_tokens=7768 physical_query_tokens=600
2026-08-21T22:12:08.078030095Z INFO 08-21 22:12:08 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6e08a48f3aa6499586b1bc317280416e logical_start=7168 logical_end=7768 capped_end=7760 physical_query_tokens=592
2026-08-21T22:12:21.327514999Z WARNING 08-21 22:12:21 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=141 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=60 assistant_tool_msgs=58 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:12:21.327712620Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:12:21.508416623Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:12:21.776211492Z INFO 08-21 22:12:21 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ad092dd57db64b0d968965a48a76dc39 checkpoint_tokens=7360 logical_tokens=7749 physical_query_tokens=389
2026-08-21T22:12:21.776273437Z INFO 08-21 22:12:21 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ad092dd57db64b0d968965a48a76dc39 logical_start=7360 logical_end=7749 capped_end=7616 physical_query_tokens=256
2026-08-21T22:12:24.762016363Z INFO 08-21 22:12:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ad092dd57db64b0d968965a48a76dc39 logical_start=7616 logical_end=7749 capped_end=7744 physical_query_tokens=128
2026-08-21T22:12:31.884460269Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:12:32.195832303Z INFO 08-21 22:12:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-88461fade266475582f031a0ffab68bc logical_start=0 logical_end=8192 capped_end=7168 physical_query_tokens=7168
2026-08-21T22:12:40.018718398Z INFO 08-21 22:12:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-88461fade266475582f031a0ffab68bc logical_start=7168 logical_end=10784 capped_end=10768 physical_query_tokens=3600
2026-08-21T22:12:58.843786497Z WARNING 08-21 22:12:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=404 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=68 assistant_tool_msgs=63 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:12:58.843996601Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:12:58.872270669Z WARNING 08-21 22:12:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=133 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=32 assistant_tool_msgs=31 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:12:58.872405925Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:12:58.902730293Z WARNING 08-21 22:12:58 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=145 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=62 assistant_tool_msgs=60 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:12:58.902862959Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:12:59.087487190Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:12:59.349408133Z INFO 08-21 22:12:59 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f93cd7b36bcc43feb6467d66b58ae416 checkpoint_tokens=7424 logical_tokens=7433 physical_query_tokens=9
2026-08-21T22:13:28.686717273Z WARNING 08-21 22:13:28 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=406 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=78 tool_msgs=68 assistant_tool_msgs=63 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:13:28.686865349Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:13:28.715093341Z WARNING 08-21 22:13:28 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=143 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=61 assistant_tool_msgs=59 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:13:28.715230893Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:13:29.017075004Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:13:29.359422589Z INFO 08-21 22:13:29 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-bc3d851149ee44aea0f853c0c439a1c4 checkpoint_tokens=67008 logical_tokens=67263 physical_query_tokens=255
2026-08-21T22:13:29.359459668Z INFO 08-21 22:13:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-bc3d851149ee44aea0f853c0c439a1c4 logical_start=67008 logical_end=67263 capped_end=67248 physical_query_tokens=240
2026-08-21T22:14:09.755493512Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:14:09.886190221Z INFO 08-21 22:14:09 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e68bae07453840b188d5f9f9352fc760 logical_start=0 logical_end=348 capped_end=336 physical_query_tokens=336
2026-08-21T22:17:06.047589051Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:17:06.331605699Z INFO 08-21 22:17:06 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8bfe5279491a42e0bf3907c0bf0c84e0 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T22:17:10.037318556Z INFO 08-21 22:17:10 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8bfe5279491a42e0bf3907c0bf0c84e0 logical_start=8192 logical_end=8467 capped_end=8464 physical_query_tokens=272
2026-08-21T22:17:40.742839627Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:17:41.081361676Z INFO 08-21 22:17:41 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-837ff5c61e884c92a9d49be3a9eeed5a checkpoint_tokens=67248 logical_tokens=67263 physical_query_tokens=15
2026-08-21T22:17:57.497059199Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:17:57.624596315Z INFO 08-21 22:17:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-98394603e2f94464a8efaf9bf90d1f16 logical_start=0 logical_end=133 capped_end=128 physical_query_tokens=128
2026-08-21T22:21:23.639963848Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:21:23.930563596Z INFO 08-21 22:21:23 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2f2001bba20a4c5f8dd8c6939ab2f9ed checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T22:21:23.930597839Z INFO 08-21 22:21:23 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f2001bba20a4c5f8dd8c6939ab2f9ed logical_start=7424 logical_end=8192 capped_end=7488 physical_query_tokens=64
2026-08-21T22:21:25.899472577Z INFO 08-21 22:21:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f2001bba20a4c5f8dd8c6939ab2f9ed logical_start=7488 logical_end=9261 capped_end=9248 physical_query_tokens=1760
2026-08-21T22:21:48.825001784Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:21:49.088062425Z INFO 08-21 22:21:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f02716b5ad374463b8972fc5cb79569a checkpoint_tokens=7216 logical_tokens=7229 physical_query_tokens=13
2026-08-21T22:22:16.582834399Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:22:16.850548606Z INFO 08-21 22:22:16 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-10ded438a83f4dce99e00a8a7d81a0d9 checkpoint_tokens=7488 logical_tokens=8192 physical_query_tokens=704
2026-08-21T22:22:20.635235966Z INFO 08-21 22:22:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-10ded438a83f4dce99e00a8a7d81a0d9 logical_start=8192 logical_end=9446 capped_end=9216 physical_query_tokens=1024
2026-08-21T22:22:24.657734308Z INFO 08-21 22:22:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-10ded438a83f4dce99e00a8a7d81a0d9 logical_start=9216 logical_end=9446 capped_end=9440 physical_query_tokens=224
2026-08-21T22:22:34.823280778Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:22:35.086428367Z INFO 08-21 22:22:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-6ec272f9f39a4ab38297ecc0040df674 checkpoint_tokens=7168 logical_tokens=7197 physical_query_tokens=29
2026-08-21T22:22:35.086498934Z INFO 08-21 22:22:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6ec272f9f39a4ab38297ecc0040df674 logical_start=7168 logical_end=7197 capped_end=7184 physical_query_tokens=16
2026-08-21T22:22:49.287564182Z WARNING 08-21 22:22:49 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=8 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=16 tool_msgs=2 assistant_tool_msgs=2 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:22:49.287762781Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:22:49.456679603Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:22:49.727080808Z INFO 08-21 22:22:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5135dc2b323f4a098cb16f6742a1da80 checkpoint_tokens=9216 logical_tokens=9916 physical_query_tokens=700
2026-08-21T22:22:49.727139712Z INFO 08-21 22:22:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5135dc2b323f4a098cb16f6742a1da80 logical_start=9216 logical_end=9916 capped_end=9408 physical_query_tokens=192
2026-08-21T22:22:52.530699737Z INFO 08-21 22:22:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-5135dc2b323f4a098cb16f6742a1da80 logical_start=9408 logical_end=9916 capped_end=9904 physical_query_tokens=496
2026-08-21T22:23:17.348434626Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:23:17.614356155Z INFO 08-21 22:23:17 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d11643721a834ceeb1ff980019c29b2c checkpoint_tokens=7168 logical_tokens=7527 physical_query_tokens=359
2026-08-21T22:23:17.614393967Z INFO 08-21 22:23:17 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d11643721a834ceeb1ff980019c29b2c logical_start=7168 logical_end=7527 capped_end=7296 physical_query_tokens=128
2026-08-21T22:23:20.128260208Z INFO 08-21 22:23:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d11643721a834ceeb1ff980019c29b2c logical_start=7296 logical_end=7527 capped_end=7520 physical_query_tokens=224
2026-08-21T22:23:31.203036042Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:23:31.494026188Z INFO 08-21 22:23:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-23df35e4120342e2960e6d4a5c40c164 checkpoint_tokens=7424 logical_tokens=8192 physical_query_tokens=768
2026-08-21T22:23:35.226070644Z INFO 08-21 22:23:35 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-23df35e4120342e2960e6d4a5c40c164 logical_start=8192 logical_end=11393 capped_end=8448 physical_query_tokens=256
2026-08-21T22:23:38.003896597Z INFO 08-21 22:23:38 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-23df35e4120342e2960e6d4a5c40c164 logical_start=8448 logical_end=11393 capped_end=11376 physical_query_tokens=2928
2026-08-21T22:24:22.665571707Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:24:22.934855715Z INFO 08-21 22:24:22 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-8dd0a3fc97b94637bc1915fbfd0fdbd8 checkpoint_tokens=9408 logical_tokens=10294 physical_query_tokens=886
2026-08-21T22:24:22.934909804Z INFO 08-21 22:24:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8dd0a3fc97b94637bc1915fbfd0fdbd8 logical_start=9408 logical_end=10294 capped_end=9856 physical_query_tokens=448
2026-08-21T22:24:26.294021948Z INFO 08-21 22:24:26 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-8dd0a3fc97b94637bc1915fbfd0fdbd8 logical_start=9856 logical_end=10294 capped_end=10288 physical_query_tokens=432
2026-08-21T22:24:44.487187733Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:24:44.749579219Z INFO 08-21 22:24:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a0f166e6025e4ac6b86b29402d4d2461 checkpoint_tokens=7296 logical_tokens=7735 physical_query_tokens=439
2026-08-21T22:24:44.749614700Z INFO 08-21 22:24:44 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a0f166e6025e4ac6b86b29402d4d2461 logical_start=7296 logical_end=7735 capped_end=7488 physical_query_tokens=192
2026-08-21T22:24:47.527679974Z INFO 08-21 22:24:47 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-a0f166e6025e4ac6b86b29402d4d2461 logical_start=7488 logical_end=7735 capped_end=7728 physical_query_tokens=240
2026-08-21T22:24:54.038802742Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:24:54.332506614Z INFO 08-21 22:24:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-219923aead1a46208727fb73f9b7a713 checkpoint_tokens=7168 logical_tokens=8192 physical_query_tokens=1024
2026-08-21T22:24:54.332546013Z INFO 08-21 22:24:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-219923aead1a46208727fb73f9b7a713 logical_start=7168 logical_end=8192 capped_end=7232 physical_query_tokens=64
2026-08-21T22:24:56.145420605Z INFO 08-21 22:24:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-219923aead1a46208727fb73f9b7a713 logical_start=7232 logical_end=12612 capped_end=12608 physical_query_tokens=5376
2026-08-21T22:25:39.945588725Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:25:40.072296175Z INFO 08-21 22:25:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7b92edc774aa45ffa8e09acb786e1be1 logical_start=0 logical_end=128 capped_end=112 physical_query_tokens=112
2026-08-21T22:29:18.605989959Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:29:18.738088211Z INFO 08-21 22:29:18 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b3ec00623bb04ea08c07339e34cd2480 logical_start=0 logical_end=556 capped_end=544 physical_query_tokens=544
2026-08-21T22:31:49.352522234Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:31:49.627901493Z INFO 08-21 22:31:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-90cf1ddd2ea5477492dedf6b24a53b4c checkpoint_tokens=9856 logical_tokens=10521 physical_query_tokens=665
2026-08-21T22:31:49.627939610Z INFO 08-21 22:31:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-90cf1ddd2ea5477492dedf6b24a53b4c logical_start=9856 logical_end=10521 capped_end=10240 physical_query_tokens=384
2026-08-21T22:31:52.929993939Z INFO 08-21 22:31:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-90cf1ddd2ea5477492dedf6b24a53b4c logical_start=10240 logical_end=10521 capped_end=10512 physical_query_tokens=272
2026-08-21T22:32:17.980132168Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:32:18.244660740Z INFO 08-21 22:32:18 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b21808baba184cfe8f42647bafad7cbc checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T22:32:22.185484581Z INFO 08-21 22:32:22 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-b21808baba184cfe8f42647bafad7cbc logical_start=8192 logical_end=10790 capped_end=10784 physical_query_tokens=2592
2026-08-21T22:32:51.614205091Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:32:51.883688148Z INFO 08-21 22:32:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-1f1827711bea487eaa7fb811f6523fe1 checkpoint_tokens=10240 logical_tokens=12359 physical_query_tokens=2119
2026-08-21T22:32:51.883733887Z INFO 08-21 22:32:51 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1f1827711bea487eaa7fb811f6523fe1 logical_start=10240 logical_end=12359 capped_end=10496 physical_query_tokens=256
2026-08-21T22:32:54.987816433Z INFO 08-21 22:32:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-1f1827711bea487eaa7fb811f6523fe1 logical_start=10496 logical_end=12359 capped_end=12352 physical_query_tokens=1856
2026-08-21T22:33:10.990118169Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:33:11.262169186Z INFO 08-21 22:33:11 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d4f5fd31129e4670ab8534468d03c97a checkpoint_tokens=8448 logical_tokens=13131 physical_query_tokens=4683
2026-08-21T22:33:11.262207401Z INFO 08-21 22:33:11 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4f5fd31129e4670ab8534468d03c97a logical_start=8448 logical_end=13131 capped_end=11392 physical_query_tokens=2944
2026-08-21T22:33:16.694700507Z INFO 08-21 22:33:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d4f5fd31129e4670ab8534468d03c97a logical_start=11392 logical_end=13131 capped_end=13120 physical_query_tokens=1728
2026-08-21T22:33:39.160173626Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:33:39.426402888Z INFO 08-21 22:33:39 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f1065bf9e91645afbb508d021601d2cc checkpoint_tokens=7232 logical_tokens=8192 physical_query_tokens=960
2026-08-21T22:33:43.363091550Z INFO 08-21 22:33:43 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f1065bf9e91645afbb508d021601d2cc logical_start=8192 logical_end=11334 capped_end=11328 physical_query_tokens=3136
2026-08-21T22:34:12.054525380Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:34:12.319938418Z INFO 08-21 22:34:12 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e6c0e90ec5ed41ce9260ee27e437b07f checkpoint_tokens=11328 logical_tokens=11526 physical_query_tokens=198
2026-08-21T22:34:12.319984997Z INFO 08-21 22:34:12 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-e6c0e90ec5ed41ce9260ee27e437b07f logical_start=11328 logical_end=11526 capped_end=11520 physical_query_tokens=192
2026-08-21T22:34:34.397993145Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:34:34.670097236Z INFO 08-21 22:34:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2f0716dba530429995f43ae52447c4c4 checkpoint_tokens=12352 logical_tokens=13394 physical_query_tokens=1042
2026-08-21T22:34:34.670140337Z INFO 08-21 22:34:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-2f0716dba530429995f43ae52447c4c4 logical_start=12352 logical_end=13394 capped_end=13392 physical_query_tokens=1040
2026-08-21T22:34:58.405793741Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:34:58.789967340Z INFO 08-21 22:34:58 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d377f6cd353e41b9a0b09cade5430bb6 checkpoint_tokens=27584 logical_tokens=32768 physical_query_tokens=5184
2026-08-21T22:37:03.427896537Z INFO 08-21 22:37:03 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d377f6cd353e41b9a0b09cade5430bb6 logical_start=98304 logical_end=106496 capped_end=105920 physical_query_tokens=7616
2026-08-21T22:37:20.685810155Z INFO 08-21 22:37:20 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-d377f6cd353e41b9a0b09cade5430bb6 logical_start=105920 logical_end=106809 capped_end=106800 physical_query_tokens=880
2026-08-21T22:38:32.725018492Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:38:32.992757611Z INFO 08-21 22:38:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-eea45203361e43a2aab9871b0647118e checkpoint_tokens=11520 logical_tokens=11851 physical_query_tokens=331
2026-08-21T22:38:32.992799251Z INFO 08-21 22:38:32 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-eea45203361e43a2aab9871b0647118e logical_start=11520 logical_end=11851 capped_end=11840 physical_query_tokens=320
2026-08-21T22:38:56.329048243Z WARNING 08-21 22:38:56 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=149 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=63 assistant_tool_msgs=61 strict_false=0 strict_true=0 choice=auto images=1 image_data=1 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:38:56.329279448Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:38:56.523908773Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:38:56.808660308Z INFO 08-21 22:38:56 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f30665115f324435ad15b4a869cbff8c checkpoint_tokens=12352 logical_tokens=14206 physical_query_tokens=1854
2026-08-21T22:38:56.808702543Z INFO 08-21 22:38:56 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f30665115f324435ad15b4a869cbff8c logical_start=12352 logical_end=14206 capped_end=13376 physical_query_tokens=1024
2026-08-21T22:39:00.890661106Z INFO 08-21 22:39:00 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f30665115f324435ad15b4a869cbff8c logical_start=13376 logical_end=14206 capped_end=14192 physical_query_tokens=816
2026-08-21T22:39:14.388639366Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:39:14.709590871Z INFO 08-21 22:39:14 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-30f14a02b1dc47869979acfcf04bfee4 checkpoint_tokens=13120 logical_tokens=14350 physical_query_tokens=1230
2026-08-21T22:39:14.709629880Z INFO 08-21 22:39:14 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-30f14a02b1dc47869979acfcf04bfee4 logical_start=13120 logical_end=14350 capped_end=14336 physical_query_tokens=1216
2026-08-21T22:39:46.130333875Z WARNING 08-21 22:39:46 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=135 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=85 tool_msgs=32 assistant_tool_msgs=31 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:39:46.130543214Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:39:46.331160843Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:39:46.617666508Z INFO 08-21 22:39:46 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-96b3e4c8fe694ca4a092f1e74176c282 checkpoint_tokens=14336 logical_tokens=14721 physical_query_tokens=385
2026-08-21T22:39:46.617711233Z INFO 08-21 22:39:46 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-96b3e4c8fe694ca4a092f1e74176c282 logical_start=14336 logical_end=14721 capped_end=14704 physical_query_tokens=368
2026-08-21T22:40:23.803523393Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:40:24.092732988Z INFO 08-21 22:40:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0a92b93209ed44b88eb334af6b0ae089 checkpoint_tokens=13376 logical_tokens=14666 physical_query_tokens=1290
2026-08-21T22:40:24.092767795Z INFO 08-21 22:40:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0a92b93209ed44b88eb334af6b0ae089 logical_start=13376 logical_end=14666 capped_end=14144 physical_query_tokens=768
2026-08-21T22:40:27.959334060Z INFO 08-21 22:40:27 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-0a92b93209ed44b88eb334af6b0ae089 logical_start=14144 logical_end=14666 capped_end=14656 physical_query_tokens=512
2026-08-21T22:40:39.125917032Z WARNING 08-21 22:40:39 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=333 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=79 tool_msgs=53 assistant_tool_msgs=47 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:40:39.126092344Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:40:39.160880581Z WARNING 08-21 22:40:39 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=151 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=87 tool_msgs=64 assistant_tool_msgs=62 strict_false=0 strict_true=0 choice=auto images=1 image_data=1 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:40:39.161013208Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:40:39.345231004Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:40:39.646106629Z INFO 08-21 22:40:39 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-57e30a1db55d47e4bd659195b53d7761 checkpoint_tokens=14656 logical_tokens=15406 physical_query_tokens=750
2026-08-21T22:40:39.646160105Z INFO 08-21 22:40:39 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-57e30a1db55d47e4bd659195b53d7761 logical_start=14656 logical_end=15406 capped_end=15392 physical_query_tokens=736
2026-08-21T22:40:54.005523184Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:40:54.276066220Z INFO 08-21 22:40:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-594985e8611d4503a83f83b3aa02f8f0 checkpoint_tokens=14656 logical_tokens=15239 physical_query_tokens=583
2026-08-21T22:40:54.276109923Z INFO 08-21 22:40:54 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-594985e8611d4503a83f83b3aa02f8f0 logical_start=14656 logical_end=15239 capped_end=15232 physical_query_tokens=576
2026-08-21T22:41:13.047170158Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:41:13.361051959Z INFO 08-21 22:41:13 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ed227f7b1a6a452d9d65d905ad5e3076 checkpoint_tokens=14336 logical_tokens=15812 physical_query_tokens=1476
2026-08-21T22:41:13.361095167Z INFO 08-21 22:41:13 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ed227f7b1a6a452d9d65d905ad5e3076 logical_start=14336 logical_end=15812 capped_end=14720 physical_query_tokens=384
2026-08-21T22:41:16.796243106Z INFO 08-21 22:41:16 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ed227f7b1a6a452d9d65d905ad5e3076 logical_start=14720 logical_end=15812 capped_end=15808 physical_query_tokens=1088
2026-08-21T22:41:57.608839925Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:41:57.885537169Z INFO 08-21 22:41:57 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-7b798c322b1741b681ac042b864711c9 checkpoint_tokens=14720 logical_tokens=15090 physical_query_tokens=370
2026-08-21T22:41:57.885573948Z INFO 08-21 22:41:57 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-7b798c322b1741b681ac042b864711c9 logical_start=14720 logical_end=15090 capped_end=15088 physical_query_tokens=368
2026-08-21T22:42:34.415861939Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:42:34.726717006Z INFO 08-21 22:42:34 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9266c719fde14c778c3af569817ded11 checkpoint_tokens=15232 logical_tokens=16333 physical_query_tokens=1101
2026-08-21T22:42:34.726758507Z INFO 08-21 22:42:34 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9266c719fde14c778c3af569817ded11 logical_start=15232 logical_end=16333 capped_end=15360 physical_query_tokens=128
2026-08-21T22:42:37.440459132Z INFO 08-21 22:42:37 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-9266c719fde14c778c3af569817ded11 logical_start=15360 logical_end=16333 capped_end=16320 physical_query_tokens=960
2026-08-21T22:42:52.340774830Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:42:52.479301052Z INFO 08-21 22:42:52 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-15812218966e41589e3ede1f6e093470 logical_start=0 logical_end=330 capped_end=320 physical_query_tokens=320
2026-08-21T22:45:47.118128281Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:45:47.431167860Z INFO 08-21 22:45:47 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-f9b95c71c0ae40edaba9bb3363595d52 checkpoint_tokens=16320 logical_tokens=16384 physical_query_tokens=64
2026-08-21T22:45:49.583900557Z INFO 08-21 22:45:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-f9b95c71c0ae40edaba9bb3363595d52 logical_start=16384 logical_end=16928 capped_end=16912 physical_query_tokens=528
2026-08-21T22:46:28.690987927Z WARNING 08-21 22:46:28 api_server.py:488] [BI100 4XX] endpoint=request_validation code=400 reason=request_validation_other messages=584 systems=1 system_part_msgs=0 system_text_parts=0 system_other_parts=0 tools=69 tool_msgs=140 assistant_tool_msgs=140 strict_false=0 strict_true=0 choice=auto images=0 image_data=0 image_remote=0 image_other=0 stream=1 n=unset errors=1 validation_field=max_completion_tokens validation_type=extra_forbidden
2026-08-21T22:46:28.691243884Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 400 Bad Request
2026-08-21T22:46:28.869698561Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:46:29.035500790Z INFO 08-21 22:46:29 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-75f732e16057410dbc876d9b9a75a0ae logical_start=0 logical_end=1078 capped_end=1072 physical_query_tokens=1072
2026-08-21T22:50:40.926367969Z INFO: 172.28.22.23:40513 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:50:41.316027447Z INFO 08-21 22:50:41 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-28fb2c567a5c4aafa04da25c8cba44b6 checkpoint_tokens=15808 logical_tokens=16384 physical_query_tokens=576
2026-08-21T22:50:45.043185052Z INFO 08-21 22:50:45 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-28fb2c567a5c4aafa04da25c8cba44b6 logical_start=16384 logical_end=18904 capped_end=18896 physical_query_tokens=2512
2026-08-21T22:51:46.068413902Z INFO: 172.28.22.23:17976 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T22:51:49.221295889Z INFO 08-21 22:51:49 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-6e30170a7d85467c9abb7d2f684c140b logical_start=0 logical_end=66 capped_end=64 physical_query_tokens=64
2026-08-21T23:13:08.295605643Z INFO: 172.28.22.23:24560 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T23:13:08.423183409Z INFO 08-21 23:13:08 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-60e243784f0f49d4b9a1b160cd6ee0da checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-21T23:35:51.454315163Z INFO: 172.28.22.23:14463 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T23:35:51.582765208Z INFO 08-21 23:35:51 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-250b82b75b404c3b9368723620866afd checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-21T23:51:35.028772464Z INFO: 172.28.22.23:44500 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-21T23:51:35.157134421Z INFO 08-21 23:51:35 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-df37660f9c374c72a5b0ad56852cb65d checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-22T00:13:44.511759629Z INFO: 172.28.22.23:51446 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T00:13:44.640981235Z INFO 08-22 00:13:44 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5aa0179ae72243e4bde510103af65fad checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-22T00:34:27.833316304Z INFO: 172.28.22.23:33300 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T00:34:27.961888417Z INFO 08-22 00:34:27 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b15e6534507746ef841299d075c0d174 checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-22T00:54:30.893407798Z INFO: 172.28.22.23:1656 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T00:54:31.023863219Z INFO 08-22 00:54:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-45171deb68aa40f3ab1f2ad3061a24c9 checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-22T01:13:09.169150033Z INFO: 172.28.22.23:35132 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T01:13:09.295692430Z INFO 08-22 01:13:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-07629efe13c8499babc4c893030734b8 checkpoint_tokens=64 logical_tokens=66 physical_query_tokens=2
2026-08-22T01:37:25.430187862Z INFO: 172.28.22.23:20501 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T01:37:25.558843370Z INFO 08-22 01:37:25 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-ba9b5efc3d9a4f43ac0113f32dee0497 logical_start=0 logical_end=176 capped_end=160 physical_query_tokens=160
2026-08-22T03:27:24.030063599Z INFO: 172.28.22.23:61472 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T03:27:24.158715980Z INFO 08-22 03:27:24 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-a25735dd1fcb43d7bcc633d79cc4488a checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T04:28:20.615129730Z INFO: 172.28.22.23:51151 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T04:28:20.742573810Z INFO 08-22 04:28:20 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-ef8fe3085cc94e4ca2d9f9a2bd84e911 checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T05:27:52.239998278Z INFO: 172.28.22.23:35653 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T05:27:52.368168321Z INFO 08-22 05:27:52 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e62791967271487eb05c47d57047a873 checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T06:30:09.655750960Z INFO: 172.28.22.23:54593 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T06:30:09.783619959Z INFO 08-22 06:30:09 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5769440f0f4046bb98f09e4873fabfd3 checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T07:48:06.919218196Z INFO: 172.28.22.23:8917 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T07:48:07.046362968Z INFO 08-22 07:48:07 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-eadfc69ee29441978715de827b9828f0 checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T08:47:49.636914790Z INFO: 172.28.22.23:9362 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T08:47:49.763784215Z INFO 08-22 08:47:49 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-5dcd4ca0c5814a07959786f57ff33522 checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T10:20:53.963374831Z INFO: 172.28.22.23:11893 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T10:20:54.090007776Z INFO 08-22 10:20:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-351a4924dbe0463d8aab1a0051276ff4 checkpoint_tokens=160 logical_tokens=176 physical_query_tokens=16
2026-08-22T11:18:24.059901340Z INFO: 172.28.22.23:24897 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T11:18:24.192752563Z INFO 08-22 11:18:24 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4df6090a73d84a51b5c84c809df85322 logical_start=0 logical_end=145 capped_end=128 physical_query_tokens=128
2026-08-22T11:52:07.620820902Z INFO: 172.28.22.23:65351 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T11:52:07.749216522Z INFO 08-22 11:52:07 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-9aa51b042c464fdbbcf7c27e26280f72 checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T12:21:55.569379254Z INFO: 172.28.22.23:17404 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T12:21:55.696015265Z INFO 08-22 12:21:55 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-b6e53f23d832414eaed99ea045e6a642 checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T12:46:16.236530636Z INFO: 172.28.22.23:2684 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T12:46:16.364346686Z INFO 08-22 12:46:16 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-12d10e275a5247cd80cf3853fd68dac5 checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T13:10:53.882009128Z INFO: 172.28.22.23:11635 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T13:10:54.009857238Z INFO 08-22 13:10:54 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-d6571db47d3441c6b659e94b544e12e8 checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T13:33:31.480612408Z INFO: 172.28.22.23:21155 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T13:33:31.610080167Z INFO 08-22 13:33:31 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-2eadf5f531104eae855c9caa8848bb9f checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T13:57:48.600185412Z INFO: 172.28.22.23:57431 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T13:57:48.727569621Z INFO 08-22 13:57:48 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-e09bdeab6a7b417f92b553a7b914c437 checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T14:30:32.540648200Z INFO: 172.28.22.23:38123 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T14:30:32.667895283Z INFO 08-22 14:30:32 scheduler.py:1158] [BI100 GDN FAST-FORWARD] request=chat-0970016d48cc4b01834f9b6ff297f730 checkpoint_tokens=128 logical_tokens=145 physical_query_tokens=17
2026-08-22T14:57:40.126741006Z INFO: 172.28.22.23:26985 - "POST /v1/chat/completions HTTP/1.1" 200 OK
2026-08-22T14:57:40.255003137Z INFO 08-22 14:57:40 scheduler.py:551] [BI100 GDN CAPTURE BOUNDARY] request=chat-4e411045dd944e6dac95175096295f2c logical_start=0 logical_end=90 capped_end=80 physical_query_tokens=80
Reference in New Issue View Git Blame Copy Permalink