EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

BugFix: Resolve PolicyFlashlb warm up function attribute error (#4741)

Browse Source 
## Description
Fix the AttributeError caused by incorrect invocation of the warm-up
function in the FlashLB algorithm:
1. **Root Cause**: The warm-up function for FlashLB is defined outside
the `PolicyFlashlb` class (not a class method), but the code incorrectly
attempted to call it via the `PolicyFlashlb` class instance.
2. **Key Fix**: Clarify the invocation rule for FlashLB: when selecting
the FlashLB algorithm, the warm-up function must be called in advance to
precompile and warm up the algorithm (invoked as a standalone function),
instead of calling it through the `PolicyFlashlb` class.
3. **Impact**: Resolve the runtime error when using FlashLB, ensure the
algorithm pre-compilation/warm-up process works as expected, and avoid
attribute missing exceptions.

Signed-off-by: Mercykid-bash <ruanche0218@gmail.com>
This commit is contained in:
Mercykid-bash
2025-12-12 14:55:26 +08:00
committed by GitHub
parent 4984e8a284
commit 84b9d38e28
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
vllm_ascend/eplb/core/policy/policy_factory.py
View File

@@ -3,7 +3,7 @@
from .policy_abstract import DynamicConfig, EplbPolicy from .policy_abstract import DynamicConfig, EplbPolicy
from .policy_dynamic_ep import DynamicEplb from .policy_dynamic_ep import DynamicEplb
from .policy_dynamic_ep_v2 import DynamicEplbV2 from .policy_dynamic_ep_v2 import DynamicEplbV2
from .policy_flashlb import FlashLB from .policy_flashlb import FlashLB, warm_up
from .policy_random import RandomLoadBalance from .policy_random import RandomLoadBalance
@@ -29,5 +29,5 @@ class PolicyFactory:
policy_class = policy.get(policy_type, RandomLoadBalance) policy_class = policy.get(policy_type, RandomLoadBalance)
policy_instance = policy_class(config) policy_instance = policy_class(config)
if policy_type == 3: if policy_type == 3:
policy_instance.warm_up() warm_up()
return policy_instance return policy_instance