[PD] Optimize custom mem pool usage and bump mooncake version (#7393)

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
This commit is contained in:
Shangming Cai
2025-06-21 00:50:39 +08:00
committed by GitHub
parent ceba0ce4f6
commit 187b85b7f3
3 changed files with 7 additions and 58 deletions

View File

@@ -23,7 +23,7 @@ pip install -e "python[dev]"
pip list
# Install additional dependencies
pip install mooncake-transfer-engine==0.3.2.post1 nvidia-cuda-nvrtc-cu12
pip install mooncake-transfer-engine==0.3.4 nvidia-cuda-nvrtc-cu12
# For lmms_evals evaluating MMMU
git clone --branch v0.3.3 --depth 1 https://github.com/EvolvingLMMs-Lab/lmms-eval.git